aboutsummaryrefslogtreecommitdiff
path: root/workflows/pull-data/genbank/README.md
blob: 5464d1da7a8ff9f51f58c38abd1737057e8f80b6 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
# GenBank

This directory contains the tools to pull and transform
GenBank data.

# Workflows

## Prepare new GenBank data for upload

The following workflow sends GenBank data into PubSeq

```sh
# --- get list of IDs already in PubSeq
../../tools/sparql-fetch-ids > pubseq_ids.txt
# --- get list of missing genbank IDs
python3 genbank-fetch-ids.py --skip pubseq_ids.txt > genbank_ids.txt

# --- fetch XML
python3 update-from-genbank.py --ids genbank_ids.txt --out ~/tmp/genbank

# --- Transform to YAML/JSON and FASTA
python3 transform-genbank-xml2yamlfa.py --out ~/tmp/pubseq file(s)

# --- Normalize data (validation mode)
python3 ../../workflows/tools/normalize-yamlfa.py -s ~/tmp/yamlfa/state.json --species ncbi_host_species.csv --specimen specimen.csv --validate

```

# TODO

- [ ] Add id for GenBank accession - i.e. how can we tell a record is from GenBank