aboutsummaryrefslogtreecommitdiff
path: root/workflows/pull-data/genbank/README.md
blob: 188ff6fd392cd514dd88eb1edc2e0b781de971d9 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
# GenBank

This directory contains the tools to pull and transform
GenBank data.

# Workflows

## Prepare new GenBank data for upload

The following workflow sends GenBank data into PubSeq

```sh
# --- get list of IDs already in PubSeq
../../tools/pubseq-fetch-ids > pubseq_ids.txt

# --- get list of missing genbank IDs
python3 genbank-fetch-ids.py --skip pubseq_ids.txt > genbank_ids.txt

# --- fetch XML
python3 update-from-genbank.py --ids genbank_ids.txt --out ~/tmp/genbank

# --- Transform to YAML/JSON and FASTA
python3 transform-genbank-xml2yamlfa.py --out ~/tmp/pubseq file(s)

# --- Normalize data (validation mode)
python3 ../../workflows/tools/normalize-yamlfa.py -s ~/tmp/yamlfa/state.json --species ncbi_host_species.csv --specimen specimen.csv --validate

```

## Validate GenBank data

To pull the data from PubSeq use the list of pubseq ids generated
above.



# TODO

- [X] Add id for GenBank accession - i.e. how can we tell a record is from GenBank