Upgrade to Pro — share decks privately, control downloads, hide ads and more …

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=47 Gaurav Vaidya
May 28, 2014
Science
0
49

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=128

Gaurav Vaidya

May 28, 2014
Tweet

More Decks by Gaurav Vaidya

See All by Gaurav Vaidya
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
34
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
120
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
160
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
72
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
76
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
53
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
58
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
110
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
52

Other Decks in Science

See All in Science
F48d3107f5e7a4c6f765752df9754e6b?s=48 fam_taro
4
1.4k
A2cac4b3dcb2bc0b87917ddc034ef708?s=48 sansandsoc
0
520
5473f177bf5562e68645e1a6e0428f9c?s=48 kuto5046
3
600
753fba590507a4c2b0fa921f4bef68ab?s=48 ryoozawa
PRO
0
5.5k
B95f9b24c808ceab3f66f64991047b22?s=48 roy29fuku
5
270
D57a02ba9a9ecb65d11370e3abf4dddc?s=48 abigailstev
0
190
2c68dc672293cc3f8a7a57d3af86f15b?s=48 koukyo1994
3
310
A2cac4b3dcb2bc0b87917ddc034ef708?s=48 sansandsoc
1
1k
9c7f843b850f4e4beeb53c93893c4ff0?s=48 hugoledoux
0
310
931bf827a9410634647b1b71f863555c?s=48 highlow
0
400
Afcf52f6df4e2856cc0fce598c4af4e1?s=48 kamakiri1225
0
150
8554778f1060f77c8eec4e88a30369ac?s=48 unaoya
0
1.8k

Featured

See All Featured
B47b288784fda77a94aeb234ca743c24?s=48 keavy
111
15k
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
261
20k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
496
110k
0fe2973fa8d27d96547e43322341183a?s=48 swwweet
209
7.2k
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
72
3.9k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
224
48k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
208
20k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
449
36k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
288
47k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
148
20k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
122
16k

Transcript

  1. Scientific names (genus, species)

  2. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

  3. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental

  4. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  5. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  6. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus

  7. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus Leopardus Acanthisitta Myoxocephalus

  8. Scientific names (genus, species) Python 3 script (bettertaxonomy.py)

  9. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database

  10. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists

  11. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine

  12. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV

  13. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Dropbox/GitHub

  14. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World Dropbox/GitHub

  15. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  16. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  17. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  18. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Dropbox/GitHub

  19. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase Dropbox/GitHub

  20. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  21. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  22. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub Semi-meaningless names!

  23. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

  24. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop

  25. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing

  26. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing • To: https://docs.google.com/spreadsheets/d/ 1Jpr6stWGR3qe0swQ4_215kogau2lqmWxaDivBbGVd60/ edit?usp=sharing

  27. Next steps 1. Speed: caching, combine queries 2. Prioritise checklists:

    by class, in configuration file 3. Higher taxonomy: support semi-meaningful names