VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=47 Gaurav Vaidya
May 28, 2014
Science
0
43

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=128

Gaurav Vaidya

May 28, 2014
Tweet

More Decks by Gaurav Vaidya

See All by Gaurav Vaidya
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
23
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
78
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
120
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
52
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
56
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
40
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
42
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
97
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
45

Other Decks in Science

See All in Science
Aaf6190c3d7508c00df5b17b81cb94eb?s=48 maleehafatima
1
440
Acf2c97fd68b165d50bdf8f446afc0e7?s=48 cynthiazanoni
1
230
4fe5193960c3289769e3913281560dc4?s=48 takay88
0
360
6a1bd125b0e5bba1f6e9dd1551b4cbfc?s=48 taichiiiiiiiiiiiii
0
420
847a328633b1df6b11cc2f72430025e6?s=48 ks91
1
160
Af15066cec0a8e1a8d0fd0a3bae02965?s=48 eweitz
1
130
Cef25a38df4639275be8726a6d5f1906?s=48 shiftpn
0
1.5k
1135dc242dcff3b90ae46fc586ff4da8?s=48 signer
0
2k
Ab40fb58b38d364f318c06e5936c4bc8?s=48 settenqb
8
1.4k
097c045028b149ca7fd4ca42ff859cd9?s=48 ko_fujita1
1
1.4k
8f5c72286a3cac9fc87d2b81689d4b7b?s=48 satokeiju
6
1.8k
019abed4c3338ed64d8060cf2fe91ab1?s=48 housecat442
20
6.7k

Featured

See All Featured
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
770
190k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
190
8.7k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
24
1.7k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
497
130k
E837d2996f52008ace055a08fbfff992?s=48 frogandcode
123
20k
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
87
3.2k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
285
110k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
219
110k
245cee81a9c424266e5e401d844ea881?s=48 lara
590
60k
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
175
14k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
653
54k
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
91
2.8k

Transcript

  1. Scientific names (genus, species)

  2. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

  3. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental

  4. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  5. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  6. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus

  7. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus Leopardus Acanthisitta Myoxocephalus

  8. Scientific names (genus, species) Python 3 script (bettertaxonomy.py)

  9. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database

  10. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists

  11. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine

  12. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV

  13. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Dropbox/GitHub

  14. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World Dropbox/GitHub

  15. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  16. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  17. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  18. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Dropbox/GitHub

  19. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase Dropbox/GitHub

  20. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  21. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  22. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub Semi-meaningless names!

  23. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

  24. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop

  25. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing

  26. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing • To: https://docs.google.com/spreadsheets/d/ 1Jpr6stWGR3qe0swQ4_215kogau2lqmWxaDivBbGVd60/ edit?usp=sharing

  27. Next steps 1. Speed: caching, combine queries 2. Prioritise checklists:

    by class, in configuration file 3. Higher taxonomy: support semi-meaningful names