Upgrade to Pro — share decks privately, control downloads, hide ads and more …

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=47 Gaurav Vaidya
May 28, 2014
Science
0
44

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=128

Gaurav Vaidya

May 28, 2014
Tweet

More Decks by Gaurav Vaidya

See All by Gaurav Vaidya
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
23
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
80
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
120
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
54
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
61
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
41
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
46
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
98
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
45

Other Decks in Science

See All in Science
A2cac4b3dcb2bc0b87917ddc034ef708?s=48 sansandsoc
1
320
E09657ebf3fe2de5698d5797266a05c4?s=48 itakeshi
3
1.3k
1135dc242dcff3b90ae46fc586ff4da8?s=48 signer
1
4.4k
7382f7fe30561274624635116513ca37?s=48 lcolladotor
0
750
8ba32afb4b7d6967cb38b2dadf1ddd80?s=48 daigo0927
1
480
696e66ab859446f91081e37e56444730?s=48 event2020
0
110
579e722d179220daaa4870e1facd9633?s=48 hachama
0
120
D73dc2189cf378ae9088283c720d0331?s=48 pacmannai
1
150
38e2af7f8bdad4f2087ab3d42b627e33?s=48 shuntaros
0
460
02a84f9b8af46c6c3ef7c4b1f9bbb56f?s=48 masso
6
1.2k
38e2af7f8bdad4f2087ab3d42b627e33?s=48 shuntaros
0
460
D0a72daa3738ec03ac6bec53fd5df04e?s=48 scrummasudar
2
450

Featured

See All Featured
651dcfe41723207fbb0aa044a4f7c07f?s=48 dotmariusz
94
5.1k
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
500
36k
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
7
520
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
111
9.9k
C157b16234f1e75e8eac3698c1d4414a?s=48 ddemaree
274
31k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
52
4.1k
Ae14cc4491ac334f9cd23f9f93b4305e?s=48 orderedlist
PRO
329
35k
5ce91fa49a613cbc3e20d5f96856473f?s=48 edds
56
9.3k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
192
8.5k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
358
62k
D8fc2580cfaca035f666d9e4ee79a7f7?s=48 mongodb
23
3.8k
E190023b66e2b8aa73a842b106920c93?s=48 zenorocha
297
39k

Transcript

  1. Scientific names (genus, species)

  2. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

  3. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental

  4. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  5. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  6. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus

  7. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus Leopardus Acanthisitta Myoxocephalus

  8. Scientific names (genus, species) Python 3 script (bettertaxonomy.py)

  9. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database

  10. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists

  11. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine

  12. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV

  13. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Dropbox/GitHub

  14. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World Dropbox/GitHub

  15. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  16. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  17. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  18. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Dropbox/GitHub

  19. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase Dropbox/GitHub

  20. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  21. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  22. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub Semi-meaningless names!

  23. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

  24. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop

  25. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing

  26. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing • To: https://docs.google.com/spreadsheets/d/ 1Jpr6stWGR3qe0swQ4_215kogau2lqmWxaDivBbGVd60/ edit?usp=sharing

  27. Next steps 1. Speed: caching, combine queries 2. Prioritise checklists:

    by class, in configuration file 3. Higher taxonomy: support semi-meaningful names