Upgrade to Pro — share decks privately, control downloads, hide ads and more …

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=47 Gaurav Vaidya
May 28, 2014
Science
0
52

VertNet bettertaxonomy.py presentation

Ef10e56567f5d6e20bc3f7f4ab4e3254?s=128

Gaurav Vaidya

May 28, 2014
Tweet

More Decks by Gaurav Vaidya

See All by Gaurav Vaidya
All the Clades in the World: Building a Semantically-Rich and Testable Ontology of Phylogenetic Clade Definitions
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
45
Creating computable definitions for clades using the Web Ontology Language (OWL)
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
170
The Semantic Clade
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
190
VRA 2015 - Describing natural history illustrations in the Art of Life project via the Wikipedia Commons platform
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
82
Tracking Taxonomic Changes: how, where and why
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
87
Editing Wikipedia
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
71
Quantifying Taxonomic Redescription: Patterns of lumping and splitting in the last 127 years of the Check-List of North American Birds
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
66
Validating taxonomic names (BITW 2013)
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
0
110
Species description versus redescription rates: Are we getting wiser about biodiversity, more frivolous, or both?
Ef10e56567f5d6e20bc3f7f4ab4e3254?s=48 gaurav
1
60

Other Decks in Science

See All in Science
SpaceXから学ぶ人生観 ～元JWが自分の人生を取り戻すヒント～
B420a81f863b4a6750073cfeca603df6?s=48 caesar2022
0
130
20220220_球体周りの流れ抗力係数4_simpleFoamで球体周りの定常流れ
Afcf52f6df4e2856cc0fce598c4af4e1?s=48 kamakiri1225
0
270
[勉強会資料メモ] Double/Debiased ML
B583d0943fe698dd7fc75d30d02f099f?s=48 masa_asa
0
280
Text Gestalt: Stroke-Aware Scene Text Image Super-Resolution
59d6ec9d4308628a6009b2ec5bc6d2d8?s=48 sansan_randd
1
1k
確率統計 - 機械学習その前に -
31b9c72bb29c5bbbeb6780f982c4350f?s=48 hidekatsu_izuno
0
2k
OpenFAOM_pisoFoamによる2次元円柱周りの解析
Afcf52f6df4e2856cc0fce598c4af4e1?s=48 kamakiri1225
0
730
Tokoy.R #99 パーマーステーションのペンギンたち #1
Ea0b0e1760fae9c7599f86c3555e071d?s=48 bob3bob3
1
590
AI最新論文読み会2021年11月
0886c70b5ecf3b0b0ee6500c5e47884d?s=48 ecoopnet
0
220
機械学習を用いた効果検証~回帰分析とT-Learner~
2af18b4a7c797f2d0abf2429b65d5445?s=48 s1ok69oo
0
120
Unlocking the Potential of Cloud Native Science with Pangeo
654d48d6c1c10c50c160954ba31207a2?s=48 rabernat
0
110
mROS 2：組込みデバイス向けのROS 2ノード軽量実行環境
91b03a57e0ef56fee59fbddc66a7f6fd?s=48 takasehideki
0
330
Accumulated Local Effects（ALE）で機械学習モデルを解釈する / TokyoR95
7a0892afffbcbd35fd84d46508b3a914?s=48 dropout009
2
3.2k

Featured

See All Featured
Navigating Team Friction
245cee81a9c424266e5e401d844ea881?s=48 lara
175
11k
Gamification - CAS2011
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
75
3.9k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
269
12k
Designing Experiences People Love
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
130
22k
JavaScript: Past, Present, and Future - NDC Porto 2020
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
37
3.3k
Atom: Resistance is Futile
7fa6101cd43067653cf4ac6c7ca54305?s=48 akmur
255
20k
Creatively Recalculating Your Daily Design Routine
48c098b6579220a67a6ba949be6e4b5a?s=48 revolveconf
207
10k
VelocityConf: Rendering Performance Case Studies
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
316
22k
Why Our Code Smells
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
324
55k
Typedesign – Prime Four
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
34
1.4k
It's Worth the Effort
Ba530e786553390f3fb271848485681c?s=48 3n
172
26k
A Modern Web Designer's Workflow
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
689
180k

Transcript

  1. Scientific names (genus, species)

  2. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

  3. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental

  4. Meaningless name Scientific names (genus, species) Meaningful name Semi-meaningless name

    UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  5. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE

  6. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus

  7. Meaningless name Scientific names (genus, species) Meaningful name Outdated name

    Current name Semi-meaningless name UNKNOWN Blank Incidental FROG OR TOAD, UNIDENTIFIED Green bird with blunt bill. Unidentified. UNKNOWN ANTSHRIKE Oncifelis Acanthidositta Acanthocottus Leopardus Acanthisitta Myoxocephalus

  8. Scientific names (genus, species) Python 3 script (bettertaxonomy.py)

  9. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database

  10. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists

  11. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine

  12. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV

  13. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Dropbox/GitHub

  14. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World Dropbox/GitHub

  15. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  16. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  17. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS Dropbox/GitHub

  18. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Dropbox/GitHub

  19. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase Dropbox/GitHub

  20. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  21. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub

  22. Scientific names (genus, species) Python 3 script (bettertaxonomy.py) 1. Internal

    database 2. GBIF Checklists 3. TaxRefine Local CSV Mammal Species of the World ITIS NCBI Taxonomy Fishbase … Dropbox/GitHub Semi-meaningless names!

  23. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

  24. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop

  25. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing

  26. Usage • $ python3 better_taxonomy.py input.csv -i internal.csv > output.csv

    • Program: https://github.com/gaurav/bettertaxonomy/tree/ develop • From: https://docs.google.com/spreadsheets/d/16Dpuo- NqXjpjCLVrHHyQ0uvQxNQA35oIQOewPHrLLfg/edit? usp=sharing • To: https://docs.google.com/spreadsheets/d/ 1Jpr6stWGR3qe0swQ4_215kogau2lqmWxaDivBbGVd60/ edit?usp=sharing

  27. Next steps 1. Speed: caching, combine queries 2. Prioritise checklists:

    by class, in configuration file 3. Higher taxonomy: support semi-meaningful names