Pro Yearly is on sale from $80 to $50! »

COVID-19 に対するオープンデータの取り組み

COVID-19 に対するオープンデータの取り組み

第44回 Machine Learning 15minutes! で登壇した際の資料です

8fa31051503b09846584c49cd53d2f80?s=128

Asei Sugiyama

April 25, 2020
Tweet

Transcript

  1. COVID-19 ʹؔ͢Δ ΦʔϓϯσʔλͷऔΓ૊Έ ୈ 44 ճ Machine Learning 15minutes! 1

  2. ࣗݾ঺հ • ਿࢁ Ѩ੟ • Software Engineer @ Repro AI

    Labs • TensorFlow ίϯτϦϏϡʔλʔ • TFX : Issue ཱͯͨΓ PR ཱͯͨΓ • docs-l10n : ຋༁ & ϨϏϡʔ • ػցֶशਤؑ ڞஶ 2
  3. ஫ҙࣄ߲ • ͋͘·ͰݸਓతͳݟղͰ͋Γɺॴଐ͢Δ͍͔ͳΔஂମͱ΋ແؔ ܎Ͱ͢ • σʔλαΠΤϯεͷ࿩͸͋·Γ͠·ͤΜ • ػցֶशͷ࿩͸͠·ͤΜ • COVID-19

    ʹؔ͢Δকདྷ༧ଌͷ࿩͸͠·ͤΜ • COVID-19 ͷײછ༧๷ͷ࿩͸͠·ͤΜ 3
  4. ຊ೔ͷ಺༰ 1.Open Data ͱ͸ <- 2.COVID-19 ʹؔ͢Δ Open Data ͱͦͷ׆༻

    3.զʑ͸σʔλͰԿ͕Ͱ͖Δͷ͔ 4
  5. Open Data ͱ͸ • “Open data and content can be

    freely used, modified, and shared by anyone for any purpose” from The Open Definition • ϚγϯϦʔμϒϧͰ͋Δ͜ͱ΋ॏཁࢹ • Data.gov : ΞϝϦΧͷΦʔϓϯσʔ λͷαΠτ (ӈਤ) • Data Portals : 588 ͷΦʔϓϯ σʔλͷΧλϩά 5
  6. ೔ຊͷ Open Data • ࣏ࣗମ͕ؤு͍ͬͯΔ • data.go.jp • σʔλγςΟḉߐϙʔλϧαΠτ •

    ͍͢͝ (ޙड़) • ౦ژ౎ΦʔϓϯσʔλΧλϩάαΠτ ϗʔϜϖʔδ 6
  7. ΦʔϓϯσʔλΛ͸͡ΊΑ͏1 • ੓෎΍ಠཱߦ੓๏ਓɺ࣏ࣗମͳͲ͕อ ༗͢Δެڞσʔλ͕ɺࠃຽ΍اۀͳͲ ͷར׆༻͞Ε΍͍͢Α͏ʹػձ൑ಡʹ దͨ͠ܗͰɺೋ࣍ར༻Մೳͳϧʔϧͷ ΋ͱͰެ։͞ΕΔ͜ͱɺ·ͨɺͦͷΑ ͏ʹެ։͞ΕͨσʔλΛࢦ͠·͢ 1 http://www.kantei.go.jp/jp/singi/it2/densi/kettei/

    opendata_tebikisyo.pdf 7
  8. σʔλγςΟḉߐϙʔ λϧαΠτ • ͞·͟·ͳσʔλΛ PDF Ͱ͸ͳ͘ CSV, XML, RDF, Linked

    RDF Ͱެ ։͍ͯ͠Δ • ϥΠηϯε͸ CC BY • ྉཧϨγϐ (XML) 8
  9. 9

  10. ͞͹͑஍৔࢈໺ࡊͷྉཧϨγϐ (ൈਮ) ݟ΍͢͞ͷͨΊɺ࠷ޙͷߦʹ͚ͩվߦΛՃ͑ͨ <http://linkdata.org/resource/rdf1s8262i#2> <http://www.w3.org/2000/01/rdf-schema#label> "2"@ja ; <http://linkdata.org/property/rdf1s8262i#%E6%96%99%E7%90%86%E5%90%8D> "΄͏ΕΜ૲ͱ΋΍͠ͷφϜϧ"@ja ;

    <http://linkdata.org/property/rdf1s8262i#%E4%BA%BA%E6%95%B0> "4ਓ෼"@ja ; <http://linkdata.org/property/rdf1s8262i#%E6%9D%90%E6%96%991> "΋΍͠ 170gʢ2/3ାʣ"@ja ; <http://linkdata.org/property/rdf1s8262i#%E6%9D%90%E6%96%99%EF%BC%92> "΄͏ΕΜ૲ 130gʢ2/3ଋʣ"@ja ; <http://linkdata.org/property/rdf1s8262i#%E6%9D%90%E6%96%99%EF%BC%93> "͕ܲΒεʔϓͷૉ খ͞͡2"@ja ; <http://linkdata.org/property/rdf1s8262i#%E6%9D%90%E6%96%99%EF%BC%94> "͝·༉ খ̍͞͡"@ja ; <http://linkdata.org/property/rdf1s8262i#%E8%A9%B3%E7%B4%B0URL> <https://www.city.sabae.fukui.jp/kenko_fukushi/hoken_kenkozukuri/mugenyasai.files/receipi.pdf> . 10
  11. ͞͹͑஍৔࢈໺ࡊͷྉཧϨγϐ • http://linkdata.org/work/ rdf1s8262i • ߹ܭμ΢ϯϩʔυ਺ 4 ճ (2020-04-23 ࣌఺)

    • ࠷ऴߋ৽೔ : 2020/03/17 • Text, Excel, RDF ܗࣜ 11
  12. ຊ೔ͷ಺༰ 1.Open Data ͱ͸ 2.COVID-19 ʹؔ͢Δ Open Data ͱͦͷ׆༻ <-

    3.զʑ͸σʔλͰԿ͕Ͱ͖Δͷ͔ 12
  13. COVID19 ʹؔ͢Δ Open Data ͱͦͷ׆༻ ٸ଎ʹσʔλެ։ɾ׆༻ͷಈ͖͕޿͕͍ͬͯΔɻ • ౦ژ౎ ৽ܕίϩφ΢Πϧεײછ঱ରࡦαΠτ •

    ৽ܕίϩφ΢ΠϧεରࡦμογϡϘʔυ 13
  14. ౦ژ౎ ৽ܕίϩφ΢ Πϧεײછ঱ରࡦαΠ τ • ౦ژ౎ΦʔϓϯσʔλΧλϩάαΠτͷ σʔλ͔Β࡞੒ • αΠτࣗମ΋ MIT

    ϥΠηϯε • Code for Japan ͷ׆ಈͷ 1 ͭ 14
  15. 15

  16. StopCovid19 શࠃ൛ • ౦ژ౎ͷΦʔϓϯιʔεΛར༻ͨ͠αΠ τͷ·ͱΊαΠτ • ͜ͷαΠτࣗମ΋ MIT ϥΠηϯε •

    codeforjapan/stopcovid19 16
  17. ৽ܕίϩφ΢Πϧεର ࡦμογϡϘʔυ • ෱໺ହհ (@taisukef) ࢯ • COVID-19 ͷױऀ͕ར༻Մೳͳපচ਺ ʹண໨ͨ͠αΠτ

    • ްੜ࿑ಇলఏڙͷ৽ܕίϩφ΢Πϧε ཅੑױऀ਺ PDF σʔλΛ JSON-API Խͨ݁͠ՌΛར༻ • ιʔε͸CC BYϥΠηϯεͰఏڙ͞Εͯ ͍Δ 17
  18. ౎ಓ෎ݝผ৽ܕίϩφ΢Πϧεײછऀ਺Ϛοϓ • δϟοάδϟύϯגࣜձࣾ • σʔλ͸ CC-BY-NC 4.0 • ༷ʑͳσʔλιʔε͔Βूܭ͍ͯ͠Δ໛ ༷

    (ෳ਺ਓʹΑΔ࡞ۀ) • ՄࢹԽ͸ ArcGIS (ESRI) 18
  19. தͷਓͷ੠ • https://twitter.com/ oohamazaki/status/ 1253306592595832835?s=20 19

  20. SIGNATE COVID-19 νϟϨϯδ • ϑΣʔζ 1. σʔληοτͷߏங • ϑΣʔζ 2.

    σʔλ෼ੳ • ϑΣʔζ 3. ጶױऀ਺༧ଌ 20
  21. 21

  22. ຊ೔ͷ಺༰ 1.Open Data ͱ͸ 2.COVID-19 ʹؔ͢Δ Open Data ͱͦͷ׆༻ 3.զʑ͸σʔλͰԿ͕Ͱ͖Δͷ͔

    <- 22
  23. ཁࢫ • σʔλ͕࣍ʑʹެ։͞Ε͍ͯΔ͕ɺඇઐ໳ՈͰ͋ΔҰൠࢢຽ͕ ݟͯಘΒΕΔ΋ͷ͸গͳ͍ • ૬ஊ݅਺ͷരൃతͳ૿େ͕ͳ͍ͱ͍͏͜ͱ͸ɺ૭ޱ͕ർฐͯ͠ ͍ΔՄೳੑΛࣔ͢ • Ұൠࢢຽͱͯ࣍͠ʹ Q&A

    Λ੔උ͠ɺͦΕΛΞΫηε͠΍͍͢ ܗͰఏڙͰ͖ΔΑ͏ʹ͢Δ͜ͱΛఏҊ͍ͨ͠ 23
  24. ݸਓతͳ҆৺ • COVID-19 ʹؔ͢Δ AI ສೳ࿦͕ग़ͯ ͍ͳ͍͜ͱ • ༧ଌϞσϧʹΑΔ༬ݴऀ͕࣍ʑʹݱΕ Δঢ়گͰ͸ͳ͍ͷ͸ෆ޾தͷ޾͍

    • σʔληοτͷ੔උͱ͍͏΋ͬͱ΋ॏ ཁͳՕॴʹϦιʔεׂ͕͔Ε͍ͯΔ 24
  25. ػցֶश͸໾ʹཱͭͷ͔ʁ • ػցֶश·Ͱͷεςοϓʹ͓͍ͯɺݱࡏ͸ۀ຿ͷఆٛͷஈ֊ 1.ۀ຿͕ະఆٛ 2.ۀ຿͕ఆٛ͞ΕɺखॱॻΛ࡞Δ 3.खॱ͕໌֬ʹͳΓɺγεςϜԽΛߦ͏ <- ࠓ͸͜ͷ͋ͨΓ 4.৘ใΛՄࢹԽ͠ɺҙࢥܾఆΛߦ͏ <-

    ઐ໳Ո͸͜͜ 5.ҙࢥܾఆͷࣗಈԽ or ิॿ <- ػցֶश͸͜͜ 25
  26. σʔλαΠΤϯςΟετ͸໾ʹཱͭͷ͔ʁ • σʔλͷ׆༻ʹඞཁͳεΩϧͷ෼໺ • σʔλαΠΤϯε • ΤϯδχΞϦϯά • υϝΠϯ஌ࣝ •

    ҰൠͷσʔλαΠΤϯςΟετɾΤϯδχΞ͸ҩֶ΍ެऺӴੜ ͷ஌͕ࣝඞͣ͠΋๛෋ͱ͍͏Θ͚Ͱ͸ͳ͍ 26
  27. ࣗ෼ʹ͸Կ͕Ͱ͖ΔͷͩΖ͏͔ʁ • COVID-19 ͷײછͷ֦େঢ়گʹ͍ͭͯूΊΒΕͨσʔλ͸ɺඇ ઐ໳Ոͷखʹ༨Δ • Titanic ͷσʔλ͔Βɺզʑ͸Կ͔༗༻ͳ஌ݟΛಘΒΕͨͩ Ζ͏͔ʁ •

    υϝΠϯ஌ࣝΛൈ͖ʹɺ਺ཧϞσϧ΍ػցֶशϞσϧΛ༻͍ͯ কདྷ༧ଌΛͨ͠ͱ͜ΖͰɺͦͷ݁Ռ͸Կ͔ҙຯ͕͋ΔͩΖ͏ ͔ʁ 27
  28. Amazon (AWS) ͷύ ϒϦοΫσʔλϨΠΫ • σʔλʹ͸ΞΫηε͠΍͘͢ͳͬͨ • ϚΫϩͳҙࢥܾఆ͸͔֬ʹͰ͖Δ͔΋ ͠Εͳ͍ •

    զʑ͸͜ΕΛݟͯԿΛ͢Ε͹͍͍Μͩ Ζ͏͔ʁ 28
  29. See how your community is moving around differently due to

    COVID-192 • Google ͷϨϙʔτ • Transit stations ΍ Workplace ΛݮΒͤ͹ྑͦ͞͏ͳײ͕͢͡Δ • ײછऀ਺ΑΓ͸མͪண͍ͯݟΒΕΔ 2 Google LLC "Google COVID-19 Community Mobility Reports." https://www.google.com/covid19/mobility/ Accessed: 2020-04-24. 29
  30. զʑ͕ݟΔ΂͖ࢦඪ͸ ͳʹ͔ʁ • ࣍ʹ΍Δ͜ͱ͕ݟ͑ΔࢦඪΛݟ͍ͨ • ͜Ε͸Ͳͷۀ຿ʹண໨͢΂͖͔ͱ͍͏ ໰ʹಉ͡ • ໰͍߹Θͤۀ຿ʹண໨͢Δ͜ͱΛఏҊ ͍ͨ͠

    • ౦ژ౎ ৽ܕίϩφίʔϧηϯλʔ૬ஊ ݅਺ͷྦྷܭ͕ઢܗʹ͔͠৳ͼ͍ͯͳ͍ 30
  31. 31

  32. ࣍ʹ੔උ͢΂͖σʔλ͸ͳʹ͔ʁ • ඞཁͳͷ͸໰͍߹Θͤͱͦͷճ౴ • ༷ʑͳରࡦ͕ଧͨΕ͍ͯΔҰํɺ૭ޱ΁ͷΞΫηε͸໌֬Ͱͳ ͍ (෺ཧతʹ໾ॴʹߦ͚ͳ͍ʂ) ͷͰ͜͏͍ͬͨ૭ޱʹؔ܎ͳ ͍໰͍߹Θ͕ͤࡴ౸͍ͯ͠Δ͜ͱ͕༧૝͞ΕΔ •

    Q&A σʔλΛ༻͍ͨݕࡧΤϯδϯ͸໌Β͔ʹ༗ޮ • Q&A σʔλͱγφϦΦΛݩʹͨ͠νϟοτϘοτ͸༗ޮ 32
  33. 33

  34. https://corona.go.jp/ ʹઃஔࡁ 34

  35. ૝ఆ͞ΕΔ՝୊ • ηϯγςΟϒͳ࣭໰͕૬౰ྔدͤΒΕ Δ͜ͱ͕૝ఆ͞Εɺੜσʔλͷอ؅͸ Ͱ͖ͳ͍ • ঢ়گ͕໨·͙Δ͘͠มԽ͢Δ݁Ռɺಉ ࣭͡໰ʹରͯ͠΋ద੾ͳճ౴͕ৗʹม ΘΓଓ͚ΔͨΊɺσʔληοτͷߋ৽ ͕ඞཁ

    • લऀ͸ͱ΋͔͘ޙऀʹ͍ͭͯ͸ࢢຽͰ Ͱ͖Δ͜ͱ͕͋ΔͷͰ͸ 35
  36. ͳͥզʑ͸ϚεΫΛٻ Ίͯ͠·͏ͷ͔ • ڴҖʹରͯ͠Ͱ͖Δ͜ͱ͕ͳʹ΋ͳ͍ ͱ͍͏ετϨε͔ΒճආͰ͖Δ • ϚεΫ͸ങ͍ٻΊΔ͜ͱ͕Ͱ͖Δͷ Ͱɺڻҟʹରͯ͠औΕΔΞΫγϣϯʹ ͳ͍ͬͯΔ http://www.osaka-kyoiku.ac.jp/

    ~toyosawa/klecture09.pdf 36
  37. σʔληοτͷ੔උ͸ࢢຽ͕ߦ͑ΔΞΫγϣϯ • ඇઐ໳ՈͰ΋ࢀՃͰ͖Δ • ࡞Δ͜ͱΑΓ΋อक͢Δ͜ͱʹଟେͳख͕͔͔ؒΔ (ϦϯΫ੾ Ε΍σʔλͷܗࣜมߋ΁ͷରॲͱ͔) • σʔληοτ͕͋Ε͹ΤϯδχΞͷྗͰιϑτ΢ΣΞʹͰ͖Δ •

    ιϑτ΢ΣΞʹͰ͖Ε͹֦ࢄͰ͖Δ • SIGNATE ͷऔΓ૊Έ͸͋Δҙຯཧ૝త 37
  38. Recap • σʔλ͕࣍ʑʹެ։͞Ε͍ͯΔ͕ɺඇઐ໳ՈͰ͋ΔҰൠࢢຽ͕ ݟͯಘΒΕΔ΋ͷ͸গͳ͍ • ૬ஊ݅਺ͷരൃతͳ૿େ͕ͳ͍ͱ͍͏͜ͱ͸ɺ૭ޱ͕ർฐͯ͠ ͍ΔՄೳੑΛࣔ͢ • Ұൠࢢຽͱͯ࣍͠ʹ Q&A

    Λ੔උ͠ɺͦΕΛΞΫηε͠΍͍͢ ܗͰఏڙͰ͖ΔΑ͏ʹ͢Δ͜ͱΛఏҊ͍ͨ͠ 38