Upgrade to Pro — share decks privately, control downloads, hide ads and more …

(せーのっ)「いますぐはじめるえむえるおぷす」

Aipa
September 17, 2021

 (せーのっ)「いますぐはじめるえむえるおぷす」

https://churadata.connpass.com/event/222561/

「機械学習を「いい感じ」にする技術’で発表したスライドです。

Aipa

September 17, 2021
Tweet

More Decks by Aipa

Other Decks in Technology

Transcript

  1. ػցֶशΛʮ͍͍ײ͡ʯ
    ʹ͢Δٕज़
    ΞΠύʔୂ௕ 2021/09/17@JX௨৴ࣾ x ͪΎΒσʔλ߹ಉษڧձ

    View Slide

  2. ʢͤʔͷͬʣ
    ͍·͙͢͸͡ΊΔ
    ͑Ή͑Δ͓΀͢

    View Slide

  3. ݁࿦͔Β࿩͠·͕͢
    ͸͡·Γ·ͤΜͰͨ͠

    View Slide

  4. ຊ౰ʹ͋Γ͕ͱ͏
    ͍͟͝·ͨ͠

    View Slide

  5. ϥΠτχϯάτʔΫʂʂʂʂʂ

    View Slide

  6. ·͊Ͱ΋୭΋ظ଴͍ͯ͠ͳ͍λΠτϧʢྦʣ
    ͩͬͨͱࢥ͏ͷͰɺ͜Ε͔Β͸๻ͷۤ࿑࿩Ͱ
    ΋ฉ͍͓ͯ͘Ε
    ໘നͦ͏
    ໘നͦ͏
    ໘നͦ͏
    ໘നͦ͏
    ʁʁʁʁ

    View Slide

  7. ࣗݾ঺հ

    View Slide

  8. ࣗݾ঺հ
    • ΞΠύʔʢAipaʣୂ௕ʢຬ31ࡀʣ
    • ೋࣇͷ෕
    • ͪΎΒσʔλגࣜձࣾ
    • ৭ʑ΍Γ·͢
    • ΰδϥ͕޷͖Ͱ͢

    View Slide

  9. ࠓ೔࿩͢͜ͱ
    ʢ΍Γ͔ͨͬͨ͜ͱʣ

    View Slide

  10. ࿩͢͜ͱʢ΍Γ͔ͨͬͨ͜ͱʣ
    • G.I.I.C.Systemͷ։ൃ

    View Slide

  11. ࿩͢͜ͱʢ΍Γ͔ͨͬͨ͜ͱʣ
    • G.I.I.C.Systemͷ։ൃ
    • Godzillaʢΰδϥͷʣ
    • Imageʢը૾Λʣ
    • Iikanjiʢ͍͍ײ͡ʹʣ
    • Collectʢͱͬͯ͘Δʣ
    • Systemʢͯ͢͠Ήʣ

    View Slide

  12. ΰδϥʹғ·Εͯ
    ই֐ੜ֔Λऴ͍͑ͨ

    View Slide

  13. ΞʔΩςΫνϟਤ
    ʢશྗͰະ׬੒͑Ή͑Δ͓΀͢ʣ
    "NB[PO4BHF.BLFS
    .PEFM
    ϥϕϦϯάɾ
    Ξϊςʔγϣϯπʔϧ
    4
    4
    ϚΠ(16Ϛγϯ
    5SBJO
    4
    લॲཧScript 4BHF.BLFS&OEQPJOU
    ͓·͍Β
    44UBUJD)PTUJOH
    &$3
    ,FESP

    View Slide

  14. ΞʔΩςΫνϟਤ
    ʢશྗͰະ׬੒͑Ή͑Δ͓΀͢ʣ
    "NB[PO4BHF.BLFS
    .PEFM
    ϥϕϦϯάɾ
    Ξϊςʔγϣϯπʔϧ
    4
    4
    ϚΠ(16Ϛγϯ
    5SBJO
    4
    લॲཧScript 4BHF.BLFS&OEQPJOU
    ͓·͍Β
    44UBUJD)PTUJOH
    &$3
    σʔλ෼ׂͷύϥϝʔλͱ͔
    ར༻ͨ͠σʔλͷύεͱ͔
    ֶशύϥϝʔλ౳
    ֶशதͷϩάͱ͔
    ,FESP
    1SFBOOPUBUJPOతͳ΍ͭ
    ͤͬͤͱूΊΔͷ͸ͩΔ͍ͷ
    Ͱɺ"1*Λ࢖͏

    View Slide

  15. ະ׬੒ͳΒ͠ΐ͏͕ͳ͍
    ؾ࣋ͪΛ੾Γସ͑·͢
    • Pipelineͱ͔mlflowͱ͔sagemaker͸ਖ਼௚օ༷͍ͬͺ͍૊Μͩ͜ͱ͋Δͩͱ
    ࢥ͍·͢ɻࠓߋ͍͍ΑͶʢʣ
    • ႈ౳ੑͱ͔ฒྻԽͱ͔ߴ଎Խͱ͔ߟ͑Δ͜ͱ͍ͬͺ͍͋Γͦ͏Ͱ͕͢ɺج
    ຊϐλΰϥεΠονͳΜͰ͠ΐʁʢҟ࿦͸ೝΊΔʣ
    • ࠓճΞϊςʔγϣϯ͔Βελʔτ͠Α͏ͱࢥ͚ͬͨͲɺԿ࢖͓͏͔ͳͬͯ
    ࢥͬͯͨʢ࢖ͬͨ͜ͱͳ͍ʣ
    • Կ͔ྑ͍πʔϧͳ͍͔ͳʔʁ
    • ͦ΋ͦ΋Ξϊςʔγϣϯͱ͔ϥϕϦϯάͷϑΣʔζͬͯMLOpsͳͷʁʁʁ

    View Slide

  16. ͦ͏Έ͍ͨͰ͢
    https://aws.amazon.com/jp/sagemaker/

    View Slide

  17. ͔͍ͨ͋͋͋͋͋͋͋͋
    https://aws.amazon.com/jp/sagemaker/

    View Slide

  18. Կ͔ྑ͍πʔϧͳ͍͔ͳʔ
    ʢ2ճ໨ʣ
    https://qiita.com/shu-yusa/items/d19ea57e3cf9c4dbdce2

    View Slide

  19. ͓ʁʢ^ω^ = ^ω^ʣ
    https://twitter.com/1027kg/status/1392852597166379009

    View Slide

  20. ͳʹ͜ΕΑͦ͞͏
    https://labelstud.io/

    View Slide

  21. ͋Βૉఢ
    https://labelstud.io/

    View Slide

  22. ͋Βʙʙʙ
    https://labelstud.io/api#tag/Annotations

    View Slide

  23. ͖Όʔʔʔʔʔʔ
    https://labelstud.io/guide/storage.html

    View Slide

  24. ͍͢͝ʙʢͳʹ͜Εʣ

    View Slide

  25. αΫαΫʂʂʢମײʣ

    View Slide

  26. Export Data…

    View Slide

  27. !!!!???

    View Slide

  28. !!!!???

    View Slide

  29. !!!!???
    _(:3 ʯ㲃) ŴŗŖ

    View Slide

  30. ͏ͻΐʙʙʙʙ

    View Slide

  31. ௒ྑ͍
    (Αͦ͞͏)

    View Slide

  32. ແࣄπʔϧબఆ͕͢Μͩͱ͜ΖͰɺ
    ͜Ε͔Β͸ۤ࿑࿩
    • Label Studio
    • Kedro
    • YOLOv5
    • MLFlow
    • SageMaker

    View Slide

  33. εοɾɾɾ
    • Label Studio
    • Kedro
    • YOLOv5
    • MLFlow
    • SageMaker

    View Slide

  34. MLOpsɾɾɾʁ
    ͓લɾɾɾʂʁ
    • Label Studio
    • Kedro
    • YOLOv5
    • MLFlow
    • SageMaker

    View Slide

  35. • Label Studio
    • Kedro
    • YOLOv5
    • MLFlow
    • SageMaker
    ΏΔ͠(ry

    View Slide

  36. ۤ࿑࿩

    View Slide

  37. ۤ࿑࿩ʢ͓ʔΔ͋ͷͯʔ͠ΐΜʣ
    • ը૾͕දࣔ͞Εͳ͍ʢ403໰୊ʣ
    • ΞΫηεΩʔඞਢʢͦ͏Ͱ͸ͳ͍͚Ͳɺ͚ͭͨํ͕શػೳ
    Λར༻Ͱ͖Δʣ
    • APIυΩϡϝϯτ͕଍Γͳ͍
    • [Export] Downloadํ๏͕ࡌ͍ͬͯͳ͍
    • Request Parameter͕লུ͞ΕͯͯࠔΔ

    View Slide

  38. ը૾͕දࣔ͞Εͳ͍ʢ403໰୊ʣ
    • ઃఆͰS3ॺ໊෇͖ͩͱ͏·͘දࣔ͞Εͳ͍
    • ࢼ͍ͯ͠ͳ͍͚ͲΞΫηεΩʔͷઃఆ͕ଟ෼
    ඞਢ
    • ӳޠ͸ͪΌΜͱಡΉΜͩʢռΊʣ

    View Slide

  39. ͜ͷล
    • ઃఆͰS3ॺ໊෇͖ͩͱ͏·͘දࣔ͞Εͳ͍
    • ࢼ͍ͯ͠ͳ͍͚ͲೝূΩʔͷઃఆ͕ଟ෼ඞਢ
    • ӳޠ͸ͪΌΜͱಡΉΜͩʢռΊʣ

    View Slide

  40. ը૾͕දࣔ͞Εͳ͍ʢbase64໰୊ʣ
    • Project࡞੒͔ΒɺS3σʔλSyncޙɺϦετΛදࣔ͠Α͏
    ͱ͢Δͱಈ͔ͳ͘ͳΔ
    • Base64ͷจࣈྻ͕େྔʹը໘ߋ৽͢Δͱ͜͏ͳΔͬΆ͍
    • ๷͗ํ͕Θ͔Βͳ͍
    • 1ճ໨͸਺ຕΞοϓϩʔυ → Sync → දࣔͰ͖Δ͜ͱ
    ֬ೝͰ͖ͨΒɺશ෦Ξοϓϩʔυ → Sync Ͱ҆ఆ͢Δ

    View Slide

  41. ΞΫηεΩʔඞਢ
    • EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)෇༩͠
    ͨΒΞΫηεΩʔ͸͍Βͳ͍
    • ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμ΢ϯϩʔυ
    ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ
    • Ξϊςʔγϣϯ͕׬ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬ
    ͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ
    (´ɾωɾʆ)͢ΔͷͰ΍͓ͬͯ͘Μͩʂʂʂ

    View Slide

  42. ΞΫηεΩʔඞਢ
    • EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)෇༩͠
    ͨΒΞΫηεΩʔ͸͍Βͳ͍
    • ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμ΢ϯϩʔυ
    ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ
    • Ξϊςʔγϣϯ͕׬ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬ
    ͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ
    (´ɾωɾʆ)͢ΔͷͰ΍͓ͬͯ͘Μͩʂʂʂ
    ͜Ε࣮͸ҧ͔ͬͨͷͰޙ೔ϒϩά͔Ͳ͔͜Ͱ

    View Slide

  43. APIυΩϡϝϯτ͕଍Γͳ͍
    • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ
    ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ
    • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ
    ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍
    • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ
    ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ

    View Slide

  44. ΈΜͳͷ৺ͷ੠
    ʢ͓લ͕هࣄॻ͚͹͍͍ͷͰ͸ɾɾɾʁʣ
    • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ
    ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ
    • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ
    ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍
    • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ
    ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ

    View Slide

  45. • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ
    ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ
    • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ
    ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍
    • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ
    ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ
    ͔ͨ͠
    ʢ͔ͨ͠ʹʣ

    View Slide

  46. • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ
    ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ
    • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ
    ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍
    • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ
    ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ
    ͔ͨ͠
    ʢ͔ͨ͠ʹʣ
    དྷिʹ͸ॻ͜͏ͱࢥ͍·͢
    ʢϑϥάʣ

    View Slide

  47. σϞ

    View Slide

  48. σϞ಺༰
    • Label Studioͷىಈ
    • S3ͱͷ࿈ܞ
    • Ξϊςʔγϣϯ࡞ۀ
    • APIͷར༻
    • Export

    View Slide

  49. ·ͱΊ

    View Slide

  50. ·ͱΊ
    • ʮ͍·͙͢ʯMLOpsΛ࢝Ί͍ͨͳΒΫϥ΢υ
    ࢖ͬͨ΄͏͕͍͍Ͱ͢ΑʁʢռΊʣ
    • Label Studio࢖͏৔߹͸๻ͷࢡΛ౿ΜͰ͕Μ
    ͹͍ͬͯͩ͘͞

    View Slide

  51. ͓·͚

    View Slide

  52. YOLOv5ͷ݁Ռ

    View Slide

  53. View Slide