Slide 1

Slide 1 text

ػցֶशΛʮ͍͍ײ͡ʯ ʹ͢Δٕज़ ΞΠύʔୂ௕ 2021/09/17@JX௨৴ࣾ x ͪΎΒσʔλ߹ಉษڧձ

Slide 2

Slide 2 text

ʢͤʔͷͬʣ ͍·͙͢͸͡ΊΔ ͑Ή͑Δ͓΀͢

Slide 3

Slide 3 text

݁࿦͔Β࿩͠·͕͢ ͸͡·Γ·ͤΜͰͨ͠

Slide 4

Slide 4 text

ຊ౰ʹ͋Γ͕ͱ͏ ͍͟͝·ͨ͠

Slide 5

Slide 5 text

ϥΠτχϯάτʔΫʂʂʂʂʂ

Slide 6

Slide 6 text

·͊Ͱ΋୭΋ظ଴͍ͯ͠ͳ͍λΠτϧʢྦʣ ͩͬͨͱࢥ͏ͷͰɺ͜Ε͔Β͸๻ͷۤ࿑࿩Ͱ ΋ฉ͍͓ͯ͘Ε ໘നͦ͏ ໘നͦ͏ ໘നͦ͏ ໘നͦ͏ ʁʁʁʁ

Slide 7

Slide 7 text

ࣗݾ঺հ

Slide 8

Slide 8 text

ࣗݾ঺հ • ΞΠύʔʢAipaʣୂ௕ʢຬ31ࡀʣ • ೋࣇͷ෕ • ͪΎΒσʔλגࣜձࣾ • ৭ʑ΍Γ·͢ • ΰδϥ͕޷͖Ͱ͢

Slide 9

Slide 9 text

ࠓ೔࿩͢͜ͱ ʢ΍Γ͔ͨͬͨ͜ͱʣ

Slide 10

Slide 10 text

࿩͢͜ͱʢ΍Γ͔ͨͬͨ͜ͱʣ • G.I.I.C.Systemͷ։ൃ

Slide 11

Slide 11 text

࿩͢͜ͱʢ΍Γ͔ͨͬͨ͜ͱʣ • G.I.I.C.Systemͷ։ൃ • Godzillaʢΰδϥͷʣ • Imageʢը૾Λʣ • Iikanjiʢ͍͍ײ͡ʹʣ • Collectʢͱͬͯ͘Δʣ • Systemʢͯ͢͠Ήʣ

Slide 12

Slide 12 text

ΰδϥʹғ·Εͯ ই֐ੜ֔Λऴ͍͑ͨ

Slide 13

Slide 13 text

ΞʔΩςΫνϟਤ ʢશྗͰະ׬੒͑Ή͑Δ͓΀͢ʣ "NB[PO4BHF.BLFS .PEFM ϥϕϦϯάɾ Ξϊςʔγϣϯπʔϧ 4 4 ϚΠ(16Ϛγϯ 5SBJO 4 લॲཧScript 4BHF.BLFS&OEQPJOU ͓·͍Β 44UBUJD)PTUJOH &$3 ,FESP

Slide 14

Slide 14 text

ΞʔΩςΫνϟਤ ʢશྗͰະ׬੒͑Ή͑Δ͓΀͢ʣ "NB[PO4BHF.BLFS .PEFM ϥϕϦϯάɾ Ξϊςʔγϣϯπʔϧ 4 4 ϚΠ(16Ϛγϯ 5SBJO 4 લॲཧScript 4BHF.BLFS&OEQPJOU ͓·͍Β 44UBUJD)PTUJOH &$3 σʔλ෼ׂͷύϥϝʔλͱ͔ ར༻ͨ͠σʔλͷύεͱ͔ ֶशύϥϝʔλ౳ ֶशதͷϩάͱ͔ ,FESP 1SFBOOPUBUJPOతͳ΍ͭ ͤͬͤͱूΊΔͷ͸ͩΔ͍ͷ Ͱɺ"1*Λ࢖͏

Slide 15

Slide 15 text

ະ׬੒ͳΒ͠ΐ͏͕ͳ͍ ؾ࣋ͪΛ੾Γସ͑·͢ • Pipelineͱ͔mlflowͱ͔sagemaker͸ਖ਼௚օ༷͍ͬͺ͍૊Μͩ͜ͱ͋Δͩͱ ࢥ͍·͢ɻࠓߋ͍͍ΑͶʢʣ • ႈ౳ੑͱ͔ฒྻԽͱ͔ߴ଎Խͱ͔ߟ͑Δ͜ͱ͍ͬͺ͍͋Γͦ͏Ͱ͕͢ɺج ຊϐλΰϥεΠονͳΜͰ͠ΐʁʢҟ࿦͸ೝΊΔʣ • ࠓճΞϊςʔγϣϯ͔Βελʔτ͠Α͏ͱࢥ͚ͬͨͲɺԿ࢖͓͏͔ͳͬͯ ࢥͬͯͨʢ࢖ͬͨ͜ͱͳ͍ʣ • Կ͔ྑ͍πʔϧͳ͍͔ͳʔʁ • ͦ΋ͦ΋Ξϊςʔγϣϯͱ͔ϥϕϦϯάͷϑΣʔζͬͯMLOpsͳͷʁʁʁ

Slide 16

Slide 16 text

ͦ͏Έ͍ͨͰ͢ https://aws.amazon.com/jp/sagemaker/

Slide 17

Slide 17 text

͔͍ͨ͋͋͋͋͋͋͋͋ https://aws.amazon.com/jp/sagemaker/

Slide 18

Slide 18 text

Կ͔ྑ͍πʔϧͳ͍͔ͳʔ ʢ2ճ໨ʣ https://qiita.com/shu-yusa/items/d19ea57e3cf9c4dbdce2

Slide 19

Slide 19 text

͓ʁʢ^ω^ = ^ω^ʣ https://twitter.com/1027kg/status/1392852597166379009

Slide 20

Slide 20 text

ͳʹ͜ΕΑͦ͞͏ https://labelstud.io/

Slide 21

Slide 21 text

͋Βૉఢ https://labelstud.io/

Slide 22

Slide 22 text

͋Βʙʙʙ https://labelstud.io/api#tag/Annotations

Slide 23

Slide 23 text

͖Όʔʔʔʔʔʔ https://labelstud.io/guide/storage.html

Slide 24

Slide 24 text

͍͢͝ʙʢͳʹ͜Εʣ

Slide 25

Slide 25 text

αΫαΫʂʂʢମײʣ

Slide 26

Slide 26 text

Export Data…

Slide 27

Slide 27 text

!!!!???

Slide 28

Slide 28 text

!!!!???

Slide 29

Slide 29 text

!!!!??? _(:3 ʯ㲃) ŴŗŖ

Slide 30

Slide 30 text

͏ͻΐʙʙʙʙ

Slide 31

Slide 31 text

௒ྑ͍ (Αͦ͞͏)

Slide 32

Slide 32 text

ແࣄπʔϧબఆ͕͢Μͩͱ͜ΖͰɺ ͜Ε͔Β͸ۤ࿑࿩ • Label Studio • Kedro • YOLOv5 • MLFlow • SageMaker

Slide 33

Slide 33 text

εοɾɾɾ • Label Studio • Kedro • YOLOv5 • MLFlow • SageMaker

Slide 34

Slide 34 text

MLOpsɾɾɾʁ ͓લɾɾɾʂʁ • Label Studio • Kedro • YOLOv5 • MLFlow • SageMaker

Slide 35

Slide 35 text

• Label Studio • Kedro • YOLOv5 • MLFlow • SageMaker ΏΔ͠(ry

Slide 36

Slide 36 text

ۤ࿑࿩

Slide 37

Slide 37 text

ۤ࿑࿩ʢ͓ʔΔ͋ͷͯʔ͠ΐΜʣ • ը૾͕දࣔ͞Εͳ͍ʢ403໰୊ʣ • ΞΫηεΩʔඞਢʢͦ͏Ͱ͸ͳ͍͚Ͳɺ͚ͭͨํ͕શػೳ Λར༻Ͱ͖Δʣ • APIυΩϡϝϯτ͕଍Γͳ͍ • [Export] Downloadํ๏͕ࡌ͍ͬͯͳ͍ • Request Parameter͕লུ͞ΕͯͯࠔΔ

Slide 38

Slide 38 text

ը૾͕දࣔ͞Εͳ͍ʢ403໰୊ʣ • ઃఆͰS3ॺ໊෇͖ͩͱ͏·͘දࣔ͞Εͳ͍ • ࢼ͍ͯ͠ͳ͍͚ͲΞΫηεΩʔͷઃఆ͕ଟ෼ ඞਢ • ӳޠ͸ͪΌΜͱಡΉΜͩʢռΊʣ

Slide 39

Slide 39 text

͜ͷล • ઃఆͰS3ॺ໊෇͖ͩͱ͏·͘දࣔ͞Εͳ͍ • ࢼ͍ͯ͠ͳ͍͚ͲೝূΩʔͷઃఆ͕ଟ෼ඞਢ • ӳޠ͸ͪΌΜͱಡΉΜͩʢռΊʣ

Slide 40

Slide 40 text

ը૾͕දࣔ͞Εͳ͍ʢbase64໰୊ʣ • Project࡞੒͔ΒɺS3σʔλSyncޙɺϦετΛදࣔ͠Α͏ ͱ͢Δͱಈ͔ͳ͘ͳΔ • Base64ͷจࣈྻ͕େྔʹը໘ߋ৽͢Δͱ͜͏ͳΔͬΆ͍ • ๷͗ํ͕Θ͔Βͳ͍ • 1ճ໨͸਺ຕΞοϓϩʔυ → Sync → දࣔͰ͖Δ͜ͱ ֬ೝͰ͖ͨΒɺશ෦Ξοϓϩʔυ → Sync Ͱ҆ఆ͢Δ

Slide 41

Slide 41 text

ΞΫηεΩʔඞਢ • EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)෇༩͠ ͨΒΞΫηεΩʔ͸͍Βͳ͍ • ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμ΢ϯϩʔυ ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ • Ξϊςʔγϣϯ͕׬ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬ ͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ (´ɾωɾʆ)͢ΔͷͰ΍͓ͬͯ͘Μͩʂʂʂ

Slide 42

Slide 42 text

ΞΫηεΩʔඞਢ • EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)෇༩͠ ͨΒΞΫηεΩʔ͸͍Βͳ͍ • ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμ΢ϯϩʔυ ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ • Ξϊςʔγϣϯ͕׬ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬ ͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ (´ɾωɾʆ)͢ΔͷͰ΍͓ͬͯ͘Μͩʂʂʂ ͜Ε࣮͸ҧ͔ͬͨͷͰޙ೔ϒϩά͔Ͳ͔͜Ͱ

Slide 43

Slide 43 text

APIυΩϡϝϯτ͕଍Γͳ͍ • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍ • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ

Slide 44

Slide 44 text

ΈΜͳͷ৺ͷ੠ ʢ͓લ͕هࣄॻ͚͹͍͍ͷͰ͸ɾɾɾʁʣ • Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍ • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ

Slide 45

Slide 45 text

• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍ • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ ͔ͨ͠ ʢ͔ͨ͠ʹʣ

Slide 46

Slide 46 text

• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹ ͸ͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ • ඞཁ࠷௿ݶ͸ࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ ͕ͳ͔ͬͨΓͯ͠ɺ୳͢޻਺͕ਏ͍ • σʔλϕʔε΍ɺGithubʢίʔυಡΉʣͱୟ͍ͯ ڍಈΛ֬ೝ͍͚ͯ͠͹͍ͣΕ͸ղܾ͢Δʢେมʣ ͔ͨ͠ ʢ͔ͨ͠ʹʣ དྷिʹ͸ॻ͜͏ͱࢥ͍·͢ ʢϑϥάʣ

Slide 47

Slide 47 text

σϞ

Slide 48

Slide 48 text

σϞ಺༰ • Label Studioͷىಈ • S3ͱͷ࿈ܞ • Ξϊςʔγϣϯ࡞ۀ • APIͷར༻ • Export

Slide 49

Slide 49 text

·ͱΊ

Slide 50

Slide 50 text

·ͱΊ • ʮ͍·͙͢ʯMLOpsΛ࢝Ί͍ͨͳΒΫϥ΢υ ࢖ͬͨ΄͏͕͍͍Ͱ͢ΑʁʢռΊʣ • Label Studio࢖͏৔߹͸๻ͷࢡΛ౿ΜͰ͕Μ ͹͍ͬͯͩ͘͞

Slide 51

Slide 51 text

͓·͚

Slide 52

Slide 52 text

YOLOv5ͷ݁Ռ

Slide 53

Slide 53 text

No content