https://churadata.connpass.com/event/222561/
「機械学習を「いい感じ」にする技術’で発表したスライドです。
ػցֶशΛʮ͍͍ײ͡ʯʹ͢Δٕज़ΞΠύʔୂ 2021/09/17@JX௨৴ࣾ x ͪΎΒσʔλ߹ಉษڧձ
View Slide
ʢͤʔͷͬʣ͍·͙͢͡ΊΔ͑Ή͑Δ͓͢
͔݁Β͠·͕͢͡·Γ·ͤΜͰͨ͠
ຊʹ͋Γ͕ͱ͏͍͟͝·ͨ͠
ϥΠτχϯάτʔΫʂʂʂʂʂ
·͊Ͱ୭ظ͍ͯ͠ͳ͍λΠτϧʢྦʣͩͬͨͱࢥ͏ͷͰɺ͜Ε͔Βͷۤ࿑Ͱฉ͍͓ͯ͘Ε໘നͦ͏໘നͦ͏໘നͦ͏໘നͦ͏ʁʁʁʁ
ࣗݾհ
ࣗݾհ• ΞΠύʔʢAipaʣୂʢຬ31ࡀʣ• ೋࣇͷ• ͪΎΒσʔλגࣜձࣾ• ৭ʑΓ·͢• ΰδϥ͕͖Ͱ͢
ࠓ͢͜ͱʢΓ͔ͨͬͨ͜ͱʣ
͢͜ͱʢΓ͔ͨͬͨ͜ͱʣ• G.I.I.C.Systemͷ։ൃ
͢͜ͱʢΓ͔ͨͬͨ͜ͱʣ• G.I.I.C.Systemͷ։ൃ• Godzillaʢΰδϥͷʣ• Imageʢը૾Λʣ• Iikanjiʢ͍͍ײ͡ʹʣ• Collectʢͱͬͯ͘Δʣ• Systemʢͯ͢͠Ήʣ
ΰδϥʹғ·Εͯইੜ֔Λऴ͍͑ͨ
ΞʔΩςΫνϟਤʢશྗͰະ͑Ή͑Δ͓͢ʣ"NB[PO4BHF.BLFS.PEFMϥϕϦϯάɾΞϊςʔγϣϯπʔϧ44ϚΠ(16Ϛγϯ5SBJO4લॲཧScript 4BHF.BLFS&OEQPJOU͓·͍Β44UBUJD)PTUJOH&$3,FESP
ΞʔΩςΫνϟਤʢશྗͰະ͑Ή͑Δ͓͢ʣ"NB[PO4BHF.BLFS.PEFMϥϕϦϯάɾΞϊςʔγϣϯπʔϧ44ϚΠ(16Ϛγϯ5SBJO4લॲཧScript 4BHF.BLFS&OEQPJOU͓·͍Β44UBUJD)PTUJOH&$3σʔλׂͷύϥϝʔλͱ͔ར༻ͨ͠σʔλͷύεͱֶ͔शύϥϝʔλֶशதͷϩάͱ͔,FESP1SFBOOPUBUJPOతͳͭͤͬͤͱूΊΔͷͩΔ͍ͷͰɺ"1*Λ͏
ະͳΒ͠ΐ͏͕ͳ͍ؾ࣋ͪΛΓସ͑·͢• Pipelineͱ͔mlflowͱ͔sagemakerਖ਼օ༷͍ͬͺ͍Μͩ͜ͱ͋Δͩͱࢥ͍·͢ɻࠓߋ͍͍ΑͶʢʣ• ႈੑͱ͔ฒྻԽͱ͔ߴԽͱ͔ߟ͑Δ͜ͱ͍ͬͺ͍͋Γͦ͏Ͱ͕͢ɺجຊϐλΰϥεΠονͳΜͰ͠ΐʁʢҟೝΊΔʣ• ࠓճΞϊςʔγϣϯ͔Βελʔτ͠Α͏ͱࢥ͚ͬͨͲɺԿ͓͏͔ͳͬͯࢥͬͯͨʢͬͨ͜ͱͳ͍ʣ• Կ͔ྑ͍πʔϧͳ͍͔ͳʔʁ• ͦͦΞϊςʔγϣϯͱ͔ϥϕϦϯάͷϑΣʔζͬͯMLOpsͳͷʁʁʁ
ͦ͏Έ͍ͨͰ͢https://aws.amazon.com/jp/sagemaker/
͔͍ͨ͋͋͋͋͋͋͋͋https://aws.amazon.com/jp/sagemaker/
Կ͔ྑ͍πʔϧͳ͍͔ͳʔʢ2ճʣhttps://qiita.com/shu-yusa/items/d19ea57e3cf9c4dbdce2
͓ʁʢ^ω^ = ^ω^ʣhttps://twitter.com/1027kg/status/1392852597166379009
ͳʹ͜ΕΑͦ͞͏https://labelstud.io/
͋Βૉఢhttps://labelstud.io/
͋Βʙʙʙhttps://labelstud.io/api#tag/Annotations
͖Όʔʔʔʔʔʔhttps://labelstud.io/guide/storage.html
͍͢͝ʙʢͳʹ͜Εʣ
αΫαΫʂʂʢମײʣ
Export Data…
!!!!???
!!!!???_(:3 ʯ㲃) ŴŗŖ
͏ͻΐʙʙʙʙ
ྑ͍(Αͦ͞͏)
ແࣄπʔϧબఆ͕͢Μͩͱ͜ΖͰɺ͜Ε͔Βۤ࿑• Label Studio• Kedro• YOLOv5• MLFlow• SageMaker
εοɾɾɾ• Label Studio• Kedro• YOLOv5• MLFlow• SageMaker
MLOpsɾɾɾʁ͓લɾɾɾʂʁ• Label Studio• Kedro• YOLOv5• MLFlow• SageMaker
• Label Studio• Kedro• YOLOv5• MLFlow• SageMakerΏΔ͠(ry
ۤ࿑
ۤ࿑ʢ͓ʔΔ͋ͷͯʔ͠ΐΜʣ• ը૾͕දࣔ͞Εͳ͍ʢ403ʣ• ΞΫηεΩʔඞਢʢͦ͏Ͱͳ͍͚Ͳɺ͚ͭͨํ͕શػೳΛར༻Ͱ͖Δʣ• APIυΩϡϝϯτ͕Γͳ͍• [Export] Downloadํ๏͕ࡌ͍ͬͯͳ͍• Request Parameter͕লུ͞ΕͯͯࠔΔ
ը૾͕දࣔ͞Εͳ͍ʢ403ʣ• ઃఆͰS3ॺ໊͖ͩͱ͏·͘දࣔ͞Εͳ͍• ࢼ͍ͯ͠ͳ͍͚ͲΞΫηεΩʔͷઃఆ͕ଟඞਢ• ӳޠͪΌΜͱಡΉΜͩʢռΊʣ
͜ͷล• ઃఆͰS3ॺ໊͖ͩͱ͏·͘දࣔ͞Εͳ͍• ࢼ͍ͯ͠ͳ͍͚ͲೝূΩʔͷઃఆ͕ଟඞਢ• ӳޠͪΌΜͱಡΉΜͩʢռΊʣ
ը૾͕දࣔ͞Εͳ͍ʢbase64ʣ• Project࡞͔ΒɺS3σʔλSyncޙɺϦετΛදࣔ͠Α͏ͱ͢Δͱಈ͔ͳ͘ͳΔ• Base64ͷจࣈྻ͕େྔʹը໘ߋ৽͢Δͱ͜͏ͳΔͬΆ͍• ͗ํ͕Θ͔Βͳ͍• 1ճຕΞοϓϩʔυ → Sync → දࣔͰ͖Δ͜ͱ֬ೝͰ͖ͨΒɺશ෦Ξοϓϩʔυ → Sync Ͱ҆ఆ͢Δ
ΞΫηεΩʔඞਢ• EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)༩ͨ͠ΒΞΫηεΩʔ͍Βͳ͍• ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμϯϩʔυ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ• Ξϊςʔγϣϯ͕ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ(´ɾωɾʆ)͢ΔͷͰ͓ͬͯ͘Μͩʂʂʂ
ΞΫηεΩʔඞਢ• EC2Ͱىಈͯ͠ɺIAMϩʔϧ(S3FullAccessͱ͔)༩ͨ͠ΒΞΫηεΩʔ͍Βͳ͍• ͕ɺExport͢Δͱ͖ʹը૾σʔλ1ຕͣͭμϯϩʔυ͍ͯ͠ΔΑ͏ͳͷͰɺඞਢͱͳΔɹ• Ξϊςʔγϣϯ͕ྃͨ͠ޙʹʮ࡞ۀ͕ऴΘͬͨʂʂʂʯͱ͍͏ؾ͔࣋ͪΒग़ͯ͘ΔΤϥʔʹ(´ɾωɾʆ)͢ΔͷͰ͓ͬͯ͘Μͩʂʂʂ͜Ε࣮ҧ͔ͬͨͷͰޙϒϩά͔Ͳ͔͜Ͱ
APIυΩϡϝϯτ͕Γͳ͍• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ• ඞཁ࠷ݶࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ͕ͳ͔ͬͨΓͯ͠ɺ୳͕͢ਏ͍• σʔλϕʔεɺGithubʢίʔυಡΉʣͱୟ͍ͯڍಈΛ֬ೝ͍͚͍ͯͣ͠Εղܾ͢Δʢେมʣ
ΈΜͳͷ৺ͷʢ͓લ͕هࣄॻ͚͍͍ͷͰɾɾɾʁʣ• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ• ඞཁ࠷ݶࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ͕ͳ͔ͬͨΓͯ͠ɺ୳͕͢ਏ͍• σʔλϕʔεɺGithubʢίʔυಡΉʣͱୟ͍ͯڍಈΛ֬ೝ͍͚͍ͯͣ͠Εղܾ͢Δʢେมʣ
• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ• ඞཁ࠷ݶࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ͕ͳ͔ͬͨΓͯ͠ɺ୳͕͢ਏ͍• σʔλϕʔεɺGithubʢίʔυಡΉʣͱୟ͍ͯڍಈΛ֬ೝ͍͚͍ͯͣ͠Εղܾ͢Δʢେมʣ͔ͨ͠ʢ͔ͨ͠ʹʣ
• Download API͕͋ΔͬΆ͍͚ͲυΩϡϝϯτʹͳ͍ɻΈ͍ͨͳ͜ͱ͕͋Δ• ඞཁ࠷ݶࡌ͍ͬͯΔ͚Ͳɺࡉ͔͍ύϥϝʔλ͕ͳ͔ͬͨΓͯ͠ɺ୳͕͢ਏ͍• σʔλϕʔεɺGithubʢίʔυಡΉʣͱୟ͍ͯڍಈΛ֬ೝ͍͚͍ͯͣ͠Εղܾ͢Δʢେมʣ͔ͨ͠ʢ͔ͨ͠ʹʣདྷिʹॻ͜͏ͱࢥ͍·͢ʢϑϥάʣ
σϞ
σϞ༰• Label Studioͷىಈ• S3ͱͷ࿈ܞ• Ξϊςʔγϣϯ࡞ۀ• APIͷར༻• Export
·ͱΊ
·ͱΊ• ʮ͍·͙͢ʯMLOpsΛ࢝Ί͍ͨͳΒΫϥυͬͨ΄͏͕͍͍Ͱ͢ΑʁʢռΊʣ• Label Studio͏߹ͷࢡΛ౿ΜͰ͕Μ͍ͬͯͩ͘͞
͓·͚
YOLOv5ͷ݁Ռ
commander_aipa
line_developers
grimoh
kazumax55
kmwebnet
yoshiiryo1
nagiss
unclejoe
.png){kind=icon}
3playmarketing
nasa_desu
opelab
ewolff
bermonpainter
iamctodd
quramy
mraible
tammielis
hursman
wjessup
matthewcrist
edds
orderedlist
colly
chrislema