機械学習基盤の本番運用とその取り組み / ML platform in production

by Kohei Ota

Slide 1

Slide 1 text

ػցֶशج൫ͷຊ൪ӡ༻ͱ ͦͷऔΓ૊Έ 1SFTFOUFECZ,PIFJ0UB !JOEVDUPS +VMZ5FDI'FTUB

Slide 2

Slide 2 text

ࣗݾ঺հ w ଠాߤฏ !@JOEVDUPS@ !JOEVDUPS w %PDLFS.FFUVQ5PLZP0SHBOJ[FS w *OGSBTUSVDUVSF&OHJOFFS .-0QT5FBN!;0;05FDIOPMPHJFT *OD

Slide 3

Slide 3 text

;0;0508/ͷը૾ݕࡧػೳʹΈΔ ,VCFSOFUFTΛ࢖ͬͨػցֶशج൫ӡ༻ͷཪଆ $MPVE/BUJWF%BZT,BOTBJ $PQZSJHIU;0;05FDIOPMPHJFT *OD גࣜձࣾ;0;0ςΫϊϩδʔζ ։ൃ෦ .-0QTνʔϜ ଠా ߤฏ

Slide 4

Slide 4 text

;0;0508/ͷը૾ݕࡧػೳʹΈΔ ,VCFSOFUFTΛ࢖ͬͨػցֶशج൫ӡ༻ͷཪଆ $MPVE/BUJWF%BZT,BOTBJ $PQZSJHIU;0;05FDIOPMPHJFT *OD גࣜձࣾ;0;0ςΫϊϩδʔζ ։ൃ෦ .-0QTνʔϜ ଠా ߤฏ ৄ͘͠͸4QFBLFSEFDLͷεϥΠυͰʂ

Slide 5

Slide 5 text

ࠓ೔ͷλʔήοτ w Πϯϑϥ%FW0QT43&తͳ͜ͱΛ΍͍ͬͯΔਓ w ػցֶशʹ͍ͭͯ͋·Γྑ͘෼͔͍ͬͯͳ͍ਓ ׬શʹཧղ͍ͯ͠Δਓ w ಥવৼΒΕΔṖͷλεΫʹରԠͰ͖Δ͔Θ͔Βͳ͍ਓ

Slide 6

Slide 6 text

͋Δ೔͜Μͳ͜ͱΛݴΘΕΔͱ ߟ͑ͯΈ͍ͯͩ͘͞

Slide 7

Slide 7 text

ܦӦऀʮ͜Ε͔Β͸"*ͩʂʂʯ

Slide 8

Slide 8 text

"*ʁػցֶशʁͲ͏ҧ͏ͷʁ

Slide 9

Slide 9 text

ػցֶशͬͯͳʹʁʁ

Slide 10

Slide 10 text

ػցֶशʁʁ w σʔλΛೖྗɺ͋Δ΂͖݁ՌΛग़ྗͱͯ͠ w ෳ਺ͷσʔλ͔Βڞ௨ͷϧʔϧ΍ಛ௃ɺ൑அج४Λநग़ w ໌ࣔతʹϓϩάϥϜϩδοΫΛॻ͔ͣʹ݁ՌΛग़ͨ͢Ίͷ࢓૊Έ

Slide 11

Slide 11 text

ػցֶशʁʁ w σʔλΛೖྗɺ͋Δ΂͖݁ՌΛग़ྗͱͯ͠ w ෳ਺ͷσʔλ͔Βڞ௨ͷϧʔϧ΍ಛ௃ɺ൑அج४Λநग़ w ໌ࣔతʹϓϩάϥϜϩδοΫΛॻ͔ͣʹ݁ՌΛग़ͨ͢Ίͷ࢓૊Έ ϩδοΫͷந৅Խ

Slide 12

Slide 12 text

ͳͥػցֶश͕ٻΊΒΕΔͷ͔ w ϞόΠϧ΍Πϯλʔωοτ͕ීٴ͖ͬͨ͠ࠓɺ෺ࣄͷঢ়گ͸ٸܹʹมΘΔ w ͦͷมԽΛϓϩάϥϜͰද͢ͷ͸େม w *G΍GPSͰઃఆͨ͠ύϥϝʔλʔΛॻ͖׵͑Δ͚ͩͷվमΛՃ͑Δͷ͸  ೉͍͠͠ɺޮՌଌఆ΋େมʢ͍ΘΏΔzਓ޻ແೳzͱ͍͏ݺ͹ΕΔ΍ͭʣ w ͜Ε·Ͱͷ܏޲͔Β࣍ͷ݁ՌΛ༧ଌ͢Δࣄ͕Ͱ͖Δശ͕͋Ε͹  ຊ࣭తʹ͸αʔϏεͷϩδοΫ͸໰୊Ͱ͸ͳ͍͸ͣ

Slide 13

Slide 13 text

Slide 14

Slide 14 text

ػցֶशͷԠ༻ྫ w ݕࡧΤϯδϯͷϦίϝϯσʔγϣϯ w ؞΍޻৔ʹ͓͚Δෆྑ඼ͳͲͷҟৗݕ஌ w Ի੠ೝࣝɺը૾ೝࣝ w גՁ༧ଌ

Slide 15

Slide 15 text

ػցֶशͷԠ༻ྫ w ݕࡧΤϯδϯͷϦίϝϯσʔγϣϯ w ؞΍޻৔ʹ͓͚Δෆྑ඼ͳͲͷҟৗݕ஌ w Ի੠ೝࣝɺը૾ೝࣝ w גՁ༧ଌ ϦΞϧλΠϜͰมԽ͢Δ΋ͷ΍  ਓؒͷखΛհ͢Δͱେมͳ΋ͷʹରͯ͠ಛʹ༗ޮ

Slide 16

Slide 16 text

ػցֶशͷར༻Πϝʔδ

Slide 17

Slide 17 text

ػցֶशͷར༻Πϝʔδ Ϟσϧ

Slide 18

Slide 18 text

ػցֶशͷར༻Πϝʔδ ֶश ਪ࿦ ਪ࿦Ϟσϧ

Slide 19

Slide 19 text

ֶशͱਪ࿦ w ֶश w σʔλΛҰఆͷنଇ ΞϧΰϦζϜ ʹैͬͯϞσϧʹม׵ w σʔλιʔε͕ॏཁͳͷͰɺ೔ʑೖΕସΘΔ΋ͷ͸ఆৗతʹֶश͢Δ w ਪ࿦ w ϞσϧΛ࢖ͬͯɺ͋Δσʔλ͕Ͳͷύλʔϯʹ࠷΋͍͔ۙΛ൑அ͢Δ w ਪ࿦ʹ࢖͏Ϟσϧͷσʔλ઱౓͕ॏཁ

Slide 20

Slide 20 text

ֶशͱਪ࿦ w ֶश w σʔλΛҰఆͷنଇ ΞϧΰϦζϜ ʹैͬͯϞσϧʹม׵ w σʔλιʔε͕ॏཁͳͷͰɺ೔ʑೖΕସΘΔ΋ͷ͸ఆৗతʹֶश͢Δ w ਪ࿦ w ϞσϧΛ࢖ͬͯɺ͋Δσʔλ͕Ͳͷύλʔϯʹ࠷΋͍͔ۙΛ൑அ͢Δ w ਪ࿦ʹ࢖͏Ϟσϧͷσʔλ઱౓͕ॏཁ 8FCʹ͸ͳ͍ػցֶशج൫ͷϙΠϯτ    Ϟσϧ͕ػցֶशʹ͓͚Δ಄೴ ϒϥοΫϘοΫε ϞσϧͷೖΕସ͑ͱɺֶशස౓ͳͲͷఆ͕ٛॏཁ

Slide 21

Slide 21 text

Πϯϑϥج൫ͷ࿩

Slide 22

Slide 22 text

ྫ͑͹͜ΜͳΞϓϦ͕͋ͬͨͱͯ͠ 8FC "QQ %#

Slide 23

Slide 23 text

ΞϓϦʹػցֶशΛ࢖ͬͨ  ػೳΛ૿΍͢͜ͱΛߟ͑ͯΈΔ

Slide 24

Slide 24 text

Πϝʔδ͸͜͏ 8FC "QQ %# ਪ࿦Ϟσϧ ਪ࿦"1*ͷ  αʔϏϯά

Slide 25

Slide 25 text

Πϝʔδ͸͜͏ 8FC "QQ %# ਪ࿦Ϟσϧ ਪ࿦"1*ͷ  αʔϏϯά ͜ΕͰ΋ಈ͘ʹ͸ಈ͚͘Ͳɾɾɾ

Slide 26

Slide 26 text

Πϝʔδ͸͜͏ 8FC "QQ %# ਪ࿦Ϟσϧ ਪ࿦"1*ͷ  αʔϏϯά Ϟσϧͷߋ৽Ͳ͏͢Δͷʁ  ΞϓϦͷߋ৽ͱύΠϓϥΠϯ෼͚Δͷʁ Πϯϑϥઃܭ͸୭͕͢Δͷʁ

Slide 27

Slide 27 text

ػցֶशʹؔΘΔਓͨͪ ౰ࣾൺ w ϦαʔνϟʔˠΞϧΰϦζϜͱϞσϧධՁΛ୲౰ w .-ΤϯδχΞ

Slide 28

Slide 28 text

ػցֶशʹؔΘΔਓͨͪ ౰ࣾൺ w Ϧαʔνϟʔ w .-ΤϯδχΞˠϞσϧΛ࢖ͬͨ"1*΍ΞϓϦͷϓϩτλΠϐϯάͳͲ

Slide 29

Slide 29 text

ػցֶशʹؔΘΔਓͨͪ ౰ࣾൺ w Ϧαʔνϟʔ w .-ΤϯδχΞˠϞσϧΛ࢖ͬͨ"1*΍ΞϓϦͷϓϩτλΠϐϯάͳͲ ࣗಈԽ͸Ͳͬͪͷ࢓ࣄʁ Πϯϑϥઃܭ͸ͩΕ͕΍Δʁ ύϑΥʔϚϯενϡʔχϯά͸ʁ

Slide 30

Slide 30 text

Two Big Problems Data Scientist Machine Learning Engineer vs

Slide 31

Slide 31 text

Ϟσϧ࡞੒ͱαʔϏϯάͷ  ֞ࠜΛແͯ͘͠  ࣮ӡ༻ʹ଱͑͏Δج൫Λ࡞Γ͍ͨ

Slide 32

Slide 32 text

%FWY0QT

Slide 33

Slide 33 text

.-Y0QT

Slide 34

Slide 34 text

.-0QTνʔϜͷϛογϣϯ ౰ࣾൺ w .-ΤϯδχΞ΍ݚڀऀ͕ػցֶशϞσϧͷ։ൃʹूதͰ͖Δ؀ڥΛఏڙ͢Δ w ϓϩτλΠϓΛϓϩμΫγϣϯϨϕϧʹҾ্͖͛Δ ˠݚڀऀɺ.-ΤϯδχΞ͕ͨͪ࡞ͬͨ΋ͷΛ࣮ࡍʹαʔϏεΠϯ͠ӡ༻·Ͱߦ͏

Slide 35

Slide 35 text

.-0QTͰิ͑Δ͜ͱ w ݚڀऀ͸ιϑτ΢ΣΞΤϯδχΞϦϯάͷ஌ݟ͕ͳ͍ w +VQZUFS/PUFCPPL͚ͩ͋Ε͹͍͍ɻ%PDLFS΍Πϯϑϥ͸஌Βͳ͍͜ͱ΋ଟ͍ w .-ΤϯδχΞ͸ϓϩτλΠϐϯά͕ಘҙͰ΋ܧଓతͳΞϓϦέʔγϣϯͷվળ΍ ࣗಈԽͷλεΫ͸ઐ໳֎ͳ͜ͱ΋ଟ͍ w $*$%ઃܭɺֶशϫʔΫϑϩʔͷ࠷దԽͳͲ͸༏ઌ౓͕௿͍

Slide 36

Slide 36 text

.-0QTͰิ͑Δ͜ͱ w %FW0QTͰഓͬͨϊ΢ϋ΢Λػցֶशʹ΋ద༻͍ͯ͘͠ w (16$16Λ࢖ͬͨϫʔΫϑϩʔ΍ΠϯϑϥઃܭͳͲ͸ɺͦ΋ͦ΋Πϯϑϥͷ ஌͕ࣝཁٻ͞ΕΔ෼໺ w ຊ൪ʹ޲͚ͨΞϓϦέʔγϣϯͷվળ w ίϯςφԽɺϘτϧωοΫͷվળͳͲ

Slide 37

Slide 37 text

࣮ྫΛோΊͯΈΔ

Slide 38

Slide 38 text

;0;05FDIOPMPHJFT *OD ΞʔΩςΫνϟશମ $MPVE-PBE #BMBODJOH $MPVE"SNPS ,VCFSOFUFT &OHJOF $MPVE 4UPSBHF $POUBJOFS 3FHJTUSZ $MPVE .FNPSZTUPSF %FWFMPQFS ը૾ετϨʔδ ϞσϧετϨʔδ ίϯςφΠϝʔδ Ωϟογϡ $MPVE $PNQPTFS ֶश ,VCFSOFUFT &OHJOF "//JOEFY Ϟσϧ 6TFS ֶश ਪ࿦ (16 $MPVE 'JMFTUPSF

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

.-0QTͷ୲౰ྖҬ ౰ࣾൺ w Πϯϑϥͷߏ੒؅ཧ $*$%ύΠϓϥΠϯؚΉ w ΞϓϦέʔγϣϯͷ$*$%΍ίϯςφԽɺνϡʔχϯά w ֶशϫʔΫϑϩʔͷվળ΍ӡ༻

Slide 41

Slide 41 text

શ෦Ͱ͖ͳ͍ͱ͍͚ͳ͍ͷ͔ʁ

Slide 42

Slide 42 text

:FTBOEOP

Slide 43

Slide 43 text

νʔϜͷଟ༷ੑ w 43&ʹ͓͍ͯඞཁͱ͞ΕΔνʔϜͷଟ༷ੑ͸.-0QTͰ΋ॏཁ w ۀ຿΍ϓϩμΫτɺج൫ʹ͓͍ͯ࢖ΘΕΔٕज़͸શͯแׅతʹཧղ͢Δ ͜ͱ͕ॏཁͳͷ͸ݴ͏·Ͱ΋ͳ͍ w ಘҙྖҬ͕ҧ͏ΤϯδχΞ͕ෳ਺͍Δ͜ͱʹΑͬͯνʔϜͱͯ͠  ΑΓେ͖ͳൣғΛΧόʔͰ͖Δ w ҧ͏ࢹ఺ͷΤϯδχΞ͕͏·͘ಈ͍͍ͯ͘ʹ͸ɺݸʑͷνʔϜΛҙࣝͨ͠ ಈ͖΍༏लͳϦʔμʔͷଘࡏ΋ॏཁ

Slide 44

Slide 44 text

Slide 45

Slide 45 text

΋͏গ࣮͠ࡍͷऔ૊Έʹ͍ͭͯ ۷ΓԼ͛ͯΈ·͠ΐ͏

Slide 46

Slide 46 text

.-0QTͷ୲౰ྖҬ ౰ࣾൺ w Πϯϑϥͷߏ੒؅ཧ $*$%ύΠϓϥΠϯؚΉ w ΞϓϦέʔγϣϯͷ$*$%΍ίϯςφԽɺνϡʔχϯά w ֶशϫʔΫϑϩʔͷվળ΍ӡ༻ 8FC։ൃͱڞ௨෦෼͕େ͖͍λεΫ ػցֶशʹݻ༗ͷ෦෼͕େ͖͍λεΫ

Slide 47

Slide 47 text

ΞϓϦͷνϡʔχϯά w ϏδωεϩδοΫΛม͑ͳ͍ൣғͰਪ࿦"1*ͷ଎౓Λ্͛Δ w "1.΍֎ܗ؂ࢹͳͲΛ͔ͭͬͯఆৗ؂ࢹ͠ɺϘτϧωοΫΛݟ͚ͭΔ w ϞσϧͰѻ͏ϕΫτϧͷύϥϝʔλʔ΍σʔλͷྔʹΑͬͯɺ$16 (16ͲͪΒΛ࢖͏΂͖͔͕ܾ·Δ ෛՙࢼݧͳͲͰݕূ΋͢Δ w (16͸ศར͕ͩɺίϯςΩετεΠονʹऑ͍ͷͰΞϓϦέʔγϣϯͰ ͸ۃྗ࢖͍ͨ͘ͳ͍

Slide 48

Slide 48 text

Slide 49

Slide 49 text

ֶशϫʔΫϑϩʔͷӡ༻ͱվળ w ݚڀऀ΍.-ΤϯδχΞ͕ϞσϧΛ࡞੒͞ΕΔҰ࿈ͷྲྀΕΛ  ϑϩʔʹམͱ͠ࠐΈɺࣗಈԽ͢Δ w ຖ೔ɺຖ࣌ؒ৘ใ͕มΘΔΑ͏ͳσʔλʹରͯ͠ܧଓͯ͠Ձ஋Λ  ఏڙ͢ΔͨΊʹ͸ඞཁෆՄܽ w ฒྻ࣮ߦੑ͕Ͳ͜·ͰߴΊΒΕΔ͔ w ΞϧΰϦζϜ΍ɺ࢖͍ͬͯΔख๏ʹର͢Δཧղ͕ॏཁ

Slide 50

Slide 50 text

;0;05FDIOPMPHJFT *OD ը૾ݕࡧʹ࢖ΘΕΔҰൠతͳΞϧΰϦζϜ ෺ମݕग़ΞϧΰϦζϜ ● ը૾͔Β෺ମͷݕग़ͱΫϥε෼ྨΛ͢Δ ಛ௃ྔநग़ΞϧΰϦζϜ ● ը૾͔Βଟ࣍ݩϕΫτϧͷಛ௃ྔΛநग़͢Δ ۙࣅ࠶࠷ۙ๣୳ࡧ "// ● ߴ଎ʹଟ࣍ݩͷϕΫτϧΛ୳ࡧ͢Δ IUUQTHJUIVCDPNTQPUJGZBOOPZ $// 'FBUVSF

Slide 51

Slide 51 text

.-ϓϩμΫγϣϯ·ͰͷྲྀΕ ਪ࿦Ϟσϧ࡞ͬͨΑ ϞσϧσϓϩΠͯ͠  ਪ࿦"1*࡞ΔΑʂ

Slide 52

Slide 52 text

.-ϓϩμΫγϣϯ·ͰͷྲྀΕ ਪ࿦Ϟσϧ࡞ͬͨΑ ϞσϧσϓϩΠͯ͠  ਪ࿦"1*࡞ΔΑʂ ϫʔΫϑϩʔͰ  ਪ࿦Ϟσϧͷੜ੒ΛࣗಈԽ ΞϓϦέʔγϣϯͷ  $*$%ύΠϓϥΠϯ ਪ࿦Ϟσϧͷ  ࣗಈσϓϩΠ

Slide 53

Slide 53 text

.-ϓϩμΫγϣϯ·ͰͷྲྀΕ ਪ࿦Ϟσϧ࡞ͬͨΑ ϞσϧσϓϩΠͯ͠  ਪ࿦"1*࡞ΔΑʂ ϫʔΫϑϩʔͰ  ਪ࿦Ϟσϧͷੜ੒ΛࣗಈԽ ΞϓϦέʔγϣϯͷ  $*$%ύΠϓϥΠϯ ਪ࿦Ϟσϧͷ  ࣗಈσϓϩΠ ࣮͸ɺ΍͍ͬͯΔ͜ͱͷຊ࣭͸  ࠓ·Ͱͷ43&%FW0QTͷख๏ͱͦΜͳʹҧ͍͕ͳ͍

Slide 54

Slide 54 text

վΊͯ.-0QTͷ  ϛογϣϯʹ͍ͭͯৼΓฦΔ

Slide 55

Slide 55 text

Slide 56

Slide 56 text

.-0QTνʔϜͷϛογϣϯ ౰ࣾൺ w .-ΤϯδχΞ΍ݚڀऀ͕ػցֶशϞσϧͷ։ൃʹूதͰ͖Δ؀ڥΛఏڙ͢Δ w ϓϩτλΠϓΛϓϩμΫγϣϯϨϕϧʹҾ্͖͛Δ ˠݚڀऀɺ.-ΤϯδχΞ͕ͨͪ࡞ͬͨ΋ͷΛ࣮ࡍʹαʔϏεΠϯ͠ӡ༻·Ͱߦ͏ Ϟσϧ΍"1*ͷ೔ʑͷ։ൃऀ ମݧͷ޲্ 43&తͳΞϓϩʔν

Slide 57

Slide 57 text

·ͱΊ w %FW0QT͸։ൃͱӡ༻ͷ֞ࠜΛແ͘͠ɺϏδωεʹߩݙ͢ΔεϐʔυײΛߴΊΔͨΊ ͷऔΓ૊ΈɺจԽվֵͷϚΠϯυηοτͩͬͨ w 43&͸%FW0QTΛؚΉɺαʔϏεͷఏڙՁ஋ΛߴΊΔ࣮ફతͳΞϓϩʔν w .-0QT͸྆ऀͷ࣋ͭಛੑΛػցֶशͷεϐʔυײ΍৴པੑΛߴΊΔͨΊͷऔΓ૊Έ

Slide 58

Slide 58 text

5IBOLZPVGPSZPVSBUUFOUJPO