Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
パーソナライズを追求するお菓子の製造需要予測を自動化させた話
Search
Kazufumi Suzuki
November 01, 2018
Programming
0
170
パーソナライズを追求するお菓子の製造需要予測を自動化させた話
株式会社スナックミーで行ったaws sagemakerを用いた需要予測システムの開発、導入のお話。
Kazufumi Suzuki
November 01, 2018
Tweet
Share
More Decks by Kazufumi Suzuki
See All by Kazufumi Suzuki
AWS re:Inventに参加してよかった2つのこと
kz23szk
1
640
Other Decks in Programming
See All in Programming
Apache Hive 4 on Treasure Data
ryukobayashi
1
420
単体テストを書かない技術 #phpcon_odawara
o0h
PRO
27
8.5k
GraphQLサーバの構成要素を整理する #ハッカー鮨 #tsukijigraphql / graphql server technology selection
izumin5210
4
910
使ってみよう Azure AI Document Intelligence
kosmosebi
2
360
Fast JSX: Don't clone props object #28768
yossydev
1
190
Hanami and htmx
bkuhlmann
0
230
大規模UIKitベースアプリへのTCAの段階的導入/gradual-adoption-of-tca-in-a-large-scale-uikit-based-app
takehilo
2
210
Introducing Kotlin Multiplatform in an existing mobile app - Workshop Edition | AndroidMakers Paris
prof18
0
160
Milestoner
bkuhlmann
1
410
SIMD Parallel Programming with the Vector API
josepaumard
0
230
Deep Dive into React Stream/Serialize
mugi_uno
3
700
業務ツールとして使うPostman
msys75
0
110
Featured
See All Featured
Put a Button on it: Removing Barriers to Going Fast.
kastner
58
3.1k
Raft: Consensus for Rubyists
vanstee
133
6.3k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
660
120k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
228
16k
Done Done
chrislema
178
15k
Ruby is Unlike a Banana
tanoku
96
10k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
21
1.9k
The Art of Programming - Codeland 2020
erikaheidi
43
12k
Fantastic passwords and where to find them - at NoRuKo
philnash
39
2.5k
How to Ace a Technical Interview
jacobian
273
22k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
Transcript
ύʔιφϥΠζΛٻ͢Δ͓՛ࢠͷ धཁ༧ଌΛࣗಈԽͤͨ͞ גࣜձࣾεφοΫϛʔ Dev Day T okyo2018 11.01 Co-Founder &
CTO ࡾ ൏ਓ Data Scientist ླ Ұ࢙
ࣗݾհ ࡾ ൏ਓ גࣜձࣾεφοΫϛʔ (snaq.me) Co-Founder & CTO ͖ͳAWS Lambda
/ ECR
εφοΫϛʔ (snaq.me)ͱ ? ͓՛ࢠ(εφοΫ)ͷఆظߪೖαʔϏε 150छྨҎ্ͷ͓՛ࢠ͔Β8छྨຖճ͓ಧ͚ ஈ 1,728ԁ (੫ࠐ) / ճ
2िʹ1 or 4िʹ1ͷ͓ಧ͚Մೳ
εφοΫϛʔ (snaq.me)ͱ ? εφοΫϛʔΦϦδφϧͰ͞Εͨ φνϡϥϧϑΟφϯγΣ ߳ݝ࢈ͷ্࣭ͳখഴͱశࡊΛ༻͠ ম্͖͛ ೕԽࡎਓޱ߳ྉͳͲΛ༻͍ͯ͠ͳ͍ ͨΊɺ༏͍͠͞ͱɺඒຯ͠͞ͷ༨ӆ͕ ͍ͷ͕ಛ
ίίΞϑΟφϯγΣ
εφοΫϛʔ (snaq.me)ͱ ? ࠭ෆ༻ͰύΠφοϓϧ͚ͩͷϦΞϧ υϥΠϑϧʔπ Ұޱ৯Δͱɺࠓ·Ͱ৯ͨυϥΠϑϧʔ πͱҧ͏ຯΘ͍/৯ײͳͲ υϥΠϑϧʔπͳͷʹɺδϡʔγʔײʂ ੜͷϑϧʔπ͕͞ΒʹࢫຯΛ͚ͭͯਐԽ ͨ͠ײ͡
ϓϨϛΞϜυϥΠύΠϯ
εφοΫϛʔ (snaq.me)ͱ ? ϦΫΤετ/ ධՁΛߦ͏͜ͱͰύʔιφϥ Πζ͕Մೳ 1ਓ1ਓ͓ಧ͚͢Δ͕͓՛ࢠ͕ҟͳΔ
͔Βൃૹ·ͰͷྲྀΕ ࢦࣔॻ ࡞ ࡏݿొ ΞαΠϯ * ΞαΠϯ : ͓٬༷ಧ͚ΔεφοΫΛબͿ͜ͱ
ϐοΩϯά ൃૹ
͔Βൃૹ·ͰͷྲྀΕ ࢦࣔॻ ࡞ ࡏݿొ ΞαΠϯ * ΞαΠϯ : ͓٬༷ಧ͚ΔεφοΫΛબͿ͜ͱ
ϐοΩϯά ൃૹ γεςϜԽΛਐΊ͍ͯΔՕॴ
ΞαΠϯͷߏਤ
͔Βൃૹ·ͰͷྲྀΕ before ࢦࣔॻ ࡞ ࡏݿొ ΞαΠϯ * ΞαΠϯ :
͓٬༷ಧ͚ΔεφοΫΛબͿ͜ͱ ϐοΩϯά ൃૹ
ΞαΠϯͷΈ by Well Architecture of the year ͔͜͜Βࢿྉ֬ೝͰ͖·͢
ࠓճ ࢦࣔॻ
͔Βൃૹ·ͰͷྲྀΕ before ࢦࣔॻ ࡞ ࡏݿొ ΞαΠϯ * ΞαΠϯ :
͓٬༷ಧ͚ΔεφοΫΛબͿ͜ͱ ϐοΩϯά ൃૹ
࣌ͷ՝ ࢦࣔॻͷ࡞ʹຖि1ʙ2͔͔Δ ܭը͕όϥόϥ ૹͨ͠εφοΫͷຬͷఆ͕͍͠ ࠷খɺ࠷େՄೳ͕όϥόϥ ͳͲ
SageMakerͰधཁ༧ଌ͠Α͏
SageMakerͰ࣮ݱ͍ͤͨ͜͞ͱ खܰʹར༻͍ͨ͠ ίετ࠷খݶ & ࣗಈԽ͍ͤͨ͞ SageMakerͰػցֶशͷج൫Λ࡞Γ͍ͨ ͳͲ
धཁ༧ଌߏਤ
धཁ༧ଌߏਤ
धཁ༧ଌ෦ͷߟ͑ํ Ϣʔβʔ༧ଌ ૹ͓՛ࢠͷຬ
धཁ༧ଌߏਤ point - ᶃ
धཁ༧ଌߏਤ point - ᶃ ɾStepFunctionsΛ༻͍Δ͜ͱͰ ඞཁͷͱ͖ʹSagemakerΛىಈ ༧ଌ͕ऴΘͬͨΒɺendpointΛ আ͢Δ͜ͱ͕Մೳ ɾΤϥʔ࣌ͷ࠶τϥΠ༰қʹ ઃఆՄೳ
धཁ༧ଌߏਤ point - ᶄ
धཁ༧ଌߏਤ point - ᶄ ɾCloudWatch EventsΛ༻͍Δ͜ͱͰɺ࠶ֶशΛఆظతʹߦ͏͜ͱ͕ Մೳ
धཁ༧ଌߏਤ point - ᶅ
धཁ༧ଌߏਤ point - ᶅ ɾS3ͷόʔδϣχϯάΛ༻͍͜ͱͰɺສ͕Ұಈ͔ͳ͍Ϟσϧ͕࠷৽൛ ͰҰͭલͷόʔδϣϯͰϦΧόϦʔ͕Մೳ
͜ͷߏਤΛ։ൃͯ͠ ͨ͠ / ҙ
ࣗݾհ ླ Ұ࢙(@kz23szk) גࣜձࣾεφοΫϛʔ (snaq.me) Data Scientist ͖ͳAWS SageMaker
sagemakerͱ ػցֶश༻ϑϧϚωʔδυαʔϏε ϊʔτϒοΫ্Ͱͷ࡞ۀ͕Ͱ͖Δ ̍ϝιουͰσϓϩΠྃ త͝ͱͷνϡʔτϦΞϧ͕๛ ελʔτΞοϓػցֶशΛ͜Ε͔Β ࢝ΊΔاۀʹ͓͢͢Ίʂ
धཁ༧ଌ ൃલʹϢʔβΛਪఆ ਓखͰ༧ͯ͠ൃ ܽաࡏݿͷϦεΫɺਓత ίετΛݮ͍ͨ͠
՝ͱ ʲ՝̍ʳΤϯυϙΠϯτΛৗ࣌ىಈ͢Δͱίετ͕͔͞Ή →༧ଌͷʹLambdaͰΤϯυϙΠϯτͷىಈɺ༧ଌɺআ ʲ՝̎ʳόʔδϣϯΞοϓͰಈ͔ͳ͘ͳΔ →Step FunctionsͰ࠷৽̎ϞσϧͰτϥΠ ʲ՝̏ʳۙͷσʔλؚΊͯ࠶ֶश͍ͨ͠ →࠶ֶश༻lambdaΛ༻ҙ (CloudWatch eventsͰ݄࣮࣌ߦʣ
ʲ՝̍ʳΤϯυϙΠϯτΛৗ࣌ىಈ͢Δͱίετ͕͔͞Ή
̍ɹlambdaͰΤϯυϙΠϯτىಈͱআ boto3ʢSDKʣΛͬͯ ΤϯυϙΠϯτΛࢦఆ͠ ىಈɺআ
̍ɹlambdaͰ༧ଌ ΤϯυϙΠϯτͱσʔλΛ ࢦఆ࣮ͯ͠ߦ͢Δ͚ͩʂ ɾ༧ଌ͝ͱʹΤϯυϙΠϯτͷىಈɺ༧ଌɺআΛߦ͏͜ͱͰ ίετΛ݄υϧʹ͑Δ
ʲ՝̎ʳόʔδϣϯΞοϓͰಈ͔ͳ͘ͳΔ
StepFunctions jsonܗࣜͰαʔϏε࣮ߦΛ εςοϓͰ੍ޚͰ͖Δɻ
̎ StepFunctions ɾهड़͢Δͱϑϩʔ͕ՄࢹԽ͞ΕΔɻ ɾlambdaίʔυ͕୯ػೳʹͳΔɻ ɾذॲཧͰόʔδϣϯΞοϓ࣌ͷোΛ͙ɻ
ʲ՝̏ʳ࠶ֶशΛࣗಈԽ͍ͨ͠ ɾCloudWatch EventsΛ༻͍Δ͜ͱͰɺ࠶ֶशΛఆظతʹߦ͏
̏ɹ࠶ֶशΛࣗಈԽ Cloudwatch eventͰΫʔϩϯܗࣜͰ εέδϡʔϧ࣮ߦ LambdaଆͰલճ࣮ߦ ͨ͠δϣϒΛ࠶࣮ߦ
Sagemaker͜͏ͳͬͨΒخ͍͠ ɾલॲཧ༻ͷΤϯυϙΠϯτ࡞ػೳ͕ཉ͍͠ →ϊʔτϒοΫ্ͷίʔυΛlambdaʹ͖ͬͯͯରԠத
ɹ·ͱΊ ࡞ۀ࣌ؒͷݮ ʢ3࣌ؒ/िʣ ࣌ؒɺि࣍ͷ༧ଌͰίετΛ͑ͯӡ༻ sagemakerͷ࣮ߦɺ࠶ֶशͷࣗಈԽʹޭ ͪΐͬͱͨ͠༧ଌΛεϞʔϧελʔτͰ࢝ΊΒΕΔʂ
ࠓޙ͍ͨ͜͠ͱ σΟεΧόϦʔཁૉͷڧԽ Ϣʔβʔݸʑͷػցֶश ৽ൃ۷δϟϯϧͷఏҊ ਓؾෆਓؾεφοΫͷࣗಈબผ
͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ Let’s enjoy guilt free snacks !
We’re hiring! ɾFront / Backend ɾData Scientist ɾSRE etc