Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
reinvent-ml-mini-con
Search
ryo nakamaru
December 09, 2016
Technology
0
2.9k
reinvent-ml-mini-con
JAWS-UG AI 支部 #2 での登壇資料です
ryo nakamaru
December 09, 2016
Tweet
Share
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.4k
reinforce-2019-recap-lt
pottava
2
4.1k
ScaleShift-jp-2019-summer
pottava
1
190
Firecracker とは何か/what is Firecracker
pottava
13
5.3k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
410
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3.1k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.2k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.4k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
460
Other Decks in Technology
See All in Technology
Fabric 移行時の躓きポイントと対応策
ohata_ds
1
120
「完全に理解したTalk」完全に理解した
segavvy
1
270
動画配信の フロントエンドを支える 4年間とこれから
nisshii0313
0
110
OCI技術資料 : ファイル・ストレージ 概要
ocise
3
12k
怖くない!ゼロから始めるPHPソースコードコンパイル入門
colopl
0
240
プロダクト組織で取り組むアドベントカレンダー/Advent Calendar in Product Teams
mixplace
0
660
3年でバックエンドエンジニアが5倍に増えても破綻しなかったアーキテクチャ そして、これから / Software architecture that scales even with a 5x increase in backend engineers in 3 years
euglena1215
11
4.3k
シフトライトなテスト活動を適切に行うことで、無理な開発をせず、過剰にテストせず、顧客をビックリさせないプロダクトを作り上げているお話 #RSGT2025 / Shift Right
nihonbuson
3
1.6k
Evolving Architecture
rainerhahnekamp
3
220
OPENLOGI Company Profile
hr01
0
57k
Bring Your Own Container: When Containers Turn the Key to EDR Bypass/byoc-avtokyo2024
tkmru
0
410
デジタルアイデンティティ技術 認可・ID連携・認証 応用 / 20250114-OIDF-J-EduWG-TechSWG
oidfj
2
260
Featured
See All Featured
Product Roadmaps are Hard
iamctodd
PRO
50
11k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
28
4.4k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
29
940
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
171
50k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.9k
Navigating Team Friction
lara
183
15k
A Philosophy of Restraint
colly
203
16k
Measuring & Analyzing Core Web Vitals
bluesmoon
5
190
GraphQLとの向き合い方2022年版
quramy
44
13k
For a Future-Friendly Web
brad_frost
176
9.5k
Practical Orchestrator
shlominoach
186
10k
Reflections from 52 weeks, 52 projects
jeffersonlam
348
20k
Transcript
AWS Ͱ࢝ΊΔ DeepLearning re:Invent 2016 Machine Learning Mini Con ࢀՃใࠂ
JAWS-UG AI ࢧ෦ @ 2016.12.09
@pottava SUPINF Inc.
͍͖ͳΓͰ͕͢
FizzBuzz ͍ͬͯΔਓʙʁ
FizzBuzz ॻ͚Δਓʙʁ
ɹfor i in range(1,101): ɹ if i % 15 ==
0: ɹ print 'FizzBuzz' ɹ elif i % 3 == 0: ɹ print 'Fizz' ɹ elif i % 5 == 0: ɹ print 'Buzz' ɹ else: ɹ print i ɹͰ͢Ͷɺྫ͑ɻ
Ͱ
ػցֶशͰ FizzBuzz ղ͚Δਓʙʁ
ʁʁʁ
ίϯϐϡʔλʹσʔλΛͯ͠ ύλʔϯΛݟ͚ͭͤ͞Δ
Ξϓϩʔν Ͳ͏ղ͔͘ ໋ྩత ɹfor i in range(1,101): ɹ if i
% 15 == 0: ɹ print 'FizzBuzz' ɹ elif i % 3 == 0: ɹ print 'Fizz' ɹ elif i % 5 == 0: ɹ print 'Buzz' ɹ else: ɹ print i ػցֶश େྔͷσʔλΛ͠... ༧ଌਫ਼ΛߴΊΔ... parameter result 6 Fizz 7 7 10 Buzz 30 FizzBuzz …
Ҏ্ɺͱ͋ΔϫʔΫγϣοϓͰͷ ΞΠεϒϨΠΫͰͨ͠ɻ
ຊ
AWS Ͱ࢝ΊΔ DeepLearning
ࠓͷ ɾ࠷ۙ͋ͬͨ Amazon ػցֶशܥχϡʔεͱ DL ɾre:Invent Machine Learning Mini Con
ใࠂ ɾMXNet ʹ͍ͭͯ ɾϫʔΫγϣοϓͷ༷ࢠͱ࣮ྫ
Amazon ػցֶशܥχϡʔε
ɾAmazon Echo ɾAmazon Go AI ΧϯύχʔɺAmazon.com
Amazon Echo ɾAmazonʮୈ࢛ͷऩӹͷபʯ 2020 ·Ͱʹ 110 ԯυϧՔ͙ ɹਓೳΞγελϯτʮAlexaʯͱ ɹԻίϯτϩʔϥʔͷʮEchoʯ ɹhttp://thebridge.jp/2016/09/amazon-echo-alexa-add-11-billion-in-revenue-by-2020-2016-9-pickupnews
ɾhttps://www.amazon.jobs/en/teams/alexa ɾre:Invent Ͱ echo dot ͕ࢀՃऀʹΒΕ·ͨ͠
Amazon Echo
Amazon Echo Alexa ʹԻͰ͓ئ͍ɾ࣭͢ΔͨΊͷσόΠεɻ ʢAlexa Amazon ͕։ൃͨ͠ AI ʣ
ʮΞϨΫαɺUber ΛݺΜͰɻࠓͷఱؾʁ ʯ ʮΞϨΫαɺ͜ͷۂͷԋऀ୭ʁԻྔΛ্͛ͯʯ
Amazon Echo 1. ԻΛฉ͖औΓ 2. ԿΒ͔ͷॲཧΛͯ͠ 3. ԻΛฦ͢
Amazon Echo 1. ԻΛฉ͖औΓ 2. ԿΒ͔ͷॲཧΛͯ͠ 3. ԻΛฦ͢ Amazon Lex
Amazon Polly
ɾAmazon Echo ɾAmazon Go AI ΧϯύχʔɺAmazon.com
Amazon Go
Amazon Go 1. ೖళ࣌ɺήʔτʹεϚϗΞϓϦΛ͔͟͢ 2. ΄͍͠ͷΛόοάʹೖΕΔ 3. ͓ళΛग़Δ Coming early
2017 !! 2131 7th Ave Seattle, Washington
Amazon Rekognition ଞࣾͰΜͳ Computer vision API ͷҰछɻ
Amazon Rekognition ਂֶशϕʔεͷը૾ೝࣝ APIɻ ɾҰൠମ / ܠݕग़ ɾදੳ ɾإͷྨࣅఆ
Amazon Rekognition ͬͯΈͨ
Amazon Rekognition ฐࣾ༐ऀͷ ྨࣅఆɻ
re:Invent Machine Learning Mini Con
Machine Learning Mini Con ɾػցֶशܥͷηογϣϯ / ϫʔΫγϣοϓ ɾhttp://bit.ly/reinvent-2016-ml ɾࠓ 17
ηογϣϯ ɾϫʔΫγϣοϓҎ֎ YouTube ͰݟΕ·͢
ೖฤ ɾMAC201: Amazon Mechanical Turk ΛͬͯҰൠతಛΛ͔ͭΉ ɾMAC202: Alexa ʹ͓͚Δਂֶश ɾMAC203:
Amazon Rekognition ͷ͝հ ɾMAC204: Amazon Polly ͷ͝հ ɾMAC205: ΫϥυΒ͘͠εέʔϧ͢Δਂֶश: ɹɹɹɹɹ AWS Ͱ Caffe ΛεέʔϧΞοϓͯ͠ϏσΦݕࡧΛվળ͢Δ ɾMAC206: ػցֶशͷݱঢ়
தڃฤ ɾMAC301: ਂֶशͰͷϓϩηεΛม͍͑ͯ͘ ɾMAC302: ෆಈ࢈Ͱͷઓུత༏ҐͷͨΊʹ Amazon ML, Redshift, S3 σʔλϨΠΫΛ׆༻͢Δ
ɾMAC303: Amazon EMR ͱ Apache Spark ͰΫϥεྨͱ ϨίϝϯσʔγϣϯΤϯδϯΛ։ൃ͢Δ ɾMAC304: Amazon Lex ͷ͝հ ɾMAC306: MXNet ΛͬͯϨίϝϯσʔγϣϯϞσϧΛߏங͢Δ ɾMAC306-R: MXNet Λͬͨਂֶश
தڃฤ ɾMAC307: Predicting Customer Churn with Amazon ML ɾMAC308: ϫʔΫγϣοϓ:
Amazon Lex, Amazon Polly ͦͯ͠ Amazon Rekognition ΛͬͨϋϯζΦϯ ɾMAC309: Amazon Polly ͱ Amazon Lex ͷ͝հ
্ڃฤ ɾMAC401: Scalable Deep Learning Using MXNet ɾMAC403: Automatic Grading
of Diabetic Retinopathy ɹɹɹɹɹ through Deep Learning
ৄࡉ YouTube ͱ Slideshare Ͱ
ϐοΫΞοϓ ɾMAC201: Amazon Mechanical Turk ΛͬͯҰൠతಛΛ͔ͭΉ ɾMAC206: ػցֶशͷݱঢ় ɾMAC306: MXNet
ΛͬͯϨίϝϯσʔγϣϯϞσϧΛߏங͢Δ ɾMAC401: Scalable Deep Learning Using MXNet
MAC201 Mechanical Turk Ͱػցֶश༻σʔλΛ࡞Δ ɾhttps://www.youtube.com/watch?v=vRtLdeNl7Tg ɾେྔͷɺߴ࣭ͳσʔληοτूΊʹ͍͘ ɾϝΧχΧϧλʔΫʹͦͷ࡞Λґཔ͢Δ
MAC206 Amazon ۀ͔Β࠷৽ AI αʔϏε·Ͱհ ɾhttps://www.youtube.com/watch?v=HqsUfyu0XJc ɾDeep Learning AMI, MXNet,
Alexa ͳͲͳͲ.. ɾޙܯʹαʔϏεఏڙ͢ΔϞτϩʔϥͷࣄྫ
MXNet
ֶशϑϨʔϜϫʔΫ ͲΕ͕͓ΈͰ͔͢ɾɾʁ MXNet / TensorFlow / Caffe / Chainerɻ ɾͲͷχϡʔϥϧωοτ͏ͷʁCNNʁRNNʁ
ɾGPU ͏ͷʁCPU ͚ͩʁෳϊʔυ͏ʁ ɾࠃ࢈ΛԠԉʁ
AWS MXNet Ұײ͋Δ ɾ͑ɺAmazon DSSTNE ɾɾ ɾͱ͍͑ଞͷݕ౼͍ͨ͠ํͪ͜Β ɹ CMP314:
Bringing Deep Learning to the Cloud with Amazon EC2 https://www.youtube.com/watch?v=34Xorby_pyw
MAC306 Netflix ͷϨίϝϯυྫΛ௨ͯ͡ DL / MXNet Λৄઆ ɾhttps://www.youtube.com/watch?v=cftJAuwKWkA ɾDeep Learning
ͷॳา͔Βɻͱ͔ͯΓ͍͢ ɾGitHub ͷ MXNet ϦϙδτϦʹ͋ΔαϯϓϧΛσϞ https://github.com/dmlc/mxnet/tree/master/example/recommenders
ϫʔΫγϣοϓͷ༷ࢠͱ࣮ྫ
ϫʔΫγϣοϓʁ ϋϯζΦϯܗ͕ࣜଟ͍ɻάϧʔϓϫʔΫ͋ͬͨΓɻ ɾ࣮ࡍʹखΛಈ͔͢ͷͰͱͯཧղ͕ਐΉ ɾ·ΘΓͷࢀՃऀͱͷίϛϡχέʔγϣϯ .. !! ɾre:Invent ʹߦ͘ͳΒ௨ৗηογϣϯΑΓΦεεϝ
MAC401 ECS ্Ͱ MXNet ʹΑΔ DL ͷֶशɾਪΛମݧ ɾECS ͷ Runtask
+ CPU ͷΈ ɾGitHub ͷ awslabs ϦϙδτϦΛར༻ https://github.com/awslabs/ecs-deep-learning-workshop/
ࢼ͢ͷͱͯ؆୯ CloudFormation ʹΑΔ EC2 / ECS ੜɻͦͷޙ.. ɾLab 3: ECS
Ͱ MXNet ͷ Jupyter notebook ىಈ ɾLab 4: MXNet ʹΑΔը૾ͷΫϥεྨ ɾLab 5: ECS λεΫͱͯ͠ը૾ΛΫϥεྨ
Deep Learning AMI http://qiita.com/pottava/items/c79117089be2406b127f
͓Βͤ
དྷि JAWS-UG ίϯςφࢧ෦
ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
Amazon ECS ɾࠓ ECS ͰδϣϒΛΒͤΔηογϣϯ͕ෳ ɾMXNet on ECS ͷϫʔΫγϣοϓੈքͰਓؾ ɾECS
Ϋϥελ্Ͱ MXNet ͷֶशɾਪ
AWS Batch ɾECS ্ʹ HPC ۀքͷҙຯʹ͍ۙΫϥελΛߏஙɻ ɾδϣϒεέδϡʔϥ ≠ ίϯςφք۾ͷεέδϡʔϥ ɾECS
্ͳͷͰɺ࣮ίϯςφϕʔε ɾGlue EFS ͱͷΈ߹Θͤॏཁ
͓ΘΓ
גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻ࢹߦΛ͍ͨ͠·͢ɻ ʢGCP / Azure
ͪΖΜରԠ͍ͯ͠·͢ɾɾʣ https://www.supinf.co.jp/service/dockersupport/
͝૬ஊ͓ؾܰʹͪ͜Β·Ͱ.. 57 <Thank you !! https://www.supinf.co.jp/service/dockersupport/