Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
make-your-deaplearning-apps-on-aws-201703
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
ryo nakamaru
March 12, 2017
Technology
2.8k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
make-your-deaplearning-apps-on-aws-201703
JAWS DAYS 2017 での登壇資料です。
ryo nakamaru
March 12, 2017
Transcript
49 slides
#jawsdays #jd2017_d Deep Learning on AWS Ͱ ͚ࣗͩͷֶशϞσϧΛ࡞Ζ͏ʂ by JAWS-UG
AI ࢧ෦
#jawsdays #jd2017_d தؙ ྑ @pottava SUPINF Inc. (AWS Certified) SA,
DevOps Engineer Pro ❤ Amazon ECS, AWS Batch, IAM
#jawsdays #jd2017_d גࣜձࣾεϐϯϑ
#jawsdays #jd2017_d ͜ΜͳձࣾͰ͢ • AWS Λத৺ʹɺΫϥυωΟςΟϒͳ։ൃɾӡ༻อकͷडୗ • Docker Ͱͷ։ൃɾӡ༻ ͕େಘҙ
• GPU, Jupyter, Mesos.. Պֶٕज़ܭࢉڥͷߏஙɾอकडୗ • ͦͷଞ Web αʔϏεɾωΟςΟϒΞϓϦɾۀγεςϜɾɾ
#jawsdays #jd2017_d ૣɺσΟʔϓϥʔχϯά
#jawsdays #jd2017_d σϞ
#jawsdays #jd2017_d AWS ϗϫΠτϖʔύʔ͘Μ • σΟʔϓϥʔχϯάΛར༻ʢLSTM with MXNetʣ • AWS
നॻɺPDF 27 ϑΝΠϧΛֶशσʔλʹར༻ • ग़ͩ͠ͷ୯ޠ͔ΒɺͦΕΒ͍͠ޙଓͷจষΛࣗಈੜ
#jawsdays #jd2017_d σϞͷྲྀΕ 1. ·ͣҰʢֶशෆेͳʣਪ͕ಈ͘͜ͱΛ֬ೝ 2. ͦͷޙվΊͯɺσʔλͷऔಘɾՃ 3. ֶश 4.
৽൛ਪαʔϏεσϓϩΠ
#jawsdays #jd2017_d ਪͷ༷ࢠ ʮAmazon EC2 isʯΛ༩͑ͨ࣌ͷɺֶशෆेͳਪྫ ৽͍͠ݴޠ͕ੜ·Ε·ͨ͠ɻ
#jawsdays #jd2017_d ਪͷ༷ࢠ ʮAmazon EC2 isʯͰɺͦΕͳΓʹֶशͨ͠ޙͷਪྫ ݴ͍͍ͨ͜ͱΘ͔Γ·ͤΜ͕ɺ୯ޠจ๏ਵ͠·ͨ͠ɻ
#jawsdays #jd2017_d γεςϜߏ AWS Batch S3 2.ֶशδϣϒೖ ΤϯδχΞ SpotFleet ECR
DeepLearning AMI v2 1.ֶशσʔλೖ 3.δϣϒεέδϡʔϧ 4.σʔλऔಘ & ֶश 5.݁ՌϞσϧΛอଘ ҰൠϢʔβ AWS Lambda 7.Ϟσϧऔಘ & ਪ APIGateway 6.ਪϦΫΤετ 8.݁ՌԠ ECS EC2 g2.2xlarge EC2 g2.2xlarge
#jawsdays #jd2017_d ΄΅શ෦ެ։͠·ͨ͠ • PDF 1 ຕఔͳΒ 10 Ͱࢼͤ·͢ •
AWS ͷσϓϩΠπʔϧ܈Ұ෦ܝࡌ ʢશ෦ࢿྉԽ͢ΔͷّͳͷͰ..ʣ https://github.com/pottava/mxnet-char-lstm
#jawsdays #jd2017_d ͳΔ΄ͲΘ͔ΒΜ • ެ։͞Εͨࢿྉ͚ͩͰΑ͔͘Βͳ͍ɻ͍ɾɾ • Qiita Ͱใൃ৴͠·͢ • σΟʔϓϥʔχϯάͰ
AWS ͷઃܭͰ • Twitter ͳͲͰฉ͍ͯΒ͑Ε༨ྗ͋Δͱ͖͑·͢ :) • ͓ؾܰʹ @pottava ·Ͱ
#jawsdays #jd2017_d ৼΓฦΓ
#jawsdays #jd2017_d Ͳ͏࡞ͬͨͷ͔ 1. PDF Λదʹμϯϩʔυʢσʔλऩूɺ5 ʣ 2. ֶश͍͢͠Α͏ʹσʔλΛՃʢલॲཧɺ30 ʣ
3. LSTM ωοτϫʔΫʹೖʢֶशɺ5 ࣌ؒʣ 4. REST API Λ࣮ʢਪɺ45 ʣ ʢ + ຊࢫͰͳ͍ AWS ͷઃܭɺϑϨʔϜϫʔΫͷΩϟονΞοϓʹ૬Ԡͷ࣌ؒʣ
#jawsdays #jd2017_d ͳͥΫϥυͰʁ • ֶशσʔλ࡞ͨ͠Ϟσϧൺֱతେ͖ͳϑΝΠϧ • ֶशɺྫ͑Ұൠ͚ PC ͩͱͦΕ͚ͩͰ͔͔Δ •
Ұ࣌తʹɺେͰߴੑೳͳܭࢉೳྗ͕͑Δ • ਪαʔϏεͷσϓϩΠɾӡ༻ͱͯ؆୯
#jawsdays #jd2017_d Կ͕Ͳ͏ػցֶशͩͬͨͷʁ ❌ʮ͜ͷ୯ޠ͕ೖྗ͞ΕͨΒɺ͜͏ग़ྗͯ͠ʯ ⭕ʮେྔʹಡΜͩจষΛੜ͔ͯ͠ɺ࣍ͷ୯ޠΛ༧ଌͯ͠Ͷʯ
#jawsdays #jd2017_d Կ͕Ͳ͏σΟʔϓͩͬͨͷʁ จষͷࣗಈੜʹͬͨػցֶशͷख๏͕ LSTM ͱ͍͏ ϦΧϨϯτχϡʔϥϧωοτϫʔΫ͔ͩͬͨΒɻ ʁʁʁ
#jawsdays #jd2017_d σΟʔϓϥʔχϯά ʢਂֶश / DLʣ.
#jawsdays #jd2017_d σΟʔϓϥʔχϯάͱ • ଟߏͷχϡʔϥϧωοτϫʔΫΛ༻͍ͨػցֶशͷ͜ͱ • χϡʔϥϧωοτϫʔΫͱ͍͏ಠಛͳܗͰอ࣋͞Εͨ • ҎԼͷ a
ͱ b ΛܾΊΔ͜ͱֶ͕श ɹy = ax + b • ͦΕΛͱʹ x ͕͖ͨΒ y ͱฦ͢ͷ͕ɺਪ
#jawsdays #jd2017_d σΟʔϓϥʔχϯάͱ • ࣮ࡍେͳมͦΕͧΕʹ࠷దΛ୳͠ʮϞσϧʯΛੜ • ҰͭͷͷɺҰͭͷϊʔυ͚ͩͰมͨ͘͞Μ ɹy = f
( w1x1 + w2x2 + w3x3 + … + wnxn + b )
#jawsdays #jd2017_d Α͘ݟΔ DL ͷྫ • Amazon Rekognition ͷҰൠମݕग़ɺ͖ͬͱ CNNɻ
• ΈࠐΈχϡʔϥϧωοτϫʔΫʢCNNʣ ෳͷ͕͋Γ·͢Ͷʙ
#jawsdays #jd2017_d Ͱ
#jawsdays #jd2017_d Ͳ͏ͬͯϞσϧΛ࡞Δͷ͔
#jawsdays #jd2017_d ࢼߦࡨޡ͢ΔͨΊͷ
#jawsdays #jd2017_d Ϋϥυͷ౷߹ݚڀڥ
#jawsdays #jd2017_d Jupyter as a Service • ࢼߦࡨޡɺݚڀͷڞ༗ͷελϯμʔτͱ͍͑ Jupyter •
࠷ۙྲྀߦͷػೳ֦ுɿΫϥυͷσʔλετΞͱͷ࿈ܞ • σʔλͷநग़ɺมɾՃɺͦͷऔΓࠐΈʢETLʣ • AWS Ұาग़Ε͍ͯΔͷͷɾɾ
#jawsdays #jd2017_d Google Cloud Datalab
#jawsdays #jd2017_d Google Cloud Datalab • TensorFlow ✖ BigQuery ͷྫ
• ͦͷૢ࡞ UI ͱͯ͠ Jupyter ɹϕʔεͷ Cloud Datalab • ϩʔΧϧ൛·Ͱ͋Δɾɾ
#jawsdays #jd2017_d Azure ML Studio
#jawsdays #jd2017_d ͱʹ͔͘ੑೳॏࢹ or ࣗ༝ʹ ϑϨʔϜϫʔΫΛબͼ͍ͨͳΒ
#jawsdays #jd2017_d GPU Infiniband ΛؚΉ ϚϧνΫϥυ HPC ڥ ΦϯϓϨͱͷϋΠϒϦοτɻ
͑ΔϑϨʔϜϫʔΫଟʂʂ
#jawsdays #jd2017_d ฒྻԋࢉʹΑΔֶश
#jawsdays #jd2017_d ֶशϑΣʔζ HPC • ػցֶशͰͷֶशɺେͳύϥϝλΛܭࢉ͢Δ͜ͱ • ຊ֨తʹͳΔఔɺखڐͷ൚༻Ͱ౸ఈܭࢉͰ͖ͳ͍
#jawsdays #jd2017_d όονίϯϐϡʔςΟϯά • ແݶʹεέʔϧ͢Δߴੑೳ / GPU ࡌͷΫϥελ܈ • ࣮ߦॱংʢґଘʣͷ͋ΔδϣϒΛฒྻࢄॲཧ
• ͦΕͰऴΘΒͳֶ͍शɾɾ • AWS ͜ͷྖҬ͕͍·͍ʂʂ
#jawsdays #jd2017_d AWS Batch • Ϛωʔδυ όονίϯϐϡʔςΟϯάڥ • ΫϥελཧɺΩϡʔɺεέδϡʔϥΛ AWS
ʹ͓ͤ • Ωϡʔ͕ਂ͘ͳΔͱࣗಈͰεέʔϧʂʂ • SpotFleet ͱ౷߹͞Ε͍ͯΔʂ • Docker ϕʔεʹͳ͓ͬͯΓɺLinux ܥͷॲཧͳΜͰಈ͘
#jawsdays #jd2017_d AWS Batch • ࠓճͷΑ͏ʹɺGPU Λ͍͍ͨ / ಠࣗ AMI
Λ͍͍ͨ • ͘͠ t2 ܥΠϯελϯεͰࢼ͍ͨ͠ • ͦΜͳ࣌ʮUnmanaged ڥʯΛબ͢Ε OKʂ • ASG SpotFleet ͷ্Ͱ ECS Λಈ͔ͤेշదͰ͢
#jawsdays #jd2017_d AWS Batch ʢҙ֎ʁͳར༻ྫʣ S3 ʹ͋͛ͨେྔը૾ Rekognition Ͱͷ Ұൠମݕग़Λ
AWS Batch ͔Β࣮ߦɻ
#jawsdays #jd2017_d ϋϯζΦϯ͋Γ㽂 ΈΜͳେ͖ɺCOBOL ͷఆྫόον Λ AWS Batch Ͱ
#jawsdays #jd2017_d αʔϏε࣭͕ॏཁɺਪ
#jawsdays #jd2017_d ਪϑΣʔζ 24 / 365 • εϚϗɺIoT ػثͰਪͰ͖ΔΑ͏ʹͳ͖ͬͯͨݱ •
Մ༻ੑͱϨΠςϯγ͕ॏཁɺҰൠͷαʔϏεͱಉ͡ • EC2 Ͱ API Λఏڙ͢Δ͜ͱͪΖΜͰ͖Δ͕ • ͦΕɺLambda Ͱಈ͘Α
#jawsdays #jd2017_d AWS Lambda http://aws.typepad.com/sajp/2017/01/seamlessly- scale-predictions-with-aws-lambda-and-mxnet.html
#jawsdays #jd2017_d AMI for DeepLearning !! • ͍ɺͬͺΓֶशɾਪͱ EC2 ͕͍͍ͱ͍͏ํɺ࿕ใͰ͢
• Batch ECS Ͱ༗༻ɺશ෦ೖΓ AMI ʂʂ • ࠷৽ͷ TensorFlow, MXNet, ɹCaffe, CNTK, Theano, Torchɻɻ ɹAnaconda ೖͬͯ·͢ʂ
#jawsdays #jd2017_d DeepLearning AMI • ࠓճͷσϞͰ͍·ͨ͠ • GPU Λ͏࣌ͷؔɺNVIDIA υϥΠόηοτΞοϓࡁ
• docker & ecs-agent Λ user-data ͰΠϯετʔϧ͢Ε ɹAWS Batch Amazon ECS Ͱ؆୯ʹಈ࡞͠·͢
#jawsdays #jd2017_d JAWS-UG AI ࢧ෦
#jawsdays #jd2017_d ίϯςϯπ • AWS Ͱ AI αʔϏεΛ࣮ɾӡ༻͢ΔͨΊͷ ɹҰൠతͳٕज़ใɺݟɺࣄྫڞ༗ͷ •
͢Ͱʹ׆༻͍ͯ͠Δํ • ಋೖΛݕ౼͍ͯ͠Δํ • ԿͦΕ͓͍͍͠ͷʁͳํʢ։࠵͝ͱʹқ͕ଟগҧ͍·͢ʣ
#jawsdays #jd2017_d ࠓ݄εϖγϟϧճ։࠵ʂ • 3 / 31 (ۚ) 19:00 ʙ
• HPC ઐࢧ෦ͱͷ߹ಉΠϕϯτ • AWS ຊ͔ࣾΒήετ 2 ໊ʂʂ
#jawsdays #jd2017_d ӡӦϝϯόʔ
#jawsdays #jd2017_d Thank you for coming! ࢀߟจݙ: • AWS Batch
– ؆୯ʹ͑ͯޮతͳόονίϯϐϡʔςΟϯάػೳ – AWS https://aws.amazon.com/jp/batch/ • AWS Black Belt Online SeminarʮAWS Batchʯͷࢿྉ͓ΑͼQAެ։ http://aws.typepad.com/sajp/2017/02/aws-black-belt-online-seminar-aws- batch.html#QCPzBdn.twitter_tweet_count_m • re:Invent 2016: AWS Big Data & Machine Learning Sessionsɻ https://aws.amazon.com/blogs/big-data/reinvent-2016-aws-big-data- machine-learning-sessions/
More Decks by ryo nakamaru
See All by ryo nakamaru
AWSで楽をするサービスメッシュ入門/appmesh-trial
pottava
1
1.7k
reinforce-2019-recap-lt
pottava
2
4.2k
ScaleShift-jp-2019-summer
pottava
1
240
Firecracker とは何か/what is Firecracker
pottava
12
5.7k
ハイブリッド並列 on Kubernetes/hybrid-parallel-program-on-kubernetes
pottava
1
480
AWS Fargate + Code 兄弟で始める継続的デリバリー / Continuous Delivery with AWS Fargate and Code brothers
pottava
12
3.4k
Singularity と NVIDIA GPU Cloud で作る ハイブリッド機械学習環境の構築 / Building a hybrid environment for Machine Learning with Singularity and NGC
pottava
3
1.6k
明日から始めるちょい足し λ / get-started-with-aws-lambda
pottava
4
2.6k
NGC と Singularity によるハイブリッド機械学習環境 / A hybrid environment for Machine Learning with NGC and Singularity
pottava
0
560
Other Decks in Technology
See All in Technology
Intro to Kiro (One agent, every surface) | Kiro: Zero to Hero 01
inariku
PRO
2
150
AI時代における医療情報システムのセキュリティ / Security of Healthcare IT Systems in the AI Era
henryofficial
0
180
市販IoT機器や自作IoT機器とHomeAssistantを駆使して家の電気代をできる限り見える化する方法の考案
harutiro
0
290
Sonnetだけで業務はまわる?
kintotechdev
1
140
会社説明資料_最新版
demaecan
0
32k
Datadog の権限統制 〜Org 統合に向けて調べた注意点 / JDDUG-Meetup_24
visional_engineering_and_design
1
160
人の努力に頼らないセキュリティをエンジニアリングする在り方 / An approach to engineering security that does not rely on human effort
carta_engineering
0
120
文書画像からの情報抽出を行うエージェントを、軌跡の正解データ無しで作れるか
sansantech
PRO
2
140
[NW-JAWS DAY]「うちのAWS、インターネット出られないんで」― AWS外の自社サービスをPrivateLinkでシュッと公開する方法
ykimi
2
660
AWS Emulator を評価する: 手元で動く AWS の API の仕組み、始め方、確かめ方
inariku
PRO
1
730
コピーオンライト型ファイルシステムと ランダム書き込み
sat
PRO
2
110
マネジメントされる側の仕事は「文句」を言うこと
riyaamemiya
6
5.5k
Featured
See All Featured
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
2k
Neural Spatial Audio Processing for Sound Field Analysis and Control
skoyamalab
0
620
RailsConf 2023
tenderlove
30
1.6k
The #1 spot is gone: here's how to win anyway
tamaranovitovic
4
1.2k
Tips & Tricks on How to Get Your First Job In Tech
honzajavorek
1
850
Primal Persuasion: How to Engage the Brain for Learning That Lasts
tmiket
0
520
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
11
1.1k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
50
10k
Building a Modern Day E-commerce SEO Strategy
aleyda
45
9.3k
Learning to Love Humans: Emotional Interface Design
aarron
275
41k
Are puppies a ranking factor?
jonoalderson
2
4.2k
エンジニアに許された特別な時間の終わり
watany
109
250k