Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Search
Naotoshi Seo
February 17, 2017
Technology
4
6.1k
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Naotoshi Seo
February 17, 2017
Tweet
Share
More Decks by Naotoshi Seo
See All by Naotoshi Seo
ZOZOTOWNリプレイス2020
sonots
5
34k
Red Chainer and Cumo: Practical Deep Learning in Ruby at RubyKaigi 2019
sonots
1
4.3k
Introduction of Cumo, and Integration to Red Chainer
sonots
1
1k
Implementation of Cumo, a CUDA-aware version of Ruby/Numo
sonots
1
1.8k
Fast Numerical Computing and Deep Learning in Ruby with Cumo
sonots
0
9.1k
CuPy improvments around memory
sonots
3
1.5k
Triglav - Data Driven Workflow Tool
sonots
1
4.1k
DeNA流データエンジニアリングの極意
sonots
17
13k
BigQuery Schema Migration #bq_sushi
sonots
2
6k
Other Decks in Technology
See All in Technology
レンジャーシステムズ | 会社紹介(採用ピッチ)
rssytems
0
150
サイバー攻撃を想定したセキュリティガイドライン 策定とASM及びCNAPPの活用方法
syoshie
3
1.2k
kargoの魅力について伝える
magisystem0408
0
200
DevOps視点でAWS re:invent2024の新サービス・アプデを振り返ってみた
oshanqq
0
180
生成AIをより賢く エンジニアのための RAG入門 - Oracle AI Jam Session #20
kutsushitaneko
4
210
[Ruby] Develop a Morse Code Learning Gem & Beep from Strings
oguressive
1
150
Amazon VPC Lattice 最新アップデート紹介 - PrivateLink も似たようなアップデートあったけど違いとは
bigmuramura
0
190
OpenAIの蒸留機能(Model Distillation)を使用して運用中のLLMのコストを削減する取り組み
pharma_x_tech
4
540
podman_update_2024-12
orimanabu
1
260
統計データで2024年の クラウド・インフラ動向を眺める
ysknsid25
2
830
ブラックフライデーで購入したPixel9で、Gemini Nanoを動かしてみた
marchin1989
1
520
C++26 エラー性動作
faithandbrave
2
680
Featured
See All Featured
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
2
160
Keith and Marios Guide to Fast Websites
keithpitt
410
22k
Put a Button on it: Removing Barriers to Going Fast.
kastner
59
3.6k
Why Our Code Smells
bkeepers
PRO
335
57k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
47
5.1k
How to Think Like a Performance Engineer
csswizardry
22
1.2k
A designer walks into a library…
pauljervisheath
204
24k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
6.9k
Designing for humans not robots
tammielis
250
25k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
191
16k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
48k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
29
2k
Transcript
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNA AIγεςϜ෦ʹ͓ ͚ΔΫϥυΛ׆༻ͨ͠
ػցֶशج൫ͷߏங #denatechcon 2017 1 Feb 10, 2017 Naotoshi Seo AI System Division DeNA Co., Ltd.
ࣗݾհ 2 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾඌར!TPOPUT
ɾ"*γεςϜ෦ چੳج൫෦ ɾ"OBMZUJDT5PPMTνʔϜ $MPVE*OGSBνʔϜ ϦʔυΤϯδχΞ ݉ ɾ'MVFOUE3VCZίϛολ
ରऀ 3 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨΠϯϑϥ୲ऀ • ΠϯϑϥΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨػցֶशΤϯδχΞ
࣍ 4 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL • ͓·͚"84ͱ($1ͷൺֱ
5 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
6 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͷલʹ
7 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. (16ͷجૅࣝ GPUͷجૅࣝ
8 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • σΟʔϓϥʔχϯά
• (16Λͬͨ΄͏͕͍ • ྫ $16ͩͱˠ(16ͩͱ ͳͥ(16͕ඞཁ͔ GPUͷجૅࣝ
(16ͷಛ 9 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ฒྻॲཧ͕ಘҙ • $16ͩͱίΞͳͲͷΦʔμʔ • (16ͩͱ d ίΞ • ذॲཧۤख • ذ༧ଌɾΞτΦϒΦʔμʔͷ ػೳΛ؆ૉԽ͢Δ͜ͱͰίΞΛ ૿͍ͯ͠Δ • ߦྻԋࢉʹ͍͍ͯΔ GPUͷجૅࣝ
(16 10 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
/7*%*"5FTMB • /7*%*"ͷ)1$͚(16γϦʔζ • /7*%*"(F'PSDF(3*% • Ϋϥυήʔϛϯά͚ • ".%'JSF1SP • ".%ͷ)1$͚γϦʔζ GPUͷجૅࣝ
/7*%*"5FTMB 11 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ੈ • 'FSNJ,FQMFS • .BYXFMM1BTDBM • ྫ LˠLFQMFS • "1* • $6%" /7*%*"ಠࣗ • 0QFO$- • %JSFDU$PNQVUF GPUͷجૅࣝ http://pc.watch.impress.co.jp/img/pcw/docs/755/994/html/Visio- NvidiaGPUComparisonGFLOPSvsMemorybandwidth.png.html
$6%"ͷΞʔΩςΫνϟ 12 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ϗετ $16 ͔ΒσόΠ ε (16 ʹσʔλΛసૹ • (16Ͱॲཧ • ݁ՌΛσόΠε (16 ͔ Βϗετʹసૹ $16 GPUͷجૅࣝ http://www.nvidia.co.jp/docs/IO/51174/ NVIDIA_CUDA_Programming_Guide_1.1_JPN.pdf
13 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNAͷΦϯϓϨGPUڥ (2017/02ݱࡏ) 14
CPUɿXeon E5-2630 v3 2.4GHz *2 GPUɿNVIDIA Tesla M40 *2 Memɿ64GB NICɿ10Gb ίΞ MHz GPUϝϞϦ ൃද M40 3072 1114 12GB 2015/11 ५ͳGPU
15 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Γͳ͍ ɾТɾʆ
५ͳGPU
"*Ҋ݅ʹ͓͚Δ(16ར༻ 16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
͋Ε͋Δ͚͍͍ͩͨ • ύϥϝʔλΛগ͠ม͑ͯฒྻͰֶशͤ͞ ͯɺྑ͍ํΛબͿ • ֶश͢Δ࣌ʹ͚ͩ͏ • ऴΘͬͨΒഇغͯ͠ߏΘͳ͍ ५ͳGPU
17 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳGPU DHΠϯελϯε HΠϯελϯε
QΠϯελϯε چੈ AWSͷGPU
HΠϯελϯε 19 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA GRID K520 1536 * 2 800 2013/5 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞϦ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωο τϫ ʔΫ Ձ֨/࣌ (us- east-1) g2.2xlarge 1 8 15 1,536 4 $0.65 g2.8xlarge 4 32 60 6,144 32 $2.6
QΠϯελϯε Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ౦ژϦʔδϣϯͰ(·ͩ)͑ͳ͍ AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA Tesla K80 2496 * 2 875 2014/11 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞ Ϧ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωοτ ϫʔΫ Ձ֨/࣌ (us- east-1) p2.xlarge 1 4 61 2,496 12 ߴ $0.9 p2.8xlarge 8 32 488 19,968 96 10G $7.2 p2.16xlarge 16 64 732 39,936 192 20G $14.4
%F/"Ͱͷ(16ར༻ 21 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
VTͰQΠϯελϯε L Λ͏ • ֶशͤ͞Δ͚࣌ͩىಈ͠ɺ͋ͱࢭΊΔ • ϋΠύʔύϥϝʔλνϡʔχϯάͳͲͰͨ ͘͞Μฒ࣮ͯߦ͢ΔͷʹΫϥυڥ ༗ར‷ ŋŷŋ و ̑̑ ५ͳGPU
($1ͷ(16 22 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. GCPͷGPU
https://cloud.google.com/gpu/
($1ͷ(16 23 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΞϧϑΝ • ਃ͢ΕL QΠ ϯελϯεͱಉ͡ ͕ ͑Δ • ͦΕҎ֎·ͩμϝͩͬ ͨ ɾТɾʆ • L͕௨ৗΠϯελϯ εʹΞλον͞Εͨܗ GCPͷGPU
($1ͷ(16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ௨ৗΠϯελϯεۚʹΞλον͚ͩϓϥε GCPΠϯελϯεͷ՝͕ۚ୯Ґ(ͨͩ͠ɺ
࠷Ͱ10औΒΕΔ) GCPͷGPU GPU ݸ ฒྻί Ξ GPUϝ ϞϦ (GB) FP32 (TFLOP S) Ձ֨/࣌ (us) Ϧʔδϣ ϯ Tesla K80x1 1 2,496 12 4.3 $0.7 ౦ژҎ֎ Tesla P100x1 1 3,584 16 10.6 ෆ໌ N/A AMD FirePro S9300 x2 1 8 13.9 ෆ໌ N/A
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 25 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾ ִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ִ͞Εͨڥ 26 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
%F/"ͷ"*Ҋ݅ • ൿಗҊ݅ • ڠۀҊ݅ • ඇؔ༩ࣾһ͕σʔλʹΞΫηεͰ͖ͳ͍Α͏ʹִ ͞ΕͨηΩϡΞͳڥΛ࡞Δඞཁ͕͋Δ • ͨͩ͠ɺڠۀձࣾͷؔ༩ࣾһΞΫηεͰ͖Δ ΫϥυΞΧϯτΛ͚ͯ ผݸͷڥͱִͯ͠ ִ͞Εͨڥ
ωοτϫʔΫߏ 27 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Subnet
service components step DeNA PC Gateway ghe, etc Security Group ssh Security Group ִ͞Εͨڥ • ΦϯϓϨ(BUFXBZ ͔ΒͷΈ౿Έαʔ όʹTTIՄೳ • (BUFXBZͰάϧʔ ϓݖݶཧ • ίʔυHJUIVCF ʹઐ༻PSHΛ࡞ͬ ͯQSJWBUFӡ༻
ࠪϩά 28 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ίϚϯυ࣮ߦϩά • %F/"ͷ(BUFXBZʹ͋ΔΩʔϩΨʔ • Ϋϥυͷૢ࡞ϩά • "84$MPVE5SBJM • ($14UBDL%SJWFS ִ͞Εͨڥ
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 29 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾ ૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ૉૣ͍ߏங 30 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ̍ϲ݄ʹ̑ϓϩδΣΫτ ݄ • ઐ͡Όͳ͍ͷͰɺखؒͳ͘ૉૣ͘ ૉૣ͍ߏங
ࣗಈԽίʔυԽ 31 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
5FSSBGPSNͰΦʔέετϨʔγϣϯͷ ࣗಈԽˍίʔυԽ • "84 ($1྆ํʹରԠ • *UBNBFͰϓϩϏδϣχϯά • ࡞ͷLPOEBUFϥούʔ ૉૣ͍ߏங
ػցֶशڥͷ ϓϩϏδϣχϯά 32 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• VCVOUV$IBJOFSΦεεϝ • OWJEJBESJWFS • DVEBOWJEJBͷDVEBBQUSFQP͔ΒೖΕΔͱOWJEJBESJWFSೖָͬͯ • DVEOOOWJEJBͷNBDIJOFMFBSOJOHBQUSFQP͔ΒೖΕΔͱָ • QZUIPO • DIBJOFS ૉૣ͍ߏங
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 33 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾ ӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ӡ༻ָ͕ 34 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ͲΜͲΜڥ͕૿͑Δ • ઐ͡Όͳ͍ͷͰɺָʹ͠ͳ͍ͱ݉ۀͷ ΞϓϦ։ൃۀ͕Ͱ͖ͳ͍ ӡ༻ָ͕
35 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
ΫϥυͷػೳΛ͏ 36 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Ͱ͖Δ͚ͩΫϥυͷػೳΛ͏ • ࢹπʔϧ • "84$MPVE8BUDI • ($14UBDL%SJWFS • .Z42- "843%4 ($1$MPVE42- • 3FEJT "84&MBTUJDBDIF ͳͲͳͲ ӡ༻ָ͕
ར༻தͷ"84αʔϏε 37 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
&$ • 71$ •  • 3PVUF • 4 • "VSPSBPS3%4 .Z42- • &MBTUJ$BDIF 3FEJT • &MBTUJD-PBE#BMBODJOH • $MPVE'SPOU • &MBTUJD'JMF4ZTUFN /'4 • 4/4 • 4&4 4.51 • &.3 )BEPPQ 4QBSL • $MPVE8BUDI • $MPVE5SBJM ӡ༻ָ͕
ར༻தͷ($1αʔϏε 38 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(PPHMF$PNQVUF&OHJOF ($& • (PPHMF"QQ&OHJOF • (PPHMF-PBE#BMBODJOH • (PPHMF$MPVE$%/ • (PPHMF$MPVE%/4 • (PPHMF$MPVE42- • 4UBDLESJWFS.POJUPSJOH • (PPHMF$MPVE4UPSBHF • (PPHMF#JH2VFSZ • (PPHMF$MPVE%BUBQSPD ӡ༻ָ͕
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 39 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾ ࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ࣗ༝Λߴ͘ 40 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
γε ΤϯδχΞ ʹ̎ύλʔϯ Πϯϑϥ͍͡Γ͍ͨ Πϯϑϥ͓ͤ͠·͢ • ͍͡Γ͍ͨͳΒੋඇͬͯ͘Εʂ ࣗ༝Λߴ͘
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 41 https://suzuri.jp/mizzy/76284/t-shirt/m/navy
͍ͬͯ͡ྑ͍ 42 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Πϯελϯεͷ্ཱͪ͛ࣗ༝ • ΫϥυαʔϏεͷઃఆ • 5FSSBGPSNʹ13 • ϓϩϏδϣχϯά • ج൫ͱผͷπʔϧͰίʔυԽ0, • खಈηοτΞοϓͯ͠ΠϝʔδʹݻΊ ͯ0, ࣗ༝Λߴ͘
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 43 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾ ϛε͕͓͖ʹ͍͘
ϛε͕͓͖ʹ͍͘ 44 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ࣗ༝Λߴ͘͢Δͱࠓϛε͕͓͖Δ • ͨͱ͑ɺΠϯελϯε࡞ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • λάΛ͚Δ • 3PVUFʹϗετ໊ొ • ࢹೖ ࣗ࡞πʔϧͰ୲อ ϛε͕͓͖ʹ͍͘
FDDSFBUFJOTUBODFT HDFDSFBUFJOTUBODFT 45 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ΠϯελϯεΛ࡞ • 3PMFTλάΛ͚Δ • దͳΠϝʔδΛબ ࣍ʔδ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • 3PVUFʹϗετ໊ొ • ($1ͷ߹ඪ४Ͱ%/4ొ͞ΕΔͷͰෆཁ • ࢹೖ $ ec2-create-instances -n host --role chainer:dev ϛε͕͓͖ʹ͍͘
FDDSFBUFBNJ HDFDSFBUFTOBQTIPU 46 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ࢦఆͨ͠ϗετΛΠϝʔδԽ • Πϝʔδʹϗετͱಉ͡ϩʔϧΛ͚Δ • ࣍ճFDDSFBUFJOTUBODFT͢Δࡍʹɺ ಉ͡ϩʔϧͷ".*ͷ͏ͪɺ࠷৽ͷͷ͔ΒΠ ϯελϯεΛཱͪ͋͛Δ $ ec2-create-ami -n host ϛε͕͓͖ʹ͍͘
FDMJTUBNJ HDFMJTUTOBQTIPUT 47 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. • ࢦఆͨ͠ϩʔϧͷ͍ͭͨ".*ͷ͏ͪɺ࠷৽ͷ ͷΛදࣔ͢Δ • FDDSFBUFJOTUBODFT෦తʹ͜Ε Λ ϥΠϒϥϦͱͯ͠ ར༻ͯ͠ɺదͳ".* Λબ͢Δ $ ec2-list-ami --role chainer:dev ami-XXXXXXXX 2017-02-04T03:53:10+09:00 chainer:dev ϛε͕͓͖ʹ͍͘
FDIPTU HDFIPTU 48 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• &$Πϯελϯεʹ 3PMFTλάΛ͚ͯɺϩʔ ϧͰཧɺݕࡧ • ($&ͷ߹ NFUBEBUBΛར༻ • *UBNBFͷϩʔϧࢦఆ࣌ ʹར༻ $ ec2-host --role chainer:dev asaa5002 ϛε͕͓͖ʹ͍͘
࣍ 49 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾػցֶशج൫ʹٻΊΒΕΔ
ͨ ͷ ɾ(16αʔόͷΦϯσϚϯυΦʔτεέʔϧ ɾ"1*αʔό αʔϏεఏڙڥ ɾ'VUVSF8PSL ɾ͓·͚"84ͱ($1ͷൺֱ
(16αʔόͷ ΦϯσϚϯυΦʔτεέʔϧ 50 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ฒྻͰֶशΛΒ͍ͤͨ • (16ΠϯελϯεΛඞཁͳ͚ͩࣗಈ Ͱ্ཱͪ͛ͯཉ͍͠ • ֶश͕ऴΘͬͨΒࣗಈͰམͱͯ͠΄͍͠ • མͱ͠Ε͕ͪʼʻ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
... Chainer Cluster create ssh terminate ... XXX Cluster FDTDBMFSVO
51 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • ֶशͤ͞Δͱ͖ʹΠϯελϯεΛ ্ཱͪ͛ͯίϚϯυ࣮ߦ • ͢Ͱʹ্ཱ͕͍ͪͬͯͯΘΕͯ ͍ͳ͍Πϯελϯε͕͍Εੵۃ తʹར༻͢Δ • "84̍࣌ؒ՝ۚͳͷͰ͙͢ʹ ࡴ͞ͳ͍ • ىಈ࣌ؒNJONJO ͰΘΕ͍ͯͳ͍Πϯελϯε͕ ͍Εམͱ͢ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ $ ec2-scale-run -c config.yml [<‘Some shell code'> | <filename [args ...]>
52 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. མͱ͠Εͳ͠ ‷
ŋŷŋ و ̑̑
%PDLFSରԠ 53 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. TDBMFSVOͷதͰOWJEJBEPDLFSSVO
ྫ $IBJOFS5FOTPS'MPXίϯςφ "84($1Ͱखݩͱಉ͡ίϯςφΛ͑ͯศར 2&$4Θͳ͍ͷʁ "ࠓͷͱ͜Ζͬͯ·ͤΜ ཧ༝(16Λ͑ΔΑ͏ʹ͢Δઃఆ͕ ৭ʑΊΜͲ͏ͩͬͨ ཧ༝(,&ͱͷΠϯλʔϑΣʔεҧ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. https://suzuri.jp/chiastolite/90304/t-shirt/s/royalblue GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
ิOWJEJBEPDLFS 55 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
EPDLFSDMJͷബ͍ϥούʔ • %PDLFSίϯςφ͔Βϗετͷ(16 Λ͏ͱ͖ʹศར • OWJEJBEPDLFSQMVHJO͔Β ใΛಘͯɺEPDLFSίϚϯυʹΦ ϓγϣϯΛ৭ʑͯ͠ྑ͍͕໘ $ nvidia-docker run nvidia/cuda nvidia-smi GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
/'4Ϛϯτ 56 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεΛ্ཱͪ͛ ͯམͱ͢ͷͰɺ • ڞ༗ετϨʔδ͕ඞཁ • ֶशݩσʔλ • தؒεφοϓγϣοτ NFS • "NB[PO&'4ΛϚϯτ • ༰ྔࣗಈ֦ு • ஈ͓ߴΊ (#݄ • ౦ژϦʔδϣϯͰ͑ͳ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
εϙοτΠϯελϯεͷ׆༻ 57 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ೖࡳՁ֨ࢢ εϙοτ Ձ֨ͳΒɺࢢՁ֨ ͰΠϯελϯε্ཱ͕͕ͪΔ • ࢢՁ͕͕֨͋ͬͨΒɺՁ͕֨มΘΔ • ࢢՁ֨ೖࡳՁ֨ʹٯసͨ͠ΒɺΠϯελϯ ε͕མͱ͞ΕΔ εϙοτΠϯελϯε <࣮> QYMBSHFIˠI 0'' GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
58 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "1*αʔό αʔϏεఏڙڥ
"1*αʔό 59 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶश̎ͭͷϑΣʔζ • ֶशϑΣʔζ • ༧ଌϑΣʔζ • ֶशϑΣʔζ։ൃڥͰ (16ར༻ • ༧ଌϑΣʔζϓϩμΫγϣϯ $16ར༻ • )551"1*ͱͯͯ͠͠αʔϏεʹఏڙ APIαʔό
࣮ྫ 60 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Elastic
Load Balancing ... API Server (Blue) ... API Server (Green) • $IBJOFSͷ༧ଌϑΣʔ ζΛ͏ͷͰ1ZUIPO ΞϓϦέʔγϣϯ • %KBOHP • ϩʔΧϧ+VCBUVT • #MVF(SFFO %FQMPZNFOU APIαʔό ap-northeast-1 (cpu)
61 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 'VUVSF8PSL
'VUVSF8PSL 62 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"1*αʔόΛ("& (PPMHF"QQ&OHJOF Ͱӡ༻ָ͍ͯͨ͠͠ • ("&QZUIPO • 4UBOEBSE&OWJSPONFOU੍͕ݫ͠ ͗͢ΔͷͰ'MFYJCMF&OWJSPONFOU͔ • શࣗಈϋΠύʔύϥϝʔλνϡʔχϯά͞Μ Future Work
'VUVSF8PSL 63 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ཧ(16Ϛγϯཉ͍͠ ɾТɾʆ • τϥΠΞϯυΤϥʔͳ։ൃ༻్ • खݩͰ։ൃ͍ͨ͠ • େྔʹฒྻͰֶश͍ͤͨ͞߹Ϋϥυ • ࠷Ͱ̍ਓ̍ߪೖ༧ఆ‷ ŋŷŋ و ̑̑ Future Work
64 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͓·͚
65 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "84ͱ($1 ͷൺֱ
Πϯελϯεྉۚ 66 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(16Πϯελϯεͷஈ͋·ΓมΘΒͳ͍ • ($&Πϯελϯεͷ՝ۚ̍͝ͱ • ͨͩ͠ɺ࠷ͰऔΒΕΔ • ($&Πϯελϯε͕̍ϲ݄࣮ؒߦ͞ΕΔ ͱɺྉ͕ۚࣗಈͰׂΓҾ͔ΕΔ • &$ͷϦβʔϒυΠϯελϯεͱҧ͍ɺ৽͍͠Π ϯελϯελΠϓ͕ग़ͨ࣌ʹҾͬӽ͍͢͠ҹ AWSͱGCPͷൺֱ
($1ͷϩʔυόϥϯα͕ڧ͍ 67 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΥʔϜΞοϓෆཁ • ࣄલεέʔϧΞτਃෆཁ • ϚϧνϦʔδϣϯରԠ • ̍άϩʔόϧ*1 *1ΤχʔΩϟετ AWSͱGCPͷൺֱ
($1ͷωοτϫʔΫઃఆ͕ॊೈ 68 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεʹλάΛ͚ͯɺλάͰϧʔ ςΟϯάઃఆՄೳ • "84ͷ߹TVCOFUͰϧʔςΟϯάઃఆ AWSͱGCPͷൺֱ
"84ͷ΄͏͕αʔϏεॆ࣮ 69 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
($1ʹ"84&MBTUJ$BDIF 3FEJT .FNDBDIFE ૬͕ͳ͍ • &'4 /'4 ૬͕ͳ͍ • 4.51αʔϏε͕ͳ͍ • SEQBSUZͱఏܞ • Γͳ͍ͱ͜Ζ͕ͪ´ • 4UBDL%SJWFSʹࢹొ"1*͕·ͩͳ͍ AWSͱGCPͷൺֱ
·ͱΊ 70 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL ("& શࣗಈύϥϝʔλνϡʔχϯά ˠͦΕΫϥυͰ
4QFDJBM5IBOLT ॱෆಉ 71 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• OIBZBTIJ • LB[VLJGVKJLBXB • GVLVEBNB 1'/ • DJWJUBTQP • NB[HJ