Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Search
Naotoshi Seo
February 17, 2017
Technology
4
5.9k
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Naotoshi Seo
February 17, 2017
Tweet
Share
More Decks by Naotoshi Seo
See All by Naotoshi Seo
ZOZOTOWNリプレイス2020
sonots
5
31k
Red Chainer and Cumo: Practical Deep Learning in Ruby at RubyKaigi 2019
sonots
1
3.9k
Introduction of Cumo, and Integration to Red Chainer
sonots
1
940
Implementation of Cumo, a CUDA-aware version of Ruby/Numo
sonots
1
1.6k
Fast Numerical Computing and Deep Learning in Ruby with Cumo
sonots
0
8.5k
CuPy improvments around memory
sonots
3
1.4k
Triglav - Data Driven Workflow Tool
sonots
1
3.9k
DeNA流データエンジニアリングの極意
sonots
17
12k
BigQuery Schema Migration #bq_sushi
sonots
2
5.9k
Other Decks in Technology
See All in Technology
マルチアカウント環境への発見的統制の導入
ch1aki
1
1.3k
SPI原点回帰論:事業課題とFour Keysの結節点を見出す実践的ソフトウェアプロセス改善 / DevOpsDays Tokyo 2024
visional_engineering_and_design
4
1.2k
CSSDAY 2024
kevinshallvari
0
180
検証を通して見えてきたTiDBの性能特性
lycorptech_jp
PRO
4
1.9k
ビジネスとエンジニアリングの接合点 そしてコード品質がそこに及ぼす影響 v1.1 / The Intersections of Business and Engineering, and The Impact of Code Quality There (v1.1)
mtx2s
11
2.4k
「ふりかえりのふりかえり」をふりかえり、実のあるふりかえりにする
naitosatoshi
0
210
次世代Web認証「パスキー」 / mo-zatsudan-passkey
nkzn
22
13k
Databricks におけるデータエンジニアリング
databricksjapan
0
370
【SORACOM UG】(2024年度版) SIMってなんだ? ~セルラー通信がつながる仕組み、解説します~
soracom
PRO
0
200
2024/4/26 コンピュータ歴史博物館解説告知
toshi_atsumi
0
190
社内勉強会運営のコツ
senoo
6
1.1k
コンテナセキュリティの基本と脅威への対策
kyohmizu
3
650
Featured
See All Featured
Code Review Best Practice
trishagee
54
15k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
185
16k
Statistics for Hackers
jakevdp
789
220k
Why Our Code Smells
bkeepers
PRO
331
56k
Facilitating Awesome Meetings
lara
40
5.6k
jQuery: Nuts, Bolts and Bling
dougneiner
59
7.1k
Web development in the modern age
philhawksworth
201
10k
GraphQLとの向き合い方2022年版
quramy
30
12k
For a Future-Friendly Web
brad_frost
171
8.9k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.3k
Building Better People: How to give real-time feedback that sticks.
wjessup
353
18k
The Pragmatic Product Professional
lauravandoore
24
5.8k
Transcript
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNA AIγεςϜ෦ʹ͓ ͚ΔΫϥυΛ׆༻ͨ͠
ػցֶशج൫ͷߏங #denatechcon 2017 1 Feb 10, 2017 Naotoshi Seo AI System Division DeNA Co., Ltd.
ࣗݾհ 2 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾඌར!TPOPUT
ɾ"*γεςϜ෦ چੳج൫෦ ɾ"OBMZUJDT5PPMTνʔϜ $MPVE*OGSBνʔϜ ϦʔυΤϯδχΞ ݉ ɾ'MVFOUE3VCZίϛολ
ରऀ 3 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨΠϯϑϥ୲ऀ • ΠϯϑϥΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨػցֶशΤϯδχΞ
࣍ 4 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL • ͓·͚"84ͱ($1ͷൺֱ
5 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
6 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͷલʹ
7 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. (16ͷجૅࣝ GPUͷجૅࣝ
8 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • σΟʔϓϥʔχϯά
• (16Λͬͨ΄͏͕͍ • ྫ $16ͩͱˠ(16ͩͱ ͳͥ(16͕ඞཁ͔ GPUͷجૅࣝ
(16ͷಛ 9 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ฒྻॲཧ͕ಘҙ • $16ͩͱίΞͳͲͷΦʔμʔ • (16ͩͱ d ίΞ • ذॲཧۤख • ذ༧ଌɾΞτΦϒΦʔμʔͷ ػೳΛ؆ૉԽ͢Δ͜ͱͰίΞΛ ૿͍ͯ͠Δ • ߦྻԋࢉʹ͍͍ͯΔ GPUͷجૅࣝ
(16 10 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
/7*%*"5FTMB • /7*%*"ͷ)1$͚(16γϦʔζ • /7*%*"(F'PSDF(3*% • Ϋϥυήʔϛϯά͚ • ".%'JSF1SP • ".%ͷ)1$͚γϦʔζ GPUͷجૅࣝ
/7*%*"5FTMB 11 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ੈ • 'FSNJ,FQMFS • .BYXFMM1BTDBM • ྫ LˠLFQMFS • "1* • $6%" /7*%*"ಠࣗ • 0QFO$- • %JSFDU$PNQVUF GPUͷجૅࣝ http://pc.watch.impress.co.jp/img/pcw/docs/755/994/html/Visio- NvidiaGPUComparisonGFLOPSvsMemorybandwidth.png.html
$6%"ͷΞʔΩςΫνϟ 12 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ϗετ $16 ͔ΒσόΠ ε (16 ʹσʔλΛసૹ • (16Ͱॲཧ • ݁ՌΛσόΠε (16 ͔ Βϗετʹసૹ $16 GPUͷجૅࣝ http://www.nvidia.co.jp/docs/IO/51174/ NVIDIA_CUDA_Programming_Guide_1.1_JPN.pdf
13 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNAͷΦϯϓϨGPUڥ (2017/02ݱࡏ) 14
CPUɿXeon E5-2630 v3 2.4GHz *2 GPUɿNVIDIA Tesla M40 *2 Memɿ64GB NICɿ10Gb ίΞ MHz GPUϝϞϦ ൃද M40 3072 1114 12GB 2015/11 ५ͳGPU
15 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Γͳ͍ ɾТɾʆ
५ͳGPU
"*Ҋ݅ʹ͓͚Δ(16ར༻ 16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
͋Ε͋Δ͚͍͍ͩͨ • ύϥϝʔλΛগ͠ม͑ͯฒྻͰֶशͤ͞ ͯɺྑ͍ํΛબͿ • ֶश͢Δ࣌ʹ͚ͩ͏ • ऴΘͬͨΒഇغͯ͠ߏΘͳ͍ ५ͳGPU
17 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳGPU DHΠϯελϯε HΠϯελϯε
QΠϯελϯε چੈ AWSͷGPU
HΠϯελϯε 19 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA GRID K520 1536 * 2 800 2013/5 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞϦ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωο τϫ ʔΫ Ձ֨/࣌ (us- east-1) g2.2xlarge 1 8 15 1,536 4 $0.65 g2.8xlarge 4 32 60 6,144 32 $2.6
QΠϯελϯε Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ౦ژϦʔδϣϯͰ(·ͩ)͑ͳ͍ AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA Tesla K80 2496 * 2 875 2014/11 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞ Ϧ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωοτ ϫʔΫ Ձ֨/࣌ (us- east-1) p2.xlarge 1 4 61 2,496 12 ߴ $0.9 p2.8xlarge 8 32 488 19,968 96 10G $7.2 p2.16xlarge 16 64 732 39,936 192 20G $14.4
%F/"Ͱͷ(16ར༻ 21 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
VTͰQΠϯελϯε L Λ͏ • ֶशͤ͞Δ͚࣌ͩىಈ͠ɺ͋ͱࢭΊΔ • ϋΠύʔύϥϝʔλνϡʔχϯάͳͲͰͨ ͘͞Μฒ࣮ͯߦ͢ΔͷʹΫϥυڥ ༗ར‷ ŋŷŋ و ̑̑ ५ͳGPU
($1ͷ(16 22 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. GCPͷGPU
https://cloud.google.com/gpu/
($1ͷ(16 23 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΞϧϑΝ • ਃ͢ΕL QΠ ϯελϯεͱಉ͡ ͕ ͑Δ • ͦΕҎ֎·ͩμϝͩͬ ͨ ɾТɾʆ • L͕௨ৗΠϯελϯ εʹΞλον͞Εͨܗ GCPͷGPU
($1ͷ(16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ௨ৗΠϯελϯεۚʹΞλον͚ͩϓϥε GCPΠϯελϯεͷ՝͕ۚ୯Ґ(ͨͩ͠ɺ
࠷Ͱ10औΒΕΔ) GCPͷGPU GPU ݸ ฒྻί Ξ GPUϝ ϞϦ (GB) FP32 (TFLOP S) Ձ֨/࣌ (us) Ϧʔδϣ ϯ Tesla K80x1 1 2,496 12 4.3 $0.7 ౦ژҎ֎ Tesla P100x1 1 3,584 16 10.6 ෆ໌ N/A AMD FirePro S9300 x2 1 8 13.9 ෆ໌ N/A
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 25 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾ ִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ִ͞Εͨڥ 26 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
%F/"ͷ"*Ҋ݅ • ൿಗҊ݅ • ڠۀҊ݅ • ඇؔ༩ࣾһ͕σʔλʹΞΫηεͰ͖ͳ͍Α͏ʹִ ͞ΕͨηΩϡΞͳڥΛ࡞Δඞཁ͕͋Δ • ͨͩ͠ɺڠۀձࣾͷؔ༩ࣾһΞΫηεͰ͖Δ ΫϥυΞΧϯτΛ͚ͯ ผݸͷڥͱִͯ͠ ִ͞Εͨڥ
ωοτϫʔΫߏ 27 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Subnet
service components step DeNA PC Gateway ghe, etc Security Group ssh Security Group ִ͞Εͨڥ • ΦϯϓϨ(BUFXBZ ͔ΒͷΈ౿Έαʔ όʹTTIՄೳ • (BUFXBZͰάϧʔ ϓݖݶཧ • ίʔυHJUIVCF ʹઐ༻PSHΛ࡞ͬ ͯQSJWBUFӡ༻
ࠪϩά 28 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ίϚϯυ࣮ߦϩά • %F/"ͷ(BUFXBZʹ͋ΔΩʔϩΨʔ • Ϋϥυͷૢ࡞ϩά • "84$MPVE5SBJM • ($14UBDL%SJWFS ִ͞Εͨڥ
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 29 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾ ૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ૉૣ͍ߏங 30 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ̍ϲ݄ʹ̑ϓϩδΣΫτ ݄ • ઐ͡Όͳ͍ͷͰɺखؒͳ͘ૉૣ͘ ૉૣ͍ߏங
ࣗಈԽίʔυԽ 31 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
5FSSBGPSNͰΦʔέετϨʔγϣϯͷ ࣗಈԽˍίʔυԽ • "84 ($1྆ํʹରԠ • *UBNBFͰϓϩϏδϣχϯά • ࡞ͷLPOEBUFϥούʔ ૉૣ͍ߏங
ػցֶशڥͷ ϓϩϏδϣχϯά 32 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• VCVOUV$IBJOFSΦεεϝ • OWJEJBESJWFS • DVEBOWJEJBͷDVEBBQUSFQP͔ΒೖΕΔͱOWJEJBESJWFSೖָͬͯ • DVEOOOWJEJBͷNBDIJOFMFBSOJOHBQUSFQP͔ΒೖΕΔͱָ • QZUIPO • DIBJOFS ૉૣ͍ߏங
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 33 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾ ӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ӡ༻ָ͕ 34 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ͲΜͲΜڥ͕૿͑Δ • ઐ͡Όͳ͍ͷͰɺָʹ͠ͳ͍ͱ݉ۀͷ ΞϓϦ։ൃۀ͕Ͱ͖ͳ͍ ӡ༻ָ͕
35 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
ΫϥυͷػೳΛ͏ 36 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Ͱ͖Δ͚ͩΫϥυͷػೳΛ͏ • ࢹπʔϧ • "84$MPVE8BUDI • ($14UBDL%SJWFS • .Z42- "843%4 ($1$MPVE42- • 3FEJT "84&MBTUJDBDIF ͳͲͳͲ ӡ༻ָ͕
ར༻தͷ"84αʔϏε 37 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
&$ • 71$ •  • 3PVUF • 4 • "VSPSBPS3%4 .Z42- • &MBTUJ$BDIF 3FEJT • &MBTUJD-PBE#BMBODJOH • $MPVE'SPOU • &MBTUJD'JMF4ZTUFN /'4 • 4/4 • 4&4 4.51 • &.3 )BEPPQ 4QBSL • $MPVE8BUDI • $MPVE5SBJM ӡ༻ָ͕
ར༻தͷ($1αʔϏε 38 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(PPHMF$PNQVUF&OHJOF ($& • (PPHMF"QQ&OHJOF • (PPHMF-PBE#BMBODJOH • (PPHMF$MPVE$%/ • (PPHMF$MPVE%/4 • (PPHMF$MPVE42- • 4UBDLESJWFS.POJUPSJOH • (PPHMF$MPVE4UPSBHF • (PPHMF#JH2VFSZ • (PPHMF$MPVE%BUBQSPD ӡ༻ָ͕
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 39 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾ ࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ࣗ༝Λߴ͘ 40 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
γε ΤϯδχΞ ʹ̎ύλʔϯ Πϯϑϥ͍͡Γ͍ͨ Πϯϑϥ͓ͤ͠·͢ • ͍͡Γ͍ͨͳΒੋඇͬͯ͘Εʂ ࣗ༝Λߴ͘
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 41 https://suzuri.jp/mizzy/76284/t-shirt/m/navy
͍ͬͯ͡ྑ͍ 42 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Πϯελϯεͷ্ཱͪ͛ࣗ༝ • ΫϥυαʔϏεͷઃఆ • 5FSSBGPSNʹ13 • ϓϩϏδϣχϯά • ج൫ͱผͷπʔϧͰίʔυԽ0, • खಈηοτΞοϓͯ͠ΠϝʔδʹݻΊ ͯ0, ࣗ༝Λߴ͘
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 43 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾ ϛε͕͓͖ʹ͍͘
ϛε͕͓͖ʹ͍͘ 44 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ࣗ༝Λߴ͘͢Δͱࠓϛε͕͓͖Δ • ͨͱ͑ɺΠϯελϯε࡞ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • λάΛ͚Δ • 3PVUFʹϗετ໊ొ • ࢹೖ ࣗ࡞πʔϧͰ୲อ ϛε͕͓͖ʹ͍͘
FDDSFBUFJOTUBODFT HDFDSFBUFJOTUBODFT 45 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ΠϯελϯεΛ࡞ • 3PMFTλάΛ͚Δ • దͳΠϝʔδΛબ ࣍ʔδ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • 3PVUFʹϗετ໊ొ • ($1ͷ߹ඪ४Ͱ%/4ొ͞ΕΔͷͰෆཁ • ࢹೖ $ ec2-create-instances -n host --role chainer:dev ϛε͕͓͖ʹ͍͘
FDDSFBUFBNJ HDFDSFBUFTOBQTIPU 46 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ࢦఆͨ͠ϗετΛΠϝʔδԽ • Πϝʔδʹϗετͱಉ͡ϩʔϧΛ͚Δ • ࣍ճFDDSFBUFJOTUBODFT͢Δࡍʹɺ ಉ͡ϩʔϧͷ".*ͷ͏ͪɺ࠷৽ͷͷ͔ΒΠ ϯελϯεΛཱͪ͋͛Δ $ ec2-create-ami -n host ϛε͕͓͖ʹ͍͘
FDMJTUBNJ HDFMJTUTOBQTIPUT 47 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. • ࢦఆͨ͠ϩʔϧͷ͍ͭͨ".*ͷ͏ͪɺ࠷৽ͷ ͷΛදࣔ͢Δ • FDDSFBUFJOTUBODFT෦తʹ͜Ε Λ ϥΠϒϥϦͱͯ͠ ར༻ͯ͠ɺదͳ".* Λબ͢Δ $ ec2-list-ami --role chainer:dev ami-XXXXXXXX 2017-02-04T03:53:10+09:00 chainer:dev ϛε͕͓͖ʹ͍͘
FDIPTU HDFIPTU 48 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• &$Πϯελϯεʹ 3PMFTλάΛ͚ͯɺϩʔ ϧͰཧɺݕࡧ • ($&ͷ߹ NFUBEBUBΛར༻ • *UBNBFͷϩʔϧࢦఆ࣌ ʹར༻ $ ec2-host --role chainer:dev asaa5002 ϛε͕͓͖ʹ͍͘
࣍ 49 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾػցֶशج൫ʹٻΊΒΕΔ
ͨ ͷ ɾ(16αʔόͷΦϯσϚϯυΦʔτεέʔϧ ɾ"1*αʔό αʔϏεఏڙڥ ɾ'VUVSF8PSL ɾ͓·͚"84ͱ($1ͷൺֱ
(16αʔόͷ ΦϯσϚϯυΦʔτεέʔϧ 50 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ฒྻͰֶशΛΒ͍ͤͨ • (16ΠϯελϯεΛඞཁͳ͚ͩࣗಈ Ͱ্ཱͪ͛ͯཉ͍͠ • ֶश͕ऴΘͬͨΒࣗಈͰམͱͯ͠΄͍͠ • མͱ͠Ε͕ͪʼʻ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
... Chainer Cluster create ssh terminate ... XXX Cluster FDTDBMFSVO
51 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • ֶशͤ͞Δͱ͖ʹΠϯελϯεΛ ্ཱͪ͛ͯίϚϯυ࣮ߦ • ͢Ͱʹ্ཱ͕͍ͪͬͯͯΘΕͯ ͍ͳ͍Πϯελϯε͕͍Εੵۃ తʹར༻͢Δ • "84̍࣌ؒ՝ۚͳͷͰ͙͢ʹ ࡴ͞ͳ͍ • ىಈ࣌ؒNJONJO ͰΘΕ͍ͯͳ͍Πϯελϯε͕ ͍Εམͱ͢ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ $ ec2-scale-run -c config.yml [<‘Some shell code'> | <filename [args ...]>
52 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. མͱ͠Εͳ͠ ‷
ŋŷŋ و ̑̑
%PDLFSରԠ 53 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. TDBMFSVOͷதͰOWJEJBEPDLFSSVO
ྫ $IBJOFS5FOTPS'MPXίϯςφ "84($1Ͱखݩͱಉ͡ίϯςφΛ͑ͯศར 2&$4Θͳ͍ͷʁ "ࠓͷͱ͜Ζͬͯ·ͤΜ ཧ༝(16Λ͑ΔΑ͏ʹ͢Δઃఆ͕ ৭ʑΊΜͲ͏ͩͬͨ ཧ༝(,&ͱͷΠϯλʔϑΣʔεҧ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. https://suzuri.jp/chiastolite/90304/t-shirt/s/royalblue GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
ิOWJEJBEPDLFS 55 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
EPDLFSDMJͷബ͍ϥούʔ • %PDLFSίϯςφ͔Βϗετͷ(16 Λ͏ͱ͖ʹศར • OWJEJBEPDLFSQMVHJO͔Β ใΛಘͯɺEPDLFSίϚϯυʹΦ ϓγϣϯΛ৭ʑͯ͠ྑ͍͕໘ $ nvidia-docker run nvidia/cuda nvidia-smi GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
/'4Ϛϯτ 56 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεΛ্ཱͪ͛ ͯམͱ͢ͷͰɺ • ڞ༗ετϨʔδ͕ඞཁ • ֶशݩσʔλ • தؒεφοϓγϣοτ NFS • "NB[PO&'4ΛϚϯτ • ༰ྔࣗಈ֦ு • ஈ͓ߴΊ (#݄ • ౦ژϦʔδϣϯͰ͑ͳ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
εϙοτΠϯελϯεͷ׆༻ 57 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ೖࡳՁ֨ࢢ εϙοτ Ձ֨ͳΒɺࢢՁ֨ ͰΠϯελϯε্ཱ͕͕ͪΔ • ࢢՁ͕͕֨͋ͬͨΒɺՁ͕֨มΘΔ • ࢢՁ֨ೖࡳՁ֨ʹٯసͨ͠ΒɺΠϯελϯ ε͕མͱ͞ΕΔ εϙοτΠϯελϯε <࣮> QYMBSHFIˠI 0'' GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
58 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "1*αʔό αʔϏεఏڙڥ
"1*αʔό 59 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶश̎ͭͷϑΣʔζ • ֶशϑΣʔζ • ༧ଌϑΣʔζ • ֶशϑΣʔζ։ൃڥͰ (16ར༻ • ༧ଌϑΣʔζϓϩμΫγϣϯ $16ར༻ • )551"1*ͱͯͯ͠͠αʔϏεʹఏڙ APIαʔό
࣮ྫ 60 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Elastic
Load Balancing ... API Server (Blue) ... API Server (Green) • $IBJOFSͷ༧ଌϑΣʔ ζΛ͏ͷͰ1ZUIPO ΞϓϦέʔγϣϯ • %KBOHP • ϩʔΧϧ+VCBUVT • #MVF(SFFO %FQMPZNFOU APIαʔό ap-northeast-1 (cpu)
61 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 'VUVSF8PSL
'VUVSF8PSL 62 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"1*αʔόΛ("& (PPMHF"QQ&OHJOF Ͱӡ༻ָ͍ͯͨ͠͠ • ("&QZUIPO • 4UBOEBSE&OWJSPONFOU੍͕ݫ͠ ͗͢ΔͷͰ'MFYJCMF&OWJSPONFOU͔ • શࣗಈϋΠύʔύϥϝʔλνϡʔχϯά͞Μ Future Work
'VUVSF8PSL 63 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ཧ(16Ϛγϯཉ͍͠ ɾТɾʆ • τϥΠΞϯυΤϥʔͳ։ൃ༻్ • खݩͰ։ൃ͍ͨ͠ • େྔʹฒྻͰֶश͍ͤͨ͞߹Ϋϥυ • ࠷Ͱ̍ਓ̍ߪೖ༧ఆ‷ ŋŷŋ و ̑̑ Future Work
64 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͓·͚
65 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "84ͱ($1 ͷൺֱ
Πϯελϯεྉۚ 66 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(16Πϯελϯεͷஈ͋·ΓมΘΒͳ͍ • ($&Πϯελϯεͷ՝ۚ̍͝ͱ • ͨͩ͠ɺ࠷ͰऔΒΕΔ • ($&Πϯελϯε͕̍ϲ݄࣮ؒߦ͞ΕΔ ͱɺྉ͕ۚࣗಈͰׂΓҾ͔ΕΔ • &$ͷϦβʔϒυΠϯελϯεͱҧ͍ɺ৽͍͠Π ϯελϯελΠϓ͕ग़ͨ࣌ʹҾͬӽ͍͢͠ҹ AWSͱGCPͷൺֱ
($1ͷϩʔυόϥϯα͕ڧ͍ 67 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΥʔϜΞοϓෆཁ • ࣄલεέʔϧΞτਃෆཁ • ϚϧνϦʔδϣϯରԠ • ̍άϩʔόϧ*1 *1ΤχʔΩϟετ AWSͱGCPͷൺֱ
($1ͷωοτϫʔΫઃఆ͕ॊೈ 68 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεʹλάΛ͚ͯɺλάͰϧʔ ςΟϯάઃఆՄೳ • "84ͷ߹TVCOFUͰϧʔςΟϯάઃఆ AWSͱGCPͷൺֱ
"84ͷ΄͏͕αʔϏεॆ࣮ 69 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
($1ʹ"84&MBTUJ$BDIF 3FEJT .FNDBDIFE ૬͕ͳ͍ • &'4 /'4 ૬͕ͳ͍ • 4.51αʔϏε͕ͳ͍ • SEQBSUZͱఏܞ • Γͳ͍ͱ͜Ζ͕ͪ´ • 4UBDL%SJWFSʹࢹొ"1*͕·ͩͳ͍ AWSͱGCPͷൺֱ
·ͱΊ 70 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL ("& શࣗಈύϥϝʔλνϡʔχϯά ˠͦΕΫϥυͰ
4QFDJBM5IBOLT ॱෆಉ 71 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• OIBZBTIJ • LB[VLJGVKJLBXB • GVLVEBNB 1'/ • DJWJUBTQP • NB[HJ