Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Search
Naotoshi Seo
February 17, 2017
Technology
4
5.8k
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Naotoshi Seo
February 17, 2017
Tweet
Share
More Decks by Naotoshi Seo
See All by Naotoshi Seo
ZOZOTOWNリプレイス2020
sonots
5
31k
Red Chainer and Cumo: Practical Deep Learning in Ruby at RubyKaigi 2019
sonots
1
3.8k
Introduction of Cumo, and Integration to Red Chainer
sonots
1
930
Implementation of Cumo, a CUDA-aware version of Ruby/Numo
sonots
1
1.6k
Fast Numerical Computing and Deep Learning in Ruby with Cumo
sonots
0
8.5k
CuPy improvments around memory
sonots
3
1.4k
Triglav - Data Driven Workflow Tool
sonots
1
3.9k
DeNA流データエンジニアリングの極意
sonots
17
12k
BigQuery Schema Migration #bq_sushi
sonots
2
5.9k
Other Decks in Technology
See All in Technology
匠MethodとRDRAとICONIXとDDDで実現する一気通貫オブジェクト指向開発
haru860
4
2k
Ask-LLM論文紹介: How to Train Data-Efficient LLMs
s_ota
0
110
ビジネスとコード品質の接合点 そしてコード品質がそこに及ぼす影響 / The Intersections of Business and Engineering, and The Impact of Code Quality There
mtx2s
10
1k
業務で使えるかもしれない…!?GitHub Actions の Tips 集 / CI/CD Test Night #7
ponkio_o
PRO
24
6.9k
技術広報経験0のEMがエンジニアブランディングをはじめてみた
coconala_engineer
1
130
2023 Japan AWS Jr.Championsに選出されての振り返りとこれから
hiropy877
1
130
データマネジメントを支える武器としてのメタデータ管理
10xinc
1
390
#51 “Empowering Azure Storage with RDMA”
cafenero_777
3
210
OCI Data Integration技術情報 / ocidi_technical_jp
oracle4engineer
PRO
1
1.5k
GraphQLに入門してみた
chiroruxx
2
120
あらゆる商品を扱う商品データベースを再設計した話 / product db re-architecture
rince
8
3.6k
.NETの非同期戦略とUnityとの相互運用
neuecc
2
2.4k
Featured
See All Featured
Rails Girls Zürich Keynote
gr2m
91
13k
Mobile First: as difficult as doing things right
swwweet
215
8.5k
Designing with Data
zakiwarfel
94
4.8k
Put a Button on it: Removing Barriers to Going Fast.
kastner
58
3k
The Invisible Side of Design
smashingmag
293
49k
Building a Scalable Design System with Sketch
lauravandoore
455
32k
Code Review Best Practice
trishagee
54
15k
Ruby is Unlike a Banana
tanoku
95
10k
Making the Leap to Tech Lead
cromwellryan
123
8.4k
Optimizing for Happiness
mojombo
369
69k
How STYLIGHT went responsive
nonsquared
92
4.7k
Creatively Recalculating Your Daily Design Routine
revolveconf
209
11k
Transcript
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNA AIγεςϜ෦ʹ͓ ͚ΔΫϥυΛ׆༻ͨ͠
ػցֶशج൫ͷߏங #denatechcon 2017 1 Feb 10, 2017 Naotoshi Seo AI System Division DeNA Co., Ltd.
ࣗݾհ 2 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾඌར!TPOPUT
ɾ"*γεςϜ෦ چੳج൫෦ ɾ"OBMZUJDT5PPMTνʔϜ $MPVE*OGSBνʔϜ ϦʔυΤϯδχΞ ݉ ɾ'MVFOUE3VCZίϛολ
ରऀ 3 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨΠϯϑϥ୲ऀ • ΠϯϑϥΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨػցֶशΤϯδχΞ
࣍ 4 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL • ͓·͚"84ͱ($1ͷൺֱ
5 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
6 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͷલʹ
7 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. (16ͷجૅࣝ GPUͷجૅࣝ
8 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • σΟʔϓϥʔχϯά
• (16Λͬͨ΄͏͕͍ • ྫ $16ͩͱˠ(16ͩͱ ͳͥ(16͕ඞཁ͔ GPUͷجૅࣝ
(16ͷಛ 9 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ฒྻॲཧ͕ಘҙ • $16ͩͱίΞͳͲͷΦʔμʔ • (16ͩͱ d ίΞ • ذॲཧۤख • ذ༧ଌɾΞτΦϒΦʔμʔͷ ػೳΛ؆ૉԽ͢Δ͜ͱͰίΞΛ ૿͍ͯ͠Δ • ߦྻԋࢉʹ͍͍ͯΔ GPUͷجૅࣝ
(16 10 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
/7*%*"5FTMB • /7*%*"ͷ)1$͚(16γϦʔζ • /7*%*"(F'PSDF(3*% • Ϋϥυήʔϛϯά͚ • ".%'JSF1SP • ".%ͷ)1$͚γϦʔζ GPUͷجૅࣝ
/7*%*"5FTMB 11 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ੈ • 'FSNJ,FQMFS • .BYXFMM1BTDBM • ྫ LˠLFQMFS • "1* • $6%" /7*%*"ಠࣗ • 0QFO$- • %JSFDU$PNQVUF GPUͷجૅࣝ http://pc.watch.impress.co.jp/img/pcw/docs/755/994/html/Visio- NvidiaGPUComparisonGFLOPSvsMemorybandwidth.png.html
$6%"ͷΞʔΩςΫνϟ 12 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ϗετ $16 ͔ΒσόΠ ε (16 ʹσʔλΛసૹ • (16Ͱॲཧ • ݁ՌΛσόΠε (16 ͔ Βϗετʹసૹ $16 GPUͷجૅࣝ http://www.nvidia.co.jp/docs/IO/51174/ NVIDIA_CUDA_Programming_Guide_1.1_JPN.pdf
13 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNAͷΦϯϓϨGPUڥ (2017/02ݱࡏ) 14
CPUɿXeon E5-2630 v3 2.4GHz *2 GPUɿNVIDIA Tesla M40 *2 Memɿ64GB NICɿ10Gb ίΞ MHz GPUϝϞϦ ൃද M40 3072 1114 12GB 2015/11 ५ͳGPU
15 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Γͳ͍ ɾТɾʆ
५ͳGPU
"*Ҋ݅ʹ͓͚Δ(16ར༻ 16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
͋Ε͋Δ͚͍͍ͩͨ • ύϥϝʔλΛগ͠ม͑ͯฒྻͰֶशͤ͞ ͯɺྑ͍ํΛબͿ • ֶश͢Δ࣌ʹ͚ͩ͏ • ऴΘͬͨΒഇغͯ͠ߏΘͳ͍ ५ͳGPU
17 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳGPU DHΠϯελϯε HΠϯελϯε
QΠϯελϯε چੈ AWSͷGPU
HΠϯελϯε 19 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA GRID K520 1536 * 2 800 2013/5 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞϦ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωο τϫ ʔΫ Ձ֨/࣌ (us- east-1) g2.2xlarge 1 8 15 1,536 4 $0.65 g2.8xlarge 4 32 60 6,144 32 $2.6
QΠϯελϯε Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ౦ژϦʔδϣϯͰ(·ͩ)͑ͳ͍ AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA Tesla K80 2496 * 2 875 2014/11 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞ Ϧ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωοτ ϫʔΫ Ձ֨/࣌ (us- east-1) p2.xlarge 1 4 61 2,496 12 ߴ $0.9 p2.8xlarge 8 32 488 19,968 96 10G $7.2 p2.16xlarge 16 64 732 39,936 192 20G $14.4
%F/"Ͱͷ(16ར༻ 21 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
VTͰQΠϯελϯε L Λ͏ • ֶशͤ͞Δ͚࣌ͩىಈ͠ɺ͋ͱࢭΊΔ • ϋΠύʔύϥϝʔλνϡʔχϯάͳͲͰͨ ͘͞Μฒ࣮ͯߦ͢ΔͷʹΫϥυڥ ༗ར‷ ŋŷŋ و ̑̑ ५ͳGPU
($1ͷ(16 22 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. GCPͷGPU
https://cloud.google.com/gpu/
($1ͷ(16 23 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΞϧϑΝ • ਃ͢ΕL QΠ ϯελϯεͱಉ͡ ͕ ͑Δ • ͦΕҎ֎·ͩμϝͩͬ ͨ ɾТɾʆ • L͕௨ৗΠϯελϯ εʹΞλον͞Εͨܗ GCPͷGPU
($1ͷ(16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ௨ৗΠϯελϯεۚʹΞλον͚ͩϓϥε GCPΠϯελϯεͷ՝͕ۚ୯Ґ(ͨͩ͠ɺ
࠷Ͱ10औΒΕΔ) GCPͷGPU GPU ݸ ฒྻί Ξ GPUϝ ϞϦ (GB) FP32 (TFLOP S) Ձ֨/࣌ (us) Ϧʔδϣ ϯ Tesla K80x1 1 2,496 12 4.3 $0.7 ౦ژҎ֎ Tesla P100x1 1 3,584 16 10.6 ෆ໌ N/A AMD FirePro S9300 x2 1 8 13.9 ෆ໌ N/A
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 25 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾ ִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ִ͞Εͨڥ 26 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
%F/"ͷ"*Ҋ݅ • ൿಗҊ݅ • ڠۀҊ݅ • ඇؔ༩ࣾһ͕σʔλʹΞΫηεͰ͖ͳ͍Α͏ʹִ ͞ΕͨηΩϡΞͳڥΛ࡞Δඞཁ͕͋Δ • ͨͩ͠ɺڠۀձࣾͷؔ༩ࣾһΞΫηεͰ͖Δ ΫϥυΞΧϯτΛ͚ͯ ผݸͷڥͱִͯ͠ ִ͞Εͨڥ
ωοτϫʔΫߏ 27 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Subnet
service components step DeNA PC Gateway ghe, etc Security Group ssh Security Group ִ͞Εͨڥ • ΦϯϓϨ(BUFXBZ ͔ΒͷΈ౿Έαʔ όʹTTIՄೳ • (BUFXBZͰάϧʔ ϓݖݶཧ • ίʔυHJUIVCF ʹઐ༻PSHΛ࡞ͬ ͯQSJWBUFӡ༻
ࠪϩά 28 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ίϚϯυ࣮ߦϩά • %F/"ͷ(BUFXBZʹ͋ΔΩʔϩΨʔ • Ϋϥυͷૢ࡞ϩά • "84$MPVE5SBJM • ($14UBDL%SJWFS ִ͞Εͨڥ
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 29 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾ ૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ૉૣ͍ߏங 30 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ̍ϲ݄ʹ̑ϓϩδΣΫτ ݄ • ઐ͡Όͳ͍ͷͰɺखؒͳ͘ૉૣ͘ ૉૣ͍ߏங
ࣗಈԽίʔυԽ 31 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
5FSSBGPSNͰΦʔέετϨʔγϣϯͷ ࣗಈԽˍίʔυԽ • "84 ($1྆ํʹରԠ • *UBNBFͰϓϩϏδϣχϯά • ࡞ͷLPOEBUFϥούʔ ૉૣ͍ߏங
ػցֶशڥͷ ϓϩϏδϣχϯά 32 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• VCVOUV$IBJOFSΦεεϝ • OWJEJBESJWFS • DVEBOWJEJBͷDVEBBQUSFQP͔ΒೖΕΔͱOWJEJBESJWFSೖָͬͯ • DVEOOOWJEJBͷNBDIJOFMFBSOJOHBQUSFQP͔ΒೖΕΔͱָ • QZUIPO • DIBJOFS ૉૣ͍ߏங
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 33 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾ ӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ӡ༻ָ͕ 34 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ͲΜͲΜڥ͕૿͑Δ • ઐ͡Όͳ͍ͷͰɺָʹ͠ͳ͍ͱ݉ۀͷ ΞϓϦ։ൃۀ͕Ͱ͖ͳ͍ ӡ༻ָ͕
35 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
ΫϥυͷػೳΛ͏ 36 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Ͱ͖Δ͚ͩΫϥυͷػೳΛ͏ • ࢹπʔϧ • "84$MPVE8BUDI • ($14UBDL%SJWFS • .Z42- "843%4 ($1$MPVE42- • 3FEJT "84&MBTUJDBDIF ͳͲͳͲ ӡ༻ָ͕
ར༻தͷ"84αʔϏε 37 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
&$ • 71$ •  • 3PVUF • 4 • "VSPSBPS3%4 .Z42- • &MBTUJ$BDIF 3FEJT • &MBTUJD-PBE#BMBODJOH • $MPVE'SPOU • &MBTUJD'JMF4ZTUFN /'4 • 4/4 • 4&4 4.51 • &.3 )BEPPQ 4QBSL • $MPVE8BUDI • $MPVE5SBJM ӡ༻ָ͕
ར༻தͷ($1αʔϏε 38 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(PPHMF$PNQVUF&OHJOF ($& • (PPHMF"QQ&OHJOF • (PPHMF-PBE#BMBODJOH • (PPHMF$MPVE$%/ • (PPHMF$MPVE%/4 • (PPHMF$MPVE42- • 4UBDLESJWFS.POJUPSJOH • (PPHMF$MPVE4UPSBHF • (PPHMF#JH2VFSZ • (PPHMF$MPVE%BUBQSPD ӡ༻ָ͕
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 39 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾ ࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ࣗ༝Λߴ͘ 40 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
γε ΤϯδχΞ ʹ̎ύλʔϯ Πϯϑϥ͍͡Γ͍ͨ Πϯϑϥ͓ͤ͠·͢ • ͍͡Γ͍ͨͳΒੋඇͬͯ͘Εʂ ࣗ༝Λߴ͘
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 41 https://suzuri.jp/mizzy/76284/t-shirt/m/navy
͍ͬͯ͡ྑ͍ 42 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Πϯελϯεͷ্ཱͪ͛ࣗ༝ • ΫϥυαʔϏεͷઃఆ • 5FSSBGPSNʹ13 • ϓϩϏδϣχϯά • ج൫ͱผͷπʔϧͰίʔυԽ0, • खಈηοτΞοϓͯ͠ΠϝʔδʹݻΊ ͯ0, ࣗ༝Λߴ͘
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 43 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾ ϛε͕͓͖ʹ͍͘
ϛε͕͓͖ʹ͍͘ 44 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ࣗ༝Λߴ͘͢Δͱࠓϛε͕͓͖Δ • ͨͱ͑ɺΠϯελϯε࡞ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • λάΛ͚Δ • 3PVUFʹϗετ໊ొ • ࢹೖ ࣗ࡞πʔϧͰ୲อ ϛε͕͓͖ʹ͍͘
FDDSFBUFJOTUBODFT HDFDSFBUFJOTUBODFT 45 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ΠϯελϯεΛ࡞ • 3PMFTλάΛ͚Δ • దͳΠϝʔδΛબ ࣍ʔδ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • 3PVUFʹϗετ໊ొ • ($1ͷ߹ඪ४Ͱ%/4ొ͞ΕΔͷͰෆཁ • ࢹೖ $ ec2-create-instances -n host --role chainer:dev ϛε͕͓͖ʹ͍͘
FDDSFBUFBNJ HDFDSFBUFTOBQTIPU 46 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ࢦఆͨ͠ϗετΛΠϝʔδԽ • Πϝʔδʹϗετͱಉ͡ϩʔϧΛ͚Δ • ࣍ճFDDSFBUFJOTUBODFT͢Δࡍʹɺ ಉ͡ϩʔϧͷ".*ͷ͏ͪɺ࠷৽ͷͷ͔ΒΠ ϯελϯεΛཱͪ͋͛Δ $ ec2-create-ami -n host ϛε͕͓͖ʹ͍͘
FDMJTUBNJ HDFMJTUTOBQTIPUT 47 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. • ࢦఆͨ͠ϩʔϧͷ͍ͭͨ".*ͷ͏ͪɺ࠷৽ͷ ͷΛදࣔ͢Δ • FDDSFBUFJOTUBODFT෦తʹ͜Ε Λ ϥΠϒϥϦͱͯ͠ ར༻ͯ͠ɺదͳ".* Λબ͢Δ $ ec2-list-ami --role chainer:dev ami-XXXXXXXX 2017-02-04T03:53:10+09:00 chainer:dev ϛε͕͓͖ʹ͍͘
FDIPTU HDFIPTU 48 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• &$Πϯελϯεʹ 3PMFTλάΛ͚ͯɺϩʔ ϧͰཧɺݕࡧ • ($&ͷ߹ NFUBEBUBΛར༻ • *UBNBFͷϩʔϧࢦఆ࣌ ʹར༻ $ ec2-host --role chainer:dev asaa5002 ϛε͕͓͖ʹ͍͘
࣍ 49 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾػցֶशج൫ʹٻΊΒΕΔ
ͨ ͷ ɾ(16αʔόͷΦϯσϚϯυΦʔτεέʔϧ ɾ"1*αʔό αʔϏεఏڙڥ ɾ'VUVSF8PSL ɾ͓·͚"84ͱ($1ͷൺֱ
(16αʔόͷ ΦϯσϚϯυΦʔτεέʔϧ 50 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ฒྻͰֶशΛΒ͍ͤͨ • (16ΠϯελϯεΛඞཁͳ͚ͩࣗಈ Ͱ্ཱͪ͛ͯཉ͍͠ • ֶश͕ऴΘͬͨΒࣗಈͰམͱͯ͠΄͍͠ • མͱ͠Ε͕ͪʼʻ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
... Chainer Cluster create ssh terminate ... XXX Cluster FDTDBMFSVO
51 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • ֶशͤ͞Δͱ͖ʹΠϯελϯεΛ ্ཱͪ͛ͯίϚϯυ࣮ߦ • ͢Ͱʹ্ཱ͕͍ͪͬͯͯΘΕͯ ͍ͳ͍Πϯελϯε͕͍Εੵۃ తʹར༻͢Δ • "84̍࣌ؒ՝ۚͳͷͰ͙͢ʹ ࡴ͞ͳ͍ • ىಈ࣌ؒNJONJO ͰΘΕ͍ͯͳ͍Πϯελϯε͕ ͍Εམͱ͢ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ $ ec2-scale-run -c config.yml [<‘Some shell code'> | <filename [args ...]>
52 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. མͱ͠Εͳ͠ ‷
ŋŷŋ و ̑̑
%PDLFSରԠ 53 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. TDBMFSVOͷதͰOWJEJBEPDLFSSVO
ྫ $IBJOFS5FOTPS'MPXίϯςφ "84($1Ͱखݩͱಉ͡ίϯςφΛ͑ͯศར 2&$4Θͳ͍ͷʁ "ࠓͷͱ͜Ζͬͯ·ͤΜ ཧ༝(16Λ͑ΔΑ͏ʹ͢Δઃఆ͕ ৭ʑΊΜͲ͏ͩͬͨ ཧ༝(,&ͱͷΠϯλʔϑΣʔεҧ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. https://suzuri.jp/chiastolite/90304/t-shirt/s/royalblue GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
ิOWJEJBEPDLFS 55 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
EPDLFSDMJͷബ͍ϥούʔ • %PDLFSίϯςφ͔Βϗετͷ(16 Λ͏ͱ͖ʹศར • OWJEJBEPDLFSQMVHJO͔Β ใΛಘͯɺEPDLFSίϚϯυʹΦ ϓγϣϯΛ৭ʑͯ͠ྑ͍͕໘ $ nvidia-docker run nvidia/cuda nvidia-smi GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
/'4Ϛϯτ 56 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεΛ্ཱͪ͛ ͯམͱ͢ͷͰɺ • ڞ༗ετϨʔδ͕ඞཁ • ֶशݩσʔλ • தؒεφοϓγϣοτ NFS • "NB[PO&'4ΛϚϯτ • ༰ྔࣗಈ֦ு • ஈ͓ߴΊ (#݄ • ౦ژϦʔδϣϯͰ͑ͳ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
εϙοτΠϯελϯεͷ׆༻ 57 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ೖࡳՁ֨ࢢ εϙοτ Ձ֨ͳΒɺࢢՁ֨ ͰΠϯελϯε্ཱ͕͕ͪΔ • ࢢՁ͕͕֨͋ͬͨΒɺՁ͕֨มΘΔ • ࢢՁ֨ೖࡳՁ֨ʹٯసͨ͠ΒɺΠϯελϯ ε͕མͱ͞ΕΔ εϙοτΠϯελϯε <࣮> QYMBSHFIˠI 0'' GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
58 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "1*αʔό αʔϏεఏڙڥ
"1*αʔό 59 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶश̎ͭͷϑΣʔζ • ֶशϑΣʔζ • ༧ଌϑΣʔζ • ֶशϑΣʔζ։ൃڥͰ (16ར༻ • ༧ଌϑΣʔζϓϩμΫγϣϯ $16ར༻ • )551"1*ͱͯͯ͠͠αʔϏεʹఏڙ APIαʔό
࣮ྫ 60 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Elastic
Load Balancing ... API Server (Blue) ... API Server (Green) • $IBJOFSͷ༧ଌϑΣʔ ζΛ͏ͷͰ1ZUIPO ΞϓϦέʔγϣϯ • %KBOHP • ϩʔΧϧ+VCBUVT • #MVF(SFFO %FQMPZNFOU APIαʔό ap-northeast-1 (cpu)
61 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 'VUVSF8PSL
'VUVSF8PSL 62 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"1*αʔόΛ("& (PPMHF"QQ&OHJOF Ͱӡ༻ָ͍ͯͨ͠͠ • ("&QZUIPO • 4UBOEBSE&OWJSPONFOU੍͕ݫ͠ ͗͢ΔͷͰ'MFYJCMF&OWJSPONFOU͔ • શࣗಈϋΠύʔύϥϝʔλνϡʔχϯά͞Μ Future Work
'VUVSF8PSL 63 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ཧ(16Ϛγϯཉ͍͠ ɾТɾʆ • τϥΠΞϯυΤϥʔͳ։ൃ༻్ • खݩͰ։ൃ͍ͨ͠ • େྔʹฒྻͰֶश͍ͤͨ͞߹Ϋϥυ • ࠷Ͱ̍ਓ̍ߪೖ༧ఆ‷ ŋŷŋ و ̑̑ Future Work
64 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͓·͚
65 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "84ͱ($1 ͷൺֱ
Πϯελϯεྉۚ 66 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(16Πϯελϯεͷஈ͋·ΓมΘΒͳ͍ • ($&Πϯελϯεͷ՝ۚ̍͝ͱ • ͨͩ͠ɺ࠷ͰऔΒΕΔ • ($&Πϯελϯε͕̍ϲ݄࣮ؒߦ͞ΕΔ ͱɺྉ͕ۚࣗಈͰׂΓҾ͔ΕΔ • &$ͷϦβʔϒυΠϯελϯεͱҧ͍ɺ৽͍͠Π ϯελϯελΠϓ͕ग़ͨ࣌ʹҾͬӽ͍͢͠ҹ AWSͱGCPͷൺֱ
($1ͷϩʔυόϥϯα͕ڧ͍ 67 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΥʔϜΞοϓෆཁ • ࣄલεέʔϧΞτਃෆཁ • ϚϧνϦʔδϣϯରԠ • ̍άϩʔόϧ*1 *1ΤχʔΩϟετ AWSͱGCPͷൺֱ
($1ͷωοτϫʔΫઃఆ͕ॊೈ 68 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεʹλάΛ͚ͯɺλάͰϧʔ ςΟϯάઃఆՄೳ • "84ͷ߹TVCOFUͰϧʔςΟϯάઃఆ AWSͱGCPͷൺֱ
"84ͷ΄͏͕αʔϏεॆ࣮ 69 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
($1ʹ"84&MBTUJ$BDIF 3FEJT .FNDBDIFE ૬͕ͳ͍ • &'4 /'4 ૬͕ͳ͍ • 4.51αʔϏε͕ͳ͍ • SEQBSUZͱఏܞ • Γͳ͍ͱ͜Ζ͕ͪ´ • 4UBDL%SJWFSʹࢹొ"1*͕·ͩͳ͍ AWSͱGCPͷൺֱ
·ͱΊ 70 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL ("& શࣗಈύϥϝʔλνϡʔχϯά ˠͦΕΫϥυͰ
4QFDJBM5IBOLT ॱෆಉ 71 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• OIBZBTIJ • LB[VLJGVKJLBXB • GVLVEBNB 1'/ • DJWJUBTQP • NB[HJ