Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Search
Naotoshi Seo
February 17, 2017
Technology
4
6.1k
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Naotoshi Seo
February 17, 2017
Tweet
Share
More Decks by Naotoshi Seo
See All by Naotoshi Seo
ZOZOTOWNリプレイス2020
sonots
5
35k
Red Chainer and Cumo: Practical Deep Learning in Ruby at RubyKaigi 2019
sonots
1
4.3k
Introduction of Cumo, and Integration to Red Chainer
sonots
1
1.1k
Implementation of Cumo, a CUDA-aware version of Ruby/Numo
sonots
1
1.9k
Fast Numerical Computing and Deep Learning in Ruby with Cumo
sonots
0
9.2k
CuPy improvments around memory
sonots
3
1.6k
Triglav - Data Driven Workflow Tool
sonots
1
4.1k
DeNA流データエンジニアリングの極意
sonots
17
13k
BigQuery Schema Migration #bq_sushi
sonots
2
6.1k
Other Decks in Technology
See All in Technology
30分でわかる『アジャイルデータモデリング』
hanon52_
9
2.3k
オブザーバビリティの観点でみるAWS / AWS from observability perspective
ymotongpoo
8
1.2k
5分で紹介する生成AIエージェントとAmazon Bedrock Agents / 5-minutes introduction to generative AI agents and Amazon Bedrock Agents
hideakiaoyagi
0
230
N=1から解き明かすAWS ソリューションアーキテクトの魅力
kiiwami
0
100
Googleマップ/Earthが一般化した 地図タイルのイマ
mapconcierge4agu
1
200
RSNA2024振り返り
nanachi
0
520
2024.02.19 W&B AIエージェントLT会 / AIエージェントが業務を代行するための計画と実行 / Algomatic 宮脇
smiyawaki0820
3
310
バックエンドエンジニアのためのフロントエンド入門 #devsumiC
panda_program
16
6.7k
20250208_OpenAIDeepResearchがやばいという話
doradora09
PRO
0
170
株式会社EventHub・エンジニア採用資料
eventhub
0
4.2k
ビジネスモデリング道場 目的と背景
masuda220
PRO
6
140
CZII - CryoET Object Identification 参加振り返り・解法共有
tattaka
0
260
Featured
See All Featured
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
How STYLIGHT went responsive
nonsquared
98
5.3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
27
1.9k
Measuring & Analyzing Core Web Vitals
bluesmoon
6
240
Bash Introduction
62gerente
610
210k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
The Pragmatic Product Professional
lauravandoore
32
6.4k
Optimizing for Happiness
mojombo
376
70k
Being A Developer After 40
akosma
89
590k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
3
310
How to Think Like a Performance Engineer
csswizardry
22
1.3k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
Transcript
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNA AIγεςϜ෦ʹ͓ ͚ΔΫϥυΛ׆༻ͨ͠
ػցֶशج൫ͷߏங #denatechcon 2017 1 Feb 10, 2017 Naotoshi Seo AI System Division DeNA Co., Ltd.
ࣗݾհ 2 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾඌར!TPOPUT
ɾ"*γεςϜ෦ چੳج൫෦ ɾ"OBMZUJDT5PPMTνʔϜ $MPVE*OGSBνʔϜ ϦʔυΤϯδχΞ ݉ ɾ'MVFOUE3VCZίϛολ
ରऀ 3 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨΠϯϑϥ୲ऀ • ΠϯϑϥΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨػցֶशΤϯδχΞ
࣍ 4 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL • ͓·͚"84ͱ($1ͷൺֱ
5 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
6 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͷલʹ
7 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. (16ͷجૅࣝ GPUͷجૅࣝ
8 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • σΟʔϓϥʔχϯά
• (16Λͬͨ΄͏͕͍ • ྫ $16ͩͱˠ(16ͩͱ ͳͥ(16͕ඞཁ͔ GPUͷجૅࣝ
(16ͷಛ 9 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ฒྻॲཧ͕ಘҙ • $16ͩͱίΞͳͲͷΦʔμʔ • (16ͩͱ d ίΞ • ذॲཧۤख • ذ༧ଌɾΞτΦϒΦʔμʔͷ ػೳΛ؆ૉԽ͢Δ͜ͱͰίΞΛ ૿͍ͯ͠Δ • ߦྻԋࢉʹ͍͍ͯΔ GPUͷجૅࣝ
(16 10 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
/7*%*"5FTMB • /7*%*"ͷ)1$͚(16γϦʔζ • /7*%*"(F'PSDF(3*% • Ϋϥυήʔϛϯά͚ • ".%'JSF1SP • ".%ͷ)1$͚γϦʔζ GPUͷجૅࣝ
/7*%*"5FTMB 11 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ੈ • 'FSNJ,FQMFS • .BYXFMM1BTDBM • ྫ LˠLFQMFS • "1* • $6%" /7*%*"ಠࣗ • 0QFO$- • %JSFDU$PNQVUF GPUͷجૅࣝ http://pc.watch.impress.co.jp/img/pcw/docs/755/994/html/Visio- NvidiaGPUComparisonGFLOPSvsMemorybandwidth.png.html
$6%"ͷΞʔΩςΫνϟ 12 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ϗετ $16 ͔ΒσόΠ ε (16 ʹσʔλΛసૹ • (16Ͱॲཧ • ݁ՌΛσόΠε (16 ͔ Βϗετʹసૹ $16 GPUͷجૅࣝ http://www.nvidia.co.jp/docs/IO/51174/ NVIDIA_CUDA_Programming_Guide_1.1_JPN.pdf
13 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNAͷΦϯϓϨGPUڥ (2017/02ݱࡏ) 14
CPUɿXeon E5-2630 v3 2.4GHz *2 GPUɿNVIDIA Tesla M40 *2 Memɿ64GB NICɿ10Gb ίΞ MHz GPUϝϞϦ ൃද M40 3072 1114 12GB 2015/11 ५ͳGPU
15 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Γͳ͍ ɾТɾʆ
५ͳGPU
"*Ҋ݅ʹ͓͚Δ(16ར༻ 16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
͋Ε͋Δ͚͍͍ͩͨ • ύϥϝʔλΛগ͠ม͑ͯฒྻͰֶशͤ͞ ͯɺྑ͍ํΛબͿ • ֶश͢Δ࣌ʹ͚ͩ͏ • ऴΘͬͨΒഇغͯ͠ߏΘͳ͍ ५ͳGPU
17 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳGPU DHΠϯελϯε HΠϯελϯε
QΠϯελϯε چੈ AWSͷGPU
HΠϯελϯε 19 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA GRID K520 1536 * 2 800 2013/5 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞϦ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωο τϫ ʔΫ Ձ֨/࣌ (us- east-1) g2.2xlarge 1 8 15 1,536 4 $0.65 g2.8xlarge 4 32 60 6,144 32 $2.6
QΠϯελϯε Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ౦ژϦʔδϣϯͰ(·ͩ)͑ͳ͍ AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA Tesla K80 2496 * 2 875 2014/11 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞ Ϧ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωοτ ϫʔΫ Ձ֨/࣌ (us- east-1) p2.xlarge 1 4 61 2,496 12 ߴ $0.9 p2.8xlarge 8 32 488 19,968 96 10G $7.2 p2.16xlarge 16 64 732 39,936 192 20G $14.4
%F/"Ͱͷ(16ར༻ 21 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
VTͰQΠϯελϯε L Λ͏ • ֶशͤ͞Δ͚࣌ͩىಈ͠ɺ͋ͱࢭΊΔ • ϋΠύʔύϥϝʔλνϡʔχϯάͳͲͰͨ ͘͞Μฒ࣮ͯߦ͢ΔͷʹΫϥυڥ ༗ར‷ ŋŷŋ و ̑̑ ५ͳGPU
($1ͷ(16 22 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. GCPͷGPU
https://cloud.google.com/gpu/
($1ͷ(16 23 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΞϧϑΝ • ਃ͢ΕL QΠ ϯελϯεͱಉ͡ ͕ ͑Δ • ͦΕҎ֎·ͩμϝͩͬ ͨ ɾТɾʆ • L͕௨ৗΠϯελϯ εʹΞλον͞Εͨܗ GCPͷGPU
($1ͷ(16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ௨ৗΠϯελϯεۚʹΞλον͚ͩϓϥε GCPΠϯελϯεͷ՝͕ۚ୯Ґ(ͨͩ͠ɺ
࠷Ͱ10औΒΕΔ) GCPͷGPU GPU ݸ ฒྻί Ξ GPUϝ ϞϦ (GB) FP32 (TFLOP S) Ձ֨/࣌ (us) Ϧʔδϣ ϯ Tesla K80x1 1 2,496 12 4.3 $0.7 ౦ژҎ֎ Tesla P100x1 1 3,584 16 10.6 ෆ໌ N/A AMD FirePro S9300 x2 1 8 13.9 ෆ໌ N/A
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 25 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾ ִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ִ͞Εͨڥ 26 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
%F/"ͷ"*Ҋ݅ • ൿಗҊ݅ • ڠۀҊ݅ • ඇؔ༩ࣾһ͕σʔλʹΞΫηεͰ͖ͳ͍Α͏ʹִ ͞ΕͨηΩϡΞͳڥΛ࡞Δඞཁ͕͋Δ • ͨͩ͠ɺڠۀձࣾͷؔ༩ࣾһΞΫηεͰ͖Δ ΫϥυΞΧϯτΛ͚ͯ ผݸͷڥͱִͯ͠ ִ͞Εͨڥ
ωοτϫʔΫߏ 27 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Subnet
service components step DeNA PC Gateway ghe, etc Security Group ssh Security Group ִ͞Εͨڥ • ΦϯϓϨ(BUFXBZ ͔ΒͷΈ౿Έαʔ όʹTTIՄೳ • (BUFXBZͰάϧʔ ϓݖݶཧ • ίʔυHJUIVCF ʹઐ༻PSHΛ࡞ͬ ͯQSJWBUFӡ༻
ࠪϩά 28 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ίϚϯυ࣮ߦϩά • %F/"ͷ(BUFXBZʹ͋ΔΩʔϩΨʔ • Ϋϥυͷૢ࡞ϩά • "84$MPVE5SBJM • ($14UBDL%SJWFS ִ͞Εͨڥ
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 29 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾ ૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ૉૣ͍ߏங 30 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ̍ϲ݄ʹ̑ϓϩδΣΫτ ݄ • ઐ͡Όͳ͍ͷͰɺखؒͳ͘ૉૣ͘ ૉૣ͍ߏங
ࣗಈԽίʔυԽ 31 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
5FSSBGPSNͰΦʔέετϨʔγϣϯͷ ࣗಈԽˍίʔυԽ • "84 ($1྆ํʹରԠ • *UBNBFͰϓϩϏδϣχϯά • ࡞ͷLPOEBUFϥούʔ ૉૣ͍ߏங
ػցֶशڥͷ ϓϩϏδϣχϯά 32 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• VCVOUV$IBJOFSΦεεϝ • OWJEJBESJWFS • DVEBOWJEJBͷDVEBBQUSFQP͔ΒೖΕΔͱOWJEJBESJWFSೖָͬͯ • DVEOOOWJEJBͷNBDIJOFMFBSOJOHBQUSFQP͔ΒೖΕΔͱָ • QZUIPO • DIBJOFS ૉૣ͍ߏங
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 33 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾ ӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ӡ༻ָ͕ 34 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ͲΜͲΜڥ͕૿͑Δ • ઐ͡Όͳ͍ͷͰɺָʹ͠ͳ͍ͱ݉ۀͷ ΞϓϦ։ൃۀ͕Ͱ͖ͳ͍ ӡ༻ָ͕
35 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
ΫϥυͷػೳΛ͏ 36 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Ͱ͖Δ͚ͩΫϥυͷػೳΛ͏ • ࢹπʔϧ • "84$MPVE8BUDI • ($14UBDL%SJWFS • .Z42- "843%4 ($1$MPVE42- • 3FEJT "84&MBTUJDBDIF ͳͲͳͲ ӡ༻ָ͕
ར༻தͷ"84αʔϏε 37 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
&$ • 71$ •  • 3PVUF • 4 • "VSPSBPS3%4 .Z42- • &MBTUJ$BDIF 3FEJT • &MBTUJD-PBE#BMBODJOH • $MPVE'SPOU • &MBTUJD'JMF4ZTUFN /'4 • 4/4 • 4&4 4.51 • &.3 )BEPPQ 4QBSL • $MPVE8BUDI • $MPVE5SBJM ӡ༻ָ͕
ར༻தͷ($1αʔϏε 38 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(PPHMF$PNQVUF&OHJOF ($& • (PPHMF"QQ&OHJOF • (PPHMF-PBE#BMBODJOH • (PPHMF$MPVE$%/ • (PPHMF$MPVE%/4 • (PPHMF$MPVE42- • 4UBDLESJWFS.POJUPSJOH • (PPHMF$MPVE4UPSBHF • (PPHMF#JH2VFSZ • (PPHMF$MPVE%BUBQSPD ӡ༻ָ͕
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 39 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾ ࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ࣗ༝Λߴ͘ 40 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
γε ΤϯδχΞ ʹ̎ύλʔϯ Πϯϑϥ͍͡Γ͍ͨ Πϯϑϥ͓ͤ͠·͢ • ͍͡Γ͍ͨͳΒੋඇͬͯ͘Εʂ ࣗ༝Λߴ͘
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 41 https://suzuri.jp/mizzy/76284/t-shirt/m/navy
͍ͬͯ͡ྑ͍ 42 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Πϯελϯεͷ্ཱͪ͛ࣗ༝ • ΫϥυαʔϏεͷઃఆ • 5FSSBGPSNʹ13 • ϓϩϏδϣχϯά • ج൫ͱผͷπʔϧͰίʔυԽ0, • खಈηοτΞοϓͯ͠ΠϝʔδʹݻΊ ͯ0, ࣗ༝Λߴ͘
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 43 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾ ϛε͕͓͖ʹ͍͘
ϛε͕͓͖ʹ͍͘ 44 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ࣗ༝Λߴ͘͢Δͱࠓϛε͕͓͖Δ • ͨͱ͑ɺΠϯελϯε࡞ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • λάΛ͚Δ • 3PVUFʹϗετ໊ొ • ࢹೖ ࣗ࡞πʔϧͰ୲อ ϛε͕͓͖ʹ͍͘
FDDSFBUFJOTUBODFT HDFDSFBUFJOTUBODFT 45 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ΠϯελϯεΛ࡞ • 3PMFTλάΛ͚Δ • దͳΠϝʔδΛબ ࣍ʔδ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • 3PVUFʹϗετ໊ొ • ($1ͷ߹ඪ४Ͱ%/4ొ͞ΕΔͷͰෆཁ • ࢹೖ $ ec2-create-instances -n host --role chainer:dev ϛε͕͓͖ʹ͍͘
FDDSFBUFBNJ HDFDSFBUFTOBQTIPU 46 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ࢦఆͨ͠ϗετΛΠϝʔδԽ • Πϝʔδʹϗετͱಉ͡ϩʔϧΛ͚Δ • ࣍ճFDDSFBUFJOTUBODFT͢Δࡍʹɺ ಉ͡ϩʔϧͷ".*ͷ͏ͪɺ࠷৽ͷͷ͔ΒΠ ϯελϯεΛཱͪ͋͛Δ $ ec2-create-ami -n host ϛε͕͓͖ʹ͍͘
FDMJTUBNJ HDFMJTUTOBQTIPUT 47 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. • ࢦఆͨ͠ϩʔϧͷ͍ͭͨ".*ͷ͏ͪɺ࠷৽ͷ ͷΛදࣔ͢Δ • FDDSFBUFJOTUBODFT෦తʹ͜Ε Λ ϥΠϒϥϦͱͯ͠ ར༻ͯ͠ɺదͳ".* Λબ͢Δ $ ec2-list-ami --role chainer:dev ami-XXXXXXXX 2017-02-04T03:53:10+09:00 chainer:dev ϛε͕͓͖ʹ͍͘
FDIPTU HDFIPTU 48 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• &$Πϯελϯεʹ 3PMFTλάΛ͚ͯɺϩʔ ϧͰཧɺݕࡧ • ($&ͷ߹ NFUBEBUBΛར༻ • *UBNBFͷϩʔϧࢦఆ࣌ ʹར༻ $ ec2-host --role chainer:dev asaa5002 ϛε͕͓͖ʹ͍͘
࣍ 49 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾػցֶशج൫ʹٻΊΒΕΔ
ͨ ͷ ɾ(16αʔόͷΦϯσϚϯυΦʔτεέʔϧ ɾ"1*αʔό αʔϏεఏڙڥ ɾ'VUVSF8PSL ɾ͓·͚"84ͱ($1ͷൺֱ
(16αʔόͷ ΦϯσϚϯυΦʔτεέʔϧ 50 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ฒྻͰֶशΛΒ͍ͤͨ • (16ΠϯελϯεΛඞཁͳ͚ͩࣗಈ Ͱ্ཱͪ͛ͯཉ͍͠ • ֶश͕ऴΘͬͨΒࣗಈͰམͱͯ͠΄͍͠ • མͱ͠Ε͕ͪʼʻ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
... Chainer Cluster create ssh terminate ... XXX Cluster FDTDBMFSVO
51 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • ֶशͤ͞Δͱ͖ʹΠϯελϯεΛ ্ཱͪ͛ͯίϚϯυ࣮ߦ • ͢Ͱʹ্ཱ͕͍ͪͬͯͯΘΕͯ ͍ͳ͍Πϯελϯε͕͍Εੵۃ తʹར༻͢Δ • "84̍࣌ؒ՝ۚͳͷͰ͙͢ʹ ࡴ͞ͳ͍ • ىಈ࣌ؒNJONJO ͰΘΕ͍ͯͳ͍Πϯελϯε͕ ͍Εམͱ͢ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ $ ec2-scale-run -c config.yml [<‘Some shell code'> | <filename [args ...]>
52 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. མͱ͠Εͳ͠ ‷
ŋŷŋ و ̑̑
%PDLFSରԠ 53 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. TDBMFSVOͷதͰOWJEJBEPDLFSSVO
ྫ $IBJOFS5FOTPS'MPXίϯςφ "84($1Ͱखݩͱಉ͡ίϯςφΛ͑ͯศར 2&$4Θͳ͍ͷʁ "ࠓͷͱ͜Ζͬͯ·ͤΜ ཧ༝(16Λ͑ΔΑ͏ʹ͢Δઃఆ͕ ৭ʑΊΜͲ͏ͩͬͨ ཧ༝(,&ͱͷΠϯλʔϑΣʔεҧ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. https://suzuri.jp/chiastolite/90304/t-shirt/s/royalblue GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
ิOWJEJBEPDLFS 55 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
EPDLFSDMJͷബ͍ϥούʔ • %PDLFSίϯςφ͔Βϗετͷ(16 Λ͏ͱ͖ʹศར • OWJEJBEPDLFSQMVHJO͔Β ใΛಘͯɺEPDLFSίϚϯυʹΦ ϓγϣϯΛ৭ʑͯ͠ྑ͍͕໘ $ nvidia-docker run nvidia/cuda nvidia-smi GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
/'4Ϛϯτ 56 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεΛ্ཱͪ͛ ͯམͱ͢ͷͰɺ • ڞ༗ετϨʔδ͕ඞཁ • ֶशݩσʔλ • தؒεφοϓγϣοτ NFS • "NB[PO&'4ΛϚϯτ • ༰ྔࣗಈ֦ு • ஈ͓ߴΊ (#݄ • ౦ژϦʔδϣϯͰ͑ͳ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
εϙοτΠϯελϯεͷ׆༻ 57 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ೖࡳՁ֨ࢢ εϙοτ Ձ֨ͳΒɺࢢՁ֨ ͰΠϯελϯε্ཱ͕͕ͪΔ • ࢢՁ͕͕֨͋ͬͨΒɺՁ͕֨มΘΔ • ࢢՁ֨ೖࡳՁ֨ʹٯసͨ͠ΒɺΠϯελϯ ε͕མͱ͞ΕΔ εϙοτΠϯελϯε <࣮> QYMBSHFIˠI 0'' GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
58 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "1*αʔό αʔϏεఏڙڥ
"1*αʔό 59 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶश̎ͭͷϑΣʔζ • ֶशϑΣʔζ • ༧ଌϑΣʔζ • ֶशϑΣʔζ։ൃڥͰ (16ར༻ • ༧ଌϑΣʔζϓϩμΫγϣϯ $16ར༻ • )551"1*ͱͯͯ͠͠αʔϏεʹఏڙ APIαʔό
࣮ྫ 60 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Elastic
Load Balancing ... API Server (Blue) ... API Server (Green) • $IBJOFSͷ༧ଌϑΣʔ ζΛ͏ͷͰ1ZUIPO ΞϓϦέʔγϣϯ • %KBOHP • ϩʔΧϧ+VCBUVT • #MVF(SFFO %FQMPZNFOU APIαʔό ap-northeast-1 (cpu)
61 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 'VUVSF8PSL
'VUVSF8PSL 62 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"1*αʔόΛ("& (PPMHF"QQ&OHJOF Ͱӡ༻ָ͍ͯͨ͠͠ • ("&QZUIPO • 4UBOEBSE&OWJSPONFOU੍͕ݫ͠ ͗͢ΔͷͰ'MFYJCMF&OWJSPONFOU͔ • શࣗಈϋΠύʔύϥϝʔλνϡʔχϯά͞Μ Future Work
'VUVSF8PSL 63 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ཧ(16Ϛγϯཉ͍͠ ɾТɾʆ • τϥΠΞϯυΤϥʔͳ։ൃ༻్ • खݩͰ։ൃ͍ͨ͠ • େྔʹฒྻͰֶश͍ͤͨ͞߹Ϋϥυ • ࠷Ͱ̍ਓ̍ߪೖ༧ఆ‷ ŋŷŋ و ̑̑ Future Work
64 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͓·͚
65 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "84ͱ($1 ͷൺֱ
Πϯελϯεྉۚ 66 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(16Πϯελϯεͷஈ͋·ΓมΘΒͳ͍ • ($&Πϯελϯεͷ՝ۚ̍͝ͱ • ͨͩ͠ɺ࠷ͰऔΒΕΔ • ($&Πϯελϯε͕̍ϲ݄࣮ؒߦ͞ΕΔ ͱɺྉ͕ۚࣗಈͰׂΓҾ͔ΕΔ • &$ͷϦβʔϒυΠϯελϯεͱҧ͍ɺ৽͍͠Π ϯελϯελΠϓ͕ग़ͨ࣌ʹҾͬӽ͍͢͠ҹ AWSͱGCPͷൺֱ
($1ͷϩʔυόϥϯα͕ڧ͍ 67 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΥʔϜΞοϓෆཁ • ࣄલεέʔϧΞτਃෆཁ • ϚϧνϦʔδϣϯରԠ • ̍άϩʔόϧ*1 *1ΤχʔΩϟετ AWSͱGCPͷൺֱ
($1ͷωοτϫʔΫઃఆ͕ॊೈ 68 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεʹλάΛ͚ͯɺλάͰϧʔ ςΟϯάઃఆՄೳ • "84ͷ߹TVCOFUͰϧʔςΟϯάઃఆ AWSͱGCPͷൺֱ
"84ͷ΄͏͕αʔϏεॆ࣮ 69 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
($1ʹ"84&MBTUJ$BDIF 3FEJT .FNDBDIFE ૬͕ͳ͍ • &'4 /'4 ૬͕ͳ͍ • 4.51αʔϏε͕ͳ͍ • SEQBSUZͱఏܞ • Γͳ͍ͱ͜Ζ͕ͪ´ • 4UBDL%SJWFSʹࢹొ"1*͕·ͩͳ͍ AWSͱGCPͷൺֱ
·ͱΊ 70 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL ("& શࣗಈύϥϝʔλνϡʔχϯά ˠͦΕΫϥυͰ
4QFDJBM5IBOLT ॱෆಉ 71 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• OIBZBTIJ • LB[VLJGVKJLBXB • GVLVEBNB 1'/ • DJWJUBTQP • NB[HJ