Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Shiva 〜Nextremerをscale upする機械学習環境〜
Search
Chanmoro
December 14, 2017
Technology
0
160
Shiva 〜Nextremerをscale upする機械学習環境〜
Nextremer 社内で運用している機械学習環境 Shiva のご紹介
tag: Docker, Mesos, Marathon, Jupyter, ceph,
Chanmoro
December 14, 2017
Tweet
Share
More Decks by Chanmoro
See All by Chanmoro
LAPRAS クローラーの変遷
chanmoro
3
2.1k
クローラーをテストしよう!
chanmoro
2
1.7k
対話AI on Kubernetes
chanmoro
0
73
グラフ解析で社長の脳内さらす!
chanmoro
0
270
Other Decks in Technology
See All in Technology
AWS CDKでデータリストアの運用、どのように設計する?~Aurora・EFSの実践事例を紹介~/aws-cdk-data-restore-aurora-efs
mhrtech
4
650
10分でわかるfreee エンジニア向け会社説明資料
freee
18
520k
APIテスト自動化の勘所
yokawasa
7
4.2k
2024-10-30-reInventStandby_StudyGroup_Intro
shinichirokawano
1
630
Amazon FSx for NetApp ONTAPを利用するにあたっての要件整理と設計のポイント
non97
1
160
LeSSに潜む「隠れWF病」とその処方箋
lycorptech_jp
PRO
2
120
日経電子版におけるリアルタイムレコメンドシステム開発の事例紹介/nikkei-realtime-recommender-system
yng87
1
510
Autify Company Deck
autifyhq
1
39k
Shift-from-React-to-Vue
calm1205
3
1.3k
カメラを用いた店内計測におけるオプトインの仕組みの実現 / ai-optin-camera
cyberagentdevelopers
PRO
1
120
visionOSでの空間表現実装とImmersive Video表示について / ai-immersive-visionos
cyberagentdevelopers
PRO
1
110
ガバメントクラウド先行事業中間報告を読み解く
sugiim
1
1.4k
Featured
See All Featured
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
41
2.1k
Designing for humans not robots
tammielis
249
25k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
27
790
Intergalactic Javascript Robots from Outer Space
tanoku
268
27k
How GitHub (no longer) Works
holman
311
140k
Code Review Best Practice
trishagee
64
17k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
664
120k
Producing Creativity
orderedlist
PRO
341
39k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
92
16k
For a Future-Friendly Web
brad_frost
175
9.4k
Typedesign – Prime Four
hannesfritz
39
2.4k
Being A Developer After 40
akosma
86
590k
Transcript
Copyright © Nextremer, inc. All Rights Reserved. 1 Shiva ʙNextremerΛScale
up͢Δػցֶशڥʙ 14th Dec 2017
Copyright © Nextremer, inc. All Rights Reserved. 2 ࣗݾհ ྆֯
ي(ΖͣΈ ͔͖ͣ) גࣜձࣾNextremer ϓϩάϥϚʔ ※ରγεςϜͷݚڀ։ൃΛ͍ͯ͠ΔاۀͰ͢ • ओʹ͍ͬͯΔ͜ͱ • αʔόʔαΠυ։ൃ • ͜͜࠷ۙ৮ٕͬͨज़ • Terraform, Ansible, Packer ← Infrasctucture as Codeʂ • Docker, Kubernetes, Apache Mesos ← ϙʔλϏϦςΟ͍͜͞͏ʂ • Python, Scala, javascript(ES6) ← ؔܕ͏·͔͚͘Δͱؾ͍͍࣋ͪʂ • Finagle, React.js ← ϚΠΫϩαʔϏε͍ͨ͠ʂϦΞΫςΟϒ͍ͨ͠ʂ
Copyright © Nextremer, inc. All Rights Reserved. 3 ࠓ͓͢͠Δ͜ͱ Nextremer
ͷػցֶशڥ Shiva ʹ͍͓ͭͯ͠͠·͢
Copyright © Nextremer, inc. All Rights Reserved. 4 ػցֶशڥ Shiva
1. ΦϑΟεʹ͋ΔGPUϚγϯʹ 2. WebͷμογϡϘʔυ͔Β 3. ઐ༻ͷJupyterΛ্ཱͪ͛ΒΕΔ
Copyright © Nextremer, inc. All Rights Reserved. 5 Shiva͕ղܾ͢Δ՝ ▪
GPUϚγϯΛ͍͍͚ͨͲɾɾɾ • Ϋϥυඅ༻Λؾʹͯ͠ؾܰʹ͑ͳ͍ • ओʹ༧ࢉ͖ͷPJҎ֎ɺτϨʔχϯάͱ͔ɺҋݚڀͱ͔ • GPUϚγϯΛෳϢʔβʔͰڞ༗͢ΔͷΓʹ͍͘ • ϥΠϒϥϦͷڝ߹ɺ୭͕ͬͯΔ͔Θ͔ΒΜ • GPUϚγϯ্Ͱͷڥߏங͕େมͩͬͨΓ • શһ͕ৄ͍͠Θ͚͡Όͳ͍
Copyright © Nextremer, inc. All Rights Reserved. 6 σϞ ※GIFΞχϝʔγϣϯͰ͢
Copyright © Nextremer, inc. All Rights Reserved. 7 Abstract ▪
ϢʔβʔຖͷDockerίϯςφ ▪ શ෦ೖΓڥ & sudoݖݶ ▪ ϗʔϜdirΛશϚγϯͰڞ༗
Copyright © Nextremer, inc. All Rights Reserved. 8 Architecture Overview
Copyright © Nextremer, inc. All Rights Reserved. 9 Architecture Overview
μογϡϘʔυ͔ΒAPIܦ༝Ͱૢ࡞ ɹɾϦιʔεར༻ঢ়گΛऔಘ ɹɾίϯςφͷىಈɾআ
Copyright © Nextremer, inc. All Rights Reserved. 10 Architecture Overview
શͰϗʔϜσΟϨΫτϦΛڞ༗ ɹɾࢄετϨʔδΛߏங ɹɾίϯςφىಈ࣌ʹϚϯτ
Copyright © Nextremer, inc. All Rights Reserved. 11 Architecture Overview
▪ ϢʔβʔͱϙʔτͷϚοϐϯά • http://host/user/kazuki.morozumi • Jupyter͕Ϧεϯ͢ΔϙʔτϥϯμϜ ▪ ίϯςφՔಇঢ়گΛެ։͢ΔAPI ▪ tmpnbΛΧελϚΠζ • https://github.com/jupyter/tmpnb
Copyright © Nextremer, inc. All Rights Reserved. 12 Infrastructure Overview
Copyright © Nextremer, inc. All Rights Reserved. 13 Infrastructure Overview
ίϯςφΦʔέετϨʔγϣϯʹ Mesos + MarathonΛར༻
Copyright © Nextremer, inc. All Rights Reserved. 14 Infrastructure Overview
▪ Mesos+MarathonΛબͨ͠ཧ༝ • ಛఆͷΞϓϦΛσʔϞϯͱͯ͠ಈ͔ͤΕे • αʔϏεσΟεΧόϦͱ͔͍Βͳ͍ • KubernetesΦʔόʔεϖοΫ͗͢Δ • ߏཁૉ͕ଟ͘ෳࡶͰߏஙɺϝϯςφϯε͕େม • ୯७ʹMesos+MarathonΛࢼͯ͠Έ͔ͨͬͨ • ߏங࣌ใ͕͔ͳΓগͳ͔ͬͨ
Copyright © Nextremer, inc. All Rights Reserved. 15 Infrastructure Overview
CPU Intel Core i7-6700K ϝϞϦ 32GB Disk SSD 500GB GPU GTX-1080 ×2ຕ GPUϚγϯεϖοΫ ݟͨେࣄʂ ɹ- ͱΓ͋͑ͣޫΒͤΔ ɹ- ΈΜͳʹݟ͑Δॴʹஔ͘
Copyright © Nextremer, inc. All Rights Reserved. 16 ӡ༻͍ͯͯ͠ىͬͨ͜ ▪
σΟεΫ্ݶ • ֶशσʔλඦGBΛΞοϓϩʔυͨ͠ΒσΟεΫ্ݶʹୡͯ͠ఀࢭ • ίϯςφଆ͔ΒsshfsͰࣗͷPCͷσΟεΫΛϚϯτͯ͠ճආͨ͠ ▪ ίϯςφ͕ͨ࣌͠ͷηʔϑςΟʔωοτ • ։ൃͨ͠ίʔυͷόάͰϗετͷCPUɾϝϞϦΛ৯͍௵͢ • ϏΪφʔͷϢʔβʔ͕͜ͷΑ͏ͳόάΛ࡞Γ͕ͪ • ରԠࡦίϯςφຖʹϦιʔε੍ݶΛ͚ͭΔ • ස͔ͭӨڹͳͷͰಛʹݱঢ়ରԠͤͣ
Copyright © Nextremer, inc. All Rights Reserved. 17 ৄࡉQiitaͷهࣄʂ
Copyright © Nextremer, inc. All Rights Reserved. 18 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ WBC؍ઓઐ༻
Line bot
Copyright © Nextremer, inc. All Rights Reserved. 19 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢
Copyright © Nextremer, inc. All Rights Reserved. 20 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ ▪
ฐࣾCEO ҪΛίϐʔͨ͠ରγεςϜ • 2017/10 ୈ8ճରγεςϜγϯϙδϜʹͯσϞൃද
Copyright © Nextremer, inc. All Rights Reserved. 21 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢