Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Shiva 〜Nextremerをscale upする機械学習環境〜
Search
Chanmoro
December 14, 2017
Technology
0
180
Shiva 〜Nextremerをscale upする機械学習環境〜
Nextremer 社内で運用している機械学習環境 Shiva のご紹介
tag: Docker, Mesos, Marathon, Jupyter, ceph,
Chanmoro
December 14, 2017
Tweet
Share
More Decks by Chanmoro
See All by Chanmoro
LAPRAS クローラーの変遷
chanmoro
3
2.3k
クローラーをテストしよう!
chanmoro
2
1.8k
対話AI on Kubernetes
chanmoro
0
81
グラフ解析で社長の脳内さらす!
chanmoro
0
400
Other Decks in Technology
See All in Technology
GA technologiesでのAI-Readyの取り組み@DataOps Night
yuto16
0
230
Why React!?? Next.jsそしてReactを改めてイチから選ぶ
ypresto
9
3.6k
今日から始めるpprof / Pprof workshop for beginners
ymotongpoo
6
780
DEFCON CHV CTF 2025 Write-up
bata_24
0
190
stupid jj tricks
indirect
0
7.5k
AIが書いたコードをAIが検証する!自律的なモバイルアプリ開発の実現
henteko
1
230
業務自動化プラットフォーム Google Agentspace に入門してみる #devio2025
maroon1st
0
170
AI Agentと MCP Serverで実現する iOSアプリの 自動テスト作成の効率化
spiderplus_cb
0
280
いまさら聞けない ABテスト入門
skmr2348
0
170
What is BigQuery?
aizack_harks
0
120
今改めてServiceクラスについて考える 〜あるRails開発者の10年〜
joker1007
20
9k
Windows で省エネ
murachiakira
0
140
Featured
See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6.1k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Documentation Writing (for coders)
carmenintech
75
5k
Unsuck your backbone
ammeep
671
58k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
How To Stay Up To Date on Web Technology
chriscoyier
791
250k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
46
7.6k
Embracing the Ebb and Flow
colly
88
4.8k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
23
1.5k
Building an army of robots
kneath
306
46k
How to Ace a Technical Interview
jacobian
280
23k
How STYLIGHT went responsive
nonsquared
100
5.8k
Transcript
Copyright © Nextremer, inc. All Rights Reserved. 1 Shiva ʙNextremerΛScale
up͢Δػցֶशڥʙ 14th Dec 2017
Copyright © Nextremer, inc. All Rights Reserved. 2 ࣗݾհ ྆֯
ي(ΖͣΈ ͔͖ͣ) גࣜձࣾNextremer ϓϩάϥϚʔ ※ରγεςϜͷݚڀ։ൃΛ͍ͯ͠ΔاۀͰ͢ • ओʹ͍ͬͯΔ͜ͱ • αʔόʔαΠυ։ൃ • ͜͜࠷ۙ৮ٕͬͨज़ • Terraform, Ansible, Packer ← Infrasctucture as Codeʂ • Docker, Kubernetes, Apache Mesos ← ϙʔλϏϦςΟ͍͜͞͏ʂ • Python, Scala, javascript(ES6) ← ؔܕ͏·͔͚͘Δͱؾ͍͍࣋ͪʂ • Finagle, React.js ← ϚΠΫϩαʔϏε͍ͨ͠ʂϦΞΫςΟϒ͍ͨ͠ʂ
Copyright © Nextremer, inc. All Rights Reserved. 3 ࠓ͓͢͠Δ͜ͱ Nextremer
ͷػցֶशڥ Shiva ʹ͍͓ͭͯ͠͠·͢
Copyright © Nextremer, inc. All Rights Reserved. 4 ػցֶशڥ Shiva
1. ΦϑΟεʹ͋ΔGPUϚγϯʹ 2. WebͷμογϡϘʔυ͔Β 3. ઐ༻ͷJupyterΛ্ཱͪ͛ΒΕΔ
Copyright © Nextremer, inc. All Rights Reserved. 5 Shiva͕ղܾ͢Δ՝ ▪
GPUϚγϯΛ͍͍͚ͨͲɾɾɾ • Ϋϥυඅ༻Λؾʹͯ͠ؾܰʹ͑ͳ͍ • ओʹ༧ࢉ͖ͷPJҎ֎ɺτϨʔχϯάͱ͔ɺҋݚڀͱ͔ • GPUϚγϯΛෳϢʔβʔͰڞ༗͢ΔͷΓʹ͍͘ • ϥΠϒϥϦͷڝ߹ɺ୭͕ͬͯΔ͔Θ͔ΒΜ • GPUϚγϯ্Ͱͷڥߏங͕େมͩͬͨΓ • શһ͕ৄ͍͠Θ͚͡Όͳ͍
Copyright © Nextremer, inc. All Rights Reserved. 6 σϞ ※GIFΞχϝʔγϣϯͰ͢
Copyright © Nextremer, inc. All Rights Reserved. 7 Abstract ▪
ϢʔβʔຖͷDockerίϯςφ ▪ શ෦ೖΓڥ & sudoݖݶ ▪ ϗʔϜdirΛશϚγϯͰڞ༗
Copyright © Nextremer, inc. All Rights Reserved. 8 Architecture Overview
Copyright © Nextremer, inc. All Rights Reserved. 9 Architecture Overview
μογϡϘʔυ͔ΒAPIܦ༝Ͱૢ࡞ ɹɾϦιʔεར༻ঢ়گΛऔಘ ɹɾίϯςφͷىಈɾআ
Copyright © Nextremer, inc. All Rights Reserved. 10 Architecture Overview
શͰϗʔϜσΟϨΫτϦΛڞ༗ ɹɾࢄετϨʔδΛߏங ɹɾίϯςφىಈ࣌ʹϚϯτ
Copyright © Nextremer, inc. All Rights Reserved. 11 Architecture Overview
▪ ϢʔβʔͱϙʔτͷϚοϐϯά • http://host/user/kazuki.morozumi • Jupyter͕Ϧεϯ͢ΔϙʔτϥϯμϜ ▪ ίϯςφՔಇঢ়گΛެ։͢ΔAPI ▪ tmpnbΛΧελϚΠζ • https://github.com/jupyter/tmpnb
Copyright © Nextremer, inc. All Rights Reserved. 12 Infrastructure Overview
Copyright © Nextremer, inc. All Rights Reserved. 13 Infrastructure Overview
ίϯςφΦʔέετϨʔγϣϯʹ Mesos + MarathonΛར༻
Copyright © Nextremer, inc. All Rights Reserved. 14 Infrastructure Overview
▪ Mesos+MarathonΛબͨ͠ཧ༝ • ಛఆͷΞϓϦΛσʔϞϯͱͯ͠ಈ͔ͤΕे • αʔϏεσΟεΧόϦͱ͔͍Βͳ͍ • KubernetesΦʔόʔεϖοΫ͗͢Δ • ߏཁૉ͕ଟ͘ෳࡶͰߏஙɺϝϯςφϯε͕େม • ୯७ʹMesos+MarathonΛࢼͯ͠Έ͔ͨͬͨ • ߏங࣌ใ͕͔ͳΓগͳ͔ͬͨ
Copyright © Nextremer, inc. All Rights Reserved. 15 Infrastructure Overview
CPU Intel Core i7-6700K ϝϞϦ 32GB Disk SSD 500GB GPU GTX-1080 ×2ຕ GPUϚγϯεϖοΫ ݟͨେࣄʂ ɹ- ͱΓ͋͑ͣޫΒͤΔ ɹ- ΈΜͳʹݟ͑Δॴʹஔ͘
Copyright © Nextremer, inc. All Rights Reserved. 16 ӡ༻͍ͯͯ͠ىͬͨ͜ ▪
σΟεΫ্ݶ • ֶशσʔλඦGBΛΞοϓϩʔυͨ͠ΒσΟεΫ্ݶʹୡͯ͠ఀࢭ • ίϯςφଆ͔ΒsshfsͰࣗͷPCͷσΟεΫΛϚϯτͯ͠ճආͨ͠ ▪ ίϯςφ͕ͨ࣌͠ͷηʔϑςΟʔωοτ • ։ൃͨ͠ίʔυͷόάͰϗετͷCPUɾϝϞϦΛ৯͍௵͢ • ϏΪφʔͷϢʔβʔ͕͜ͷΑ͏ͳόάΛ࡞Γ͕ͪ • ରԠࡦίϯςφຖʹϦιʔε੍ݶΛ͚ͭΔ • ස͔ͭӨڹͳͷͰಛʹݱঢ়ରԠͤͣ
Copyright © Nextremer, inc. All Rights Reserved. 17 ৄࡉQiitaͷهࣄʂ
Copyright © Nextremer, inc. All Rights Reserved. 18 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ WBC؍ઓઐ༻
Line bot
Copyright © Nextremer, inc. All Rights Reserved. 19 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢
Copyright © Nextremer, inc. All Rights Reserved. 20 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ ▪
ฐࣾCEO ҪΛίϐʔͨ͠ରγεςϜ • 2017/10 ୈ8ճରγεςϜγϯϙδϜʹͯσϞൃද
Copyright © Nextremer, inc. All Rights Reserved. 21 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢