Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Shiva 〜Nextremerをscale upする機械学習環境〜
Search
Chanmoro
December 14, 2017
Technology
0
180
Shiva 〜Nextremerをscale upする機械学習環境〜
Nextremer 社内で運用している機械学習環境 Shiva のご紹介
tag: Docker, Mesos, Marathon, Jupyter, ceph,
Chanmoro
December 14, 2017
Tweet
Share
More Decks by Chanmoro
See All by Chanmoro
LAPRAS クローラーの変遷
chanmoro
3
2.3k
クローラーをテストしよう!
chanmoro
2
1.8k
対話AI on Kubernetes
chanmoro
0
80
グラフ解析で社長の脳内さらす!
chanmoro
0
380
Other Decks in Technology
See All in Technology
Figma Dev Mode MCP Serverを用いたUI開発
zoothezoo
0
250
ロールが細分化された組織でSREは何をするか?
tgidgd
1
450
Building GoReleaser - from shell script to paid product
caarlos0
0
110
アクセスピークを制するオートスケール再設計: 障害を乗り越えKEDAで実現したリソース管理の最適化
myamashii
1
720
毎晩の 負荷試験自動実行による効果
recruitengineers
PRO
5
190
ゼロから始めるSREの事業貢献 - 生成AI時代のSRE成長戦略と実践 / Starting SRE from Day One
shinyorke
PRO
0
150
AIエージェントが書くのなら直接CloudFormationを書かせればいいじゃないですか何故AWS CDKを使う必要があるのさ
watany
19
7.7k
研究開発部メンバーの働き⽅ / Sansan R&D Profile
sansan33
PRO
3
18k
「現場で活躍するAIエージェント」を実現するチームと開発プロセス
tkikuchi1002
4
580
セキュアな社内Dify運用と外部連携の両立 ~AIによるAPIリスク評価~
zozotech
PRO
0
140
LLM拡張解体新書/llm-extension-deep-dive
oracle4engineer
PRO
24
6.8k
データ駆動経営の道しるべ:プロダクト開発指標の戦略的活用法
ham0215
2
150
Featured
See All Featured
Thoughts on Productivity
jonyablonski
69
4.7k
Being A Developer After 40
akosma
90
590k
Visualization
eitanlees
146
16k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
How to train your dragon (web standard)
notwaldorf
96
6.1k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
10
980
Designing for Performance
lara
610
69k
Intergalactic Javascript Robots from Outer Space
tanoku
271
27k
Into the Great Unknown - MozCon
thekraken
40
1.9k
How to Think Like a Performance Engineer
csswizardry
25
1.7k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
How to Ace a Technical Interview
jacobian
278
23k
Transcript
Copyright © Nextremer, inc. All Rights Reserved. 1 Shiva ʙNextremerΛScale
up͢Δػցֶशڥʙ 14th Dec 2017
Copyright © Nextremer, inc. All Rights Reserved. 2 ࣗݾհ ྆֯
ي(ΖͣΈ ͔͖ͣ) גࣜձࣾNextremer ϓϩάϥϚʔ ※ରγεςϜͷݚڀ։ൃΛ͍ͯ͠ΔاۀͰ͢ • ओʹ͍ͬͯΔ͜ͱ • αʔόʔαΠυ։ൃ • ͜͜࠷ۙ৮ٕͬͨज़ • Terraform, Ansible, Packer ← Infrasctucture as Codeʂ • Docker, Kubernetes, Apache Mesos ← ϙʔλϏϦςΟ͍͜͞͏ʂ • Python, Scala, javascript(ES6) ← ؔܕ͏·͔͚͘Δͱؾ͍͍࣋ͪʂ • Finagle, React.js ← ϚΠΫϩαʔϏε͍ͨ͠ʂϦΞΫςΟϒ͍ͨ͠ʂ
Copyright © Nextremer, inc. All Rights Reserved. 3 ࠓ͓͢͠Δ͜ͱ Nextremer
ͷػցֶशڥ Shiva ʹ͍͓ͭͯ͠͠·͢
Copyright © Nextremer, inc. All Rights Reserved. 4 ػցֶशڥ Shiva
1. ΦϑΟεʹ͋ΔGPUϚγϯʹ 2. WebͷμογϡϘʔυ͔Β 3. ઐ༻ͷJupyterΛ্ཱͪ͛ΒΕΔ
Copyright © Nextremer, inc. All Rights Reserved. 5 Shiva͕ղܾ͢Δ՝ ▪
GPUϚγϯΛ͍͍͚ͨͲɾɾɾ • Ϋϥυඅ༻Λؾʹͯ͠ؾܰʹ͑ͳ͍ • ओʹ༧ࢉ͖ͷPJҎ֎ɺτϨʔχϯάͱ͔ɺҋݚڀͱ͔ • GPUϚγϯΛෳϢʔβʔͰڞ༗͢ΔͷΓʹ͍͘ • ϥΠϒϥϦͷڝ߹ɺ୭͕ͬͯΔ͔Θ͔ΒΜ • GPUϚγϯ্Ͱͷڥߏங͕େมͩͬͨΓ • શһ͕ৄ͍͠Θ͚͡Όͳ͍
Copyright © Nextremer, inc. All Rights Reserved. 6 σϞ ※GIFΞχϝʔγϣϯͰ͢
Copyright © Nextremer, inc. All Rights Reserved. 7 Abstract ▪
ϢʔβʔຖͷDockerίϯςφ ▪ શ෦ೖΓڥ & sudoݖݶ ▪ ϗʔϜdirΛશϚγϯͰڞ༗
Copyright © Nextremer, inc. All Rights Reserved. 8 Architecture Overview
Copyright © Nextremer, inc. All Rights Reserved. 9 Architecture Overview
μογϡϘʔυ͔ΒAPIܦ༝Ͱૢ࡞ ɹɾϦιʔεར༻ঢ়گΛऔಘ ɹɾίϯςφͷىಈɾআ
Copyright © Nextremer, inc. All Rights Reserved. 10 Architecture Overview
શͰϗʔϜσΟϨΫτϦΛڞ༗ ɹɾࢄετϨʔδΛߏங ɹɾίϯςφىಈ࣌ʹϚϯτ
Copyright © Nextremer, inc. All Rights Reserved. 11 Architecture Overview
▪ ϢʔβʔͱϙʔτͷϚοϐϯά • http://host/user/kazuki.morozumi • Jupyter͕Ϧεϯ͢ΔϙʔτϥϯμϜ ▪ ίϯςφՔಇঢ়گΛެ։͢ΔAPI ▪ tmpnbΛΧελϚΠζ • https://github.com/jupyter/tmpnb
Copyright © Nextremer, inc. All Rights Reserved. 12 Infrastructure Overview
Copyright © Nextremer, inc. All Rights Reserved. 13 Infrastructure Overview
ίϯςφΦʔέετϨʔγϣϯʹ Mesos + MarathonΛར༻
Copyright © Nextremer, inc. All Rights Reserved. 14 Infrastructure Overview
▪ Mesos+MarathonΛબͨ͠ཧ༝ • ಛఆͷΞϓϦΛσʔϞϯͱͯ͠ಈ͔ͤΕे • αʔϏεσΟεΧόϦͱ͔͍Βͳ͍ • KubernetesΦʔόʔεϖοΫ͗͢Δ • ߏཁૉ͕ଟ͘ෳࡶͰߏஙɺϝϯςφϯε͕େม • ୯७ʹMesos+MarathonΛࢼͯ͠Έ͔ͨͬͨ • ߏங࣌ใ͕͔ͳΓগͳ͔ͬͨ
Copyright © Nextremer, inc. All Rights Reserved. 15 Infrastructure Overview
CPU Intel Core i7-6700K ϝϞϦ 32GB Disk SSD 500GB GPU GTX-1080 ×2ຕ GPUϚγϯεϖοΫ ݟͨେࣄʂ ɹ- ͱΓ͋͑ͣޫΒͤΔ ɹ- ΈΜͳʹݟ͑Δॴʹஔ͘
Copyright © Nextremer, inc. All Rights Reserved. 16 ӡ༻͍ͯͯ͠ىͬͨ͜ ▪
σΟεΫ্ݶ • ֶशσʔλඦGBΛΞοϓϩʔυͨ͠ΒσΟεΫ্ݶʹୡͯ͠ఀࢭ • ίϯςφଆ͔ΒsshfsͰࣗͷPCͷσΟεΫΛϚϯτͯ͠ճආͨ͠ ▪ ίϯςφ͕ͨ࣌͠ͷηʔϑςΟʔωοτ • ։ൃͨ͠ίʔυͷόάͰϗετͷCPUɾϝϞϦΛ৯͍௵͢ • ϏΪφʔͷϢʔβʔ͕͜ͷΑ͏ͳόάΛ࡞Γ͕ͪ • ରԠࡦίϯςφຖʹϦιʔε੍ݶΛ͚ͭΔ • ස͔ͭӨڹͳͷͰಛʹݱঢ়ରԠͤͣ
Copyright © Nextremer, inc. All Rights Reserved. 17 ৄࡉQiitaͷهࣄʂ
Copyright © Nextremer, inc. All Rights Reserved. 18 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ WBC؍ઓઐ༻
Line bot
Copyright © Nextremer, inc. All Rights Reserved. 19 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢
Copyright © Nextremer, inc. All Rights Reserved. 20 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ ▪
ฐࣾCEO ҪΛίϐʔͨ͠ରγεςϜ • 2017/10 ୈ8ճରγεςϜγϯϙδϜʹͯσϞൃද
Copyright © Nextremer, inc. All Rights Reserved. 21 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢