Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Shiva 〜Nextremerをscale upする機械学習環境〜
Search
Chanmoro
December 14, 2017
Technology
0
160
Shiva 〜Nextremerをscale upする機械学習環境〜
Nextremer 社内で運用している機械学習環境 Shiva のご紹介
tag: Docker, Mesos, Marathon, Jupyter, ceph,
Chanmoro
December 14, 2017
Tweet
Share
More Decks by Chanmoro
See All by Chanmoro
LAPRAS クローラーの変遷
chanmoro
3
2.1k
クローラーをテストしよう!
chanmoro
2
1.7k
対話AI on Kubernetes
chanmoro
0
73
グラフ解析で社長の脳内さらす!
chanmoro
0
280
Other Decks in Technology
See All in Technology
安心してください、日本語使えますよ―Ubuntu日本語Remix提供休止に寄せて― 2024-11-17
nobutomurata
1
1k
AIチャットボット開発への生成AI活用
ryomrt
0
170
【Pycon mini 東海 2024】Google Colaboratoryで試すVLM
kazuhitotakahashi
2
540
Engineer Career Talk
lycorp_recruit_jp
0
190
Can We Measure Developer Productivity?
ewolff
1
150
Lambdaと地方とコミュニティ
miu_crescent
2
370
プロダクト活用度で見えた真実 ホリゾンタルSaaSでの顧客解像度の高め方
tadaken3
0
180
Shopifyアプリ開発における Shopifyの機能活用
sonatard
4
250
The Rise of LLMOps
asei
7
1.7k
TypeScript、上達の瞬間
sadnessojisan
46
13k
ISUCONに強くなるかもしれない日々の過ごしかた/Findy ISUCON 2024-11-14
fujiwara3
8
870
DynamoDB でスロットリングが発生したとき_大盛りver/when_throttling_occurs_in_dynamodb_long
emiki
1
430
Featured
See All Featured
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
4
370
Optimising Largest Contentful Paint
csswizardry
33
2.9k
Designing for humans not robots
tammielis
250
25k
Fontdeck: Realign not Redesign
paulrobertlloyd
82
5.2k
Why Our Code Smells
bkeepers
PRO
334
57k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
26
2.1k
A designer walks into a library…
pauljervisheath
204
24k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.7k
Code Review Best Practice
trishagee
64
17k
Producing Creativity
orderedlist
PRO
341
39k
Designing the Hi-DPI Web
ddemaree
280
34k
Designing for Performance
lara
604
68k
Transcript
Copyright © Nextremer, inc. All Rights Reserved. 1 Shiva ʙNextremerΛScale
up͢Δػցֶशڥʙ 14th Dec 2017
Copyright © Nextremer, inc. All Rights Reserved. 2 ࣗݾհ ྆֯
ي(ΖͣΈ ͔͖ͣ) גࣜձࣾNextremer ϓϩάϥϚʔ ※ରγεςϜͷݚڀ։ൃΛ͍ͯ͠ΔاۀͰ͢ • ओʹ͍ͬͯΔ͜ͱ • αʔόʔαΠυ։ൃ • ͜͜࠷ۙ৮ٕͬͨज़ • Terraform, Ansible, Packer ← Infrasctucture as Codeʂ • Docker, Kubernetes, Apache Mesos ← ϙʔλϏϦςΟ͍͜͞͏ʂ • Python, Scala, javascript(ES6) ← ؔܕ͏·͔͚͘Δͱؾ͍͍࣋ͪʂ • Finagle, React.js ← ϚΠΫϩαʔϏε͍ͨ͠ʂϦΞΫςΟϒ͍ͨ͠ʂ
Copyright © Nextremer, inc. All Rights Reserved. 3 ࠓ͓͢͠Δ͜ͱ Nextremer
ͷػցֶशڥ Shiva ʹ͍͓ͭͯ͠͠·͢
Copyright © Nextremer, inc. All Rights Reserved. 4 ػցֶशڥ Shiva
1. ΦϑΟεʹ͋ΔGPUϚγϯʹ 2. WebͷμογϡϘʔυ͔Β 3. ઐ༻ͷJupyterΛ্ཱͪ͛ΒΕΔ
Copyright © Nextremer, inc. All Rights Reserved. 5 Shiva͕ղܾ͢Δ՝ ▪
GPUϚγϯΛ͍͍͚ͨͲɾɾɾ • Ϋϥυඅ༻Λؾʹͯ͠ؾܰʹ͑ͳ͍ • ओʹ༧ࢉ͖ͷPJҎ֎ɺτϨʔχϯάͱ͔ɺҋݚڀͱ͔ • GPUϚγϯΛෳϢʔβʔͰڞ༗͢ΔͷΓʹ͍͘ • ϥΠϒϥϦͷڝ߹ɺ୭͕ͬͯΔ͔Θ͔ΒΜ • GPUϚγϯ্Ͱͷڥߏங͕େมͩͬͨΓ • શһ͕ৄ͍͠Θ͚͡Όͳ͍
Copyright © Nextremer, inc. All Rights Reserved. 6 σϞ ※GIFΞχϝʔγϣϯͰ͢
Copyright © Nextremer, inc. All Rights Reserved. 7 Abstract ▪
ϢʔβʔຖͷDockerίϯςφ ▪ શ෦ೖΓڥ & sudoݖݶ ▪ ϗʔϜdirΛશϚγϯͰڞ༗
Copyright © Nextremer, inc. All Rights Reserved. 8 Architecture Overview
Copyright © Nextremer, inc. All Rights Reserved. 9 Architecture Overview
μογϡϘʔυ͔ΒAPIܦ༝Ͱૢ࡞ ɹɾϦιʔεར༻ঢ়گΛऔಘ ɹɾίϯςφͷىಈɾআ
Copyright © Nextremer, inc. All Rights Reserved. 10 Architecture Overview
શͰϗʔϜσΟϨΫτϦΛڞ༗ ɹɾࢄετϨʔδΛߏங ɹɾίϯςφىಈ࣌ʹϚϯτ
Copyright © Nextremer, inc. All Rights Reserved. 11 Architecture Overview
▪ ϢʔβʔͱϙʔτͷϚοϐϯά • http://host/user/kazuki.morozumi • Jupyter͕Ϧεϯ͢ΔϙʔτϥϯμϜ ▪ ίϯςφՔಇঢ়گΛެ։͢ΔAPI ▪ tmpnbΛΧελϚΠζ • https://github.com/jupyter/tmpnb
Copyright © Nextremer, inc. All Rights Reserved. 12 Infrastructure Overview
Copyright © Nextremer, inc. All Rights Reserved. 13 Infrastructure Overview
ίϯςφΦʔέετϨʔγϣϯʹ Mesos + MarathonΛར༻
Copyright © Nextremer, inc. All Rights Reserved. 14 Infrastructure Overview
▪ Mesos+MarathonΛબͨ͠ཧ༝ • ಛఆͷΞϓϦΛσʔϞϯͱͯ͠ಈ͔ͤΕे • αʔϏεσΟεΧόϦͱ͔͍Βͳ͍ • KubernetesΦʔόʔεϖοΫ͗͢Δ • ߏཁૉ͕ଟ͘ෳࡶͰߏஙɺϝϯςφϯε͕େม • ୯७ʹMesos+MarathonΛࢼͯ͠Έ͔ͨͬͨ • ߏங࣌ใ͕͔ͳΓগͳ͔ͬͨ
Copyright © Nextremer, inc. All Rights Reserved. 15 Infrastructure Overview
CPU Intel Core i7-6700K ϝϞϦ 32GB Disk SSD 500GB GPU GTX-1080 ×2ຕ GPUϚγϯεϖοΫ ݟͨେࣄʂ ɹ- ͱΓ͋͑ͣޫΒͤΔ ɹ- ΈΜͳʹݟ͑Δॴʹஔ͘
Copyright © Nextremer, inc. All Rights Reserved. 16 ӡ༻͍ͯͯ͠ىͬͨ͜ ▪
σΟεΫ্ݶ • ֶशσʔλඦGBΛΞοϓϩʔυͨ͠ΒσΟεΫ্ݶʹୡͯ͠ఀࢭ • ίϯςφଆ͔ΒsshfsͰࣗͷPCͷσΟεΫΛϚϯτͯ͠ճආͨ͠ ▪ ίϯςφ͕ͨ࣌͠ͷηʔϑςΟʔωοτ • ։ൃͨ͠ίʔυͷόάͰϗετͷCPUɾϝϞϦΛ৯͍௵͢ • ϏΪφʔͷϢʔβʔ͕͜ͷΑ͏ͳόάΛ࡞Γ͕ͪ • ରԠࡦίϯςφຖʹϦιʔε੍ݶΛ͚ͭΔ • ස͔ͭӨڹͳͷͰಛʹݱঢ়ରԠͤͣ
Copyright © Nextremer, inc. All Rights Reserved. 17 ৄࡉQiitaͷهࣄʂ
Copyright © Nextremer, inc. All Rights Reserved. 18 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ WBC؍ઓઐ༻
Line bot
Copyright © Nextremer, inc. All Rights Reserved. 19 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢
Copyright © Nextremer, inc. All Rights Reserved. 20 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ ▪
ฐࣾCEO ҪΛίϐʔͨ͠ରγεςϜ • 2017/10 ୈ8ճରγεςϜγϯϙδϜʹͯσϞൃද
Copyright © Nextremer, inc. All Rights Reserved. 21 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢