Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
k8s_ml_platform.pdf
Search
kuromatsu
February 19, 2019
Technology
3
2.7k
k8s_ml_platform.pdf
Kubernetes Meetup Tokyo #16
https://k8sjp.connpass.com/event/116799/
kuromatsu
February 19, 2019
Tweet
Share
More Decks by kuromatsu
See All by kuromatsu
Kubernetesのカスタマイズポイントのまとめ
kuromt
0
1.5k
Other Decks in Technology
See All in Technology
転移学習とドメイン適応の基礎
kmatsui
2
570
長期運用プロジェクトでのMySQLからTiDB移行の検証
colopl
2
660
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs (QCon London)
inesmontani
PRO
1
150
Postman v10リリース後を振り返る
nagix
0
130
Databricks における 『MLOps』
databricksjapan
2
140
疲弊しない!AWSセキュリティ統制の考え方 #devio_osakaday1
masahirokawahara
6
5.9k
カオナビの利用実績をアウトカムへつなげる旅 / example-of-data-management-startup-in-kaonavi
kaonavi
0
120
レガシーをぶっ壊せ。AEONで始めるDevRelの話 / Qiita Night 2024-2-22
aeonpeople
3
150
検証を通して見えてきたTiDBの性能特性
lycorptech_jp
PRO
6
3.3k
WebアプリケーションにおけるPDOの使い方入門 / phpcon odawara 2024
meihei3
2
430
人間の尊厳、幸福、アクセシビリティ / 第116回「WEB TOUCH MEETING」アクセシビリティSP
nulabinc
PRO
2
180
Databricks におけるデータエンジニアリング
databricksjapan
0
370
Featured
See All Featured
The Pragmatic Product Professional
lauravandoore
24
5.8k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
273
13k
Embracing the Ebb and Flow
colly
79
4.1k
Writing Fast Ruby
sferik
620
60k
A better future with KSS
kneath
231
16k
Happy Clients
brianwarren
91
6.4k
Ruby is Unlike a Banana
tanoku
96
10k
Producing Creativity
orderedlist
PRO
336
39k
Designing Experiences People Love
moore
136
23k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
18
1.7k
From Idea to $5000 a Month in 5 Months
shpigford
377
45k
The Power of CSS Pseudo Elements
geoffreycrofte
59
5k
Transcript
KubernetesͰػցֶशج൫Λ ߏஙͨ͠ גࣜձࣾ࢜௨ݚڀॴ ਓೳݚڀॴ @kuromt_ 1
ࣗݾհ • TwitterΞΧϯτ: @kuromt_ • ॴଐɿגࣜձࣾ࢜௨ݚڀॴɹਓೳݚڀॴ – ػցֶशΛࢧ͑Δج൫ͷݚڀ – ͚ࣾʹػցֶशج൫Λk8s্ʹߏஙͯ͠2ؒۙ͘ӡ༻த
2
ࠓ͓͢Δ͜ͱ • ֶशίετ͕ߴ͍KubernetesΛӅṭ͠ɺֶशɾਪ ڥΛ࠶ݱՄೳͳػցֶशج൫Λߏஙͨ͠ • ӡ༻ͰಘͨݟQiitaʹެ։ – ʮػցֶशج൫ΛKubernetesͰӡ༻͖ͯͯ͠ʯ 3
KubernetesΛͬͨػցֶशج൫ͷ՝ ϝτϦΫεऩू kubectl ֶ श σ ʔ λ Ϧ
ι ʔε ͷ ֬ ೝ ֶशɺਪ • Kubernetesͷֶशίετ σʔλαΠΤϯςΟετʹ ͱͬͯߴ͗͢Δ • Job, Deployment … • Service, Ingress … • PV, PVC … • ֶशɺਪڥΛ࠶ݱ – Ϟσϧͷਫ਼͕ѱԽͨ͠ ཧ༝ͷݕূ 4
ߏஙͨ͠ج൫ 5
KubernetesΛӅṭ͢ΔಠࣗWebAPIαʔό • ػցֶशͷֶशɾਪͷͨΊʹKubernetesͷػೳΛऔࣺબ͠ ͯAPIΛཧ – ࠷ऴతʹdockerίϚϯυΛୟ͘߹ͱ΄ͱΜͲ͕ࠩͳ͍͍ํͷύϥ ϝʔλʹམͪண͍ͨ • WebAPIαʔόϚχϑΣετΛੜͯ͠kubernetes clientܦ༝
ͰίϯςφΛੜ – KubernetesΛΞοϓάϨʔυͯ͠WebAPIサーバがKubernetesͷAPI ͷมߋΛٵऩ͢ΔͷͰϢʔβύϥϝʔλΛมߋ͢Δඞཁͳ͍ 6
ҙͷֶशɾਪڥΛ࠶ݱ͢ΔΈ • ࠶ݱ͍ͨ͠ڥΛొɾར༻͢ΔAPIΛ༻ҙ – docker-composeΛج൫ͦͷͷʹొ͢Δײ֮ – ڥ໊ͱόʔδϣϯͰҰҙʹܾ·Δ • ొऀҎ֎ొ͞Ε࣮ͨߦڥΛ࠶ར༻Մೳ –
σʔλΛϚϯτ࣮ͨ͠ߦڥͷָ͕ʹͳΓɺモデルの精度の検証や PoCͷελʔτ͕ૉૣ͘ͳͬͨ 7
ߏஙֶͨ͠शɾਪج൫ ϝτϦΫεऩू ֶ श σ ʔ λ Ϧ ι
ʔε ͷ ֬ ೝ ֶशɺਪ • Ϋϥελߏ – ΦϯϓϨϛε – k8s: v1.13.2(HAߏ) – RAM: 560GBʙ1.5TB – GPU: • V100: 20ʙ40ຕ • P100: 8ʙ80ຕ • Ϧιʔε͕ෆ͢ΕNodeΛ Ճͯ͠ରԠ • શମߏCIͰཧ Web API 8
·ͱΊ • ػցֶशج൫Λߏங – KubernetesͰ͋Δ͜ͱΛҙࣝ͠ͳ͍͍ͯ͘ – WebAPIͰֶशɾਪڥΛొɾ࠶ݱͰ͖Δ • PaaSͱͯ͠ج൫͕ҭͪͭͭ͋Δ –
ݱࡏ170ਓҎ্͕ར༻ – KubernetesͩͱΒͣʹ͍ͬͯΔਓଟ͍ • 2,000ίϯςφҎ্Λಉ࣌ʹಈ͔͠ύϥϝʔλ୳ࡧ͢Δ͜ͱ 9