Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Rancherでkubeflow構築
Search
nakayamam
March 16, 2019
Technology
3
19k
Rancherでkubeflow構築
Rancher Meetup #07 in Osakaでの発表資料です
nakayamam
March 16, 2019
Tweet
Share
More Decks by nakayamam
See All by nakayamam
rancher/system-toolsを試してみた
nakayamam
0
370
Other Decks in Technology
See All in Technology
AI工学特論: MLOps・継続的評価
asei
10
1.6k
DatabricksのOLTPデータベース『Lakebase』に詳しくなろう!
inoutk
0
110
増え続ける脆弱性に立ち向かう: 事前対策と優先度づけによる 持続可能な脆弱性管理 / Confronting the Rise of Vulnerabilities: Sustainable Management Through Proactive Measures and Prioritization
nttcom
1
160
ObsidianをLLM時代のナレッジベースに! クリッピング→Markdown→CLI連携の実践
srvhat09
7
9k
MCPに潜むセキュリティリスクを考えてみる
milix_m
1
720
20250718_ITSurf_“Bet AI”を支える文化とコストマネジメント
helosshi
1
210
Talk to Someone At Delta Airlines™️ USA Contact Numbers
travelcarecenter
0
170
M365アカウント侵害時の初動対応
lhazy
7
4.5k
SAE J1939シミュレーション環境構築
daikiokazaki
0
150
データ駆動経営の道しるべ:プロダクト開発指標の戦略的活用法
ham0215
2
230
生成AIによる情報システムへのインパクト
taka_aki
1
130
Step Functions First - サーバーレスアーキテクチャの新しいパラダイム
taikis
1
280
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
BBQ
matthewcrist
89
9.7k
The Cult of Friendly URLs
andyhume
79
6.5k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.3k
The World Runs on Bad Software
bkeepers
PRO
70
11k
Become a Pro
speakerdeck
PRO
29
5.4k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
850
It's Worth the Effort
3n
185
28k
The Pragmatic Product Professional
lauravandoore
35
6.8k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
GraphQLとの向き合い方2022年版
quramy
49
14k
Transcript
RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama
ࣗݾհ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,
CNJP Kansai
kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX
kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ
kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥυͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ͍͍ͨ
• TensorFlowΛଞͷϓϩηεͱΈ߹Θ͍ͤͨ
kubeflow? kubeflowͷμογϡϘʔυ
kubeflow? Լهͷͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূՃͯ͠ෳਓͰ͑ΔΑ ͏ʹͨ͠ͷ • TFjob
Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏
ߏங·ͰಓͷΓͦ͏ɾɾɾ
͋ΔRancherΧλϩάΛݟ͍ͯΔͱɾɾ
͋ʂ
None
͔ͯ͠͠Chainer͙͑͢Δɾɾɾʁ
ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancherΠϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ
ͦͪΒΛ͏ํ͕ૣ͍͔ https://deploy.kubeflow.cloud/#/
GPUΫϥελʔͷߏங on GKE
GPUબΜͰ࡞ KZVQZUFSIVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ͍ͱࢮʹ·͢
GPUΫϥελʔ͕Ͱ͖·ͨ͠
ΫϥελʔΛ RancherΠϯϙʔτ
None
ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH
ΠϯϙʔτͰ͖·ͨ͠
RancherΧλϩάͰ kubeflowσϓϩΠ
None
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
None
6*
None
Ϣʔβʔ࡞͢Δ
ΠϝʔδΛࢦఆͯ͠TQBXO
ϫʔΫεϖʔε͕࡞͞ΕΔ
ϫʔΫεϖʔε͕ग़དྷ্͕Δ
QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ
None
UFOTPSqPXͷδϣϒͷ࡞͕Ͱ͖Δ
> kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h
studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
None
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏manifestʹө͞Ε͍ͯͳ͍Α͏ͩ
issueग़͠ͱ͖·ͨ͠ʂ
Thanks!