Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KubeflowではじめるML on Kubernetes #1 Kubeflowの概要とセットアップ
Search
Keita Watanabe
August 17, 2022
1
400
KubeflowではじめるML on Kubernetes #1 Kubeflowの概要とセットアップ
Keita Watanabe
August 17, 2022
Tweet
Share
More Decks by Keita Watanabe
See All by Keita Watanabe
re:Invent 2023 CMP319 Deploy LLMs with AWS Inferentia & Ray to optimize performance and cost
keitaw
0
2
re:Invent 2023: CMP332 De-mystifying ML software stack on Amazon EC2 accelerated instances
keitaw
0
5
AWS における LLM・GenAI 大規模学習への取り組み / Large scale GenAI・LLM training on AWS
keitaw
1
370
Amazon EC2 シリコン革命 / Amazon EC2 Silicon Innovation
keitaw
0
140
Introduction to Kserve
keitaw
0
170
ML on Kubernetes with Kubeflow #4 Kubeflow Pipelines: Part2
keitaw
0
1.1k
Practical guide on PyTorch inference using AWS Inferentia
keitaw
0
160
ML on Kubernetes with Kubeflow #3 Kubeflow Pipelines: Part1
keitaw
0
980
実践AWS Inferentia
keitaw
0
250
Featured
See All Featured
Ruby is Unlike a Banana
tanoku
96
10k
Robots, Beer and Maslow
schacon
PRO
155
7.9k
How to Ace a Technical Interview
jacobian
272
22k
Visualization
eitanlees
136
14k
Building Effective Engineering Teams - LeadDev
addyosmani
28
1.8k
Practical Orchestrator
shlominoach
182
9.7k
Fashionably flexible responsive web design (full day workshop)
malarkey
398
65k
The MySQL Ecosystem @ GitHub 2015
samlambert
243
12k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
2
3.4k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
125
32k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
21
1.6k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
121
39k
Transcript
Keita Watanabe Kubernetes Meetup Tokyo # 52 LT KubeflowͰ͡ΊΔ ML
on Kubernetes #1 Kube fl owͷ֓ཁͱηοτΞοϓ
Keita Watanabe Machine Learning Solutions Architect ▶ Self-managedͳMachine LearningͷWorkload Λ୲͍ͯ͠ΔSA
▶ લ৬ͰDatascientist/ML Researcherͱͯ͠ ECαΠτ্ͷը૾ݕࡧػೳͷ։ൃʹैࣄ ▶ Twitter: keitaw09 ▶ Linkedin: keitawatanabe ▶ ݱॴଐ: AWS Japan αϯσΟΤΰͰग़ձͬͨτϦ झຯ
Kubeflowͱ Machine Learning Model-Development Lifecycle (MDLC)ͷ ֤εςοϓʢ+ύΠϓϥΠϯʣΛΧόʔ͢ΔToolͷू·Γ KubeflowΛ࠾༻͢ΔϝϦοτ Composability: ༻్ʹԠͯ͡ඞཁͳComponentsΛΓग़ͯ͠༻͍Δ͜ͱ͕Ͱ͖Δ
Portability: Vendor lock-inΛආ͚Δ͜ͱ͕Ͱ͖Δ Scalability: ෛՙʹԠͯ͡Container/NodeΛεέʔϧ͢Δ͜ͱ͕Ͱ͖Δ
Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform
Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool
Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform
Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool ࠓΔ͜ͱ: Kube fl owͷηοτΞοϓ
Kubeflow setup Amazon EKS্ͰͷKube fl owڥͷߏங • git • kubectl
• eksctl • kustomize • ࠓճAWS Cloud9্Ͱ࡞ۀ͠·͢ cf. https://www.eksworkshop.com/ 020_prerequisites/workspace/ Prerequisites
Demo
Kubeflow setup
To be
࣍ճ…
ࢀߟࢿྉ • https://www.eksworkshop.com/020_prerequisites/workspace/ • https://www.kube fl ow.org/docs/components/ • https://awslabs.github.io/kube fl
ow-manifests/docs/deployment/vanilla/guide/ • https://www.oreilly.com/library/view/kube fl ow-for-machine/9781492050117/