Kubeflowではじめる  ML on Kubernetes #2 Kubeflow Notebooks

Slide 1

Slide 1 text

Keita Watanabe Kubernetes Meetup Tokyo # 53 LT KubeflowͰ͸͡ΊΔ  ML on Kubernetes #2 Kube fl ow Notebooks

Slide 2

Slide 2 text

Keita Watanabe Machine Learning Solutions Architect ▶ AWS JapanͰSelf-managedͳMachine Learning  ͷҊ݅Λ୲౰͍ͯ͠ΔSolutions Architect ▶ લ৬Ͱ͸Datascientist/ML Researcherͱͯ͠  ECαΠτ্ͷը૾ݕࡧػೳͷ։ൃʹैࣄ ▶ Twitter: keitaw09 ▶ Linkedin: keitawatanabe αϯσΟΤΰͰग़ձͬͨτϦ झຯ

Slide 3

Slide 3 text

Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool લճͷ಺༰: Kube fl owͷηοτΞοϓ Slide: https://speakerdeck.com/keitaw/kube fl owdehazimeruml-on-kubernetes-number-1-kube fl owfalsegai-yao-tosetutoatupu

Slide 4

Slide 4 text

ຊ೔ͷ಺༰: Kubeflow Notebooks

Slide 5

Slide 5 text

Kubeflow Notebooksͱ͸ • Webϕʔεͷ։ൃ؀ڥΛKubernetes্Ͱఏڙ͢Δπʔϧ • Կ͕خ͍͔͠ • ؅ཧऀɿඞཁͳύοέʔδ͕Πϯετʔϧ͞Εͨ։ൃऀ༻ͷΠϝʔδΛ  खܰʹఏڙͰ͖Δ + RBACʹΑΔnotebook΁ͷΞΫηε੍ޚ • ϢʔβʔɿϩʔΧϧͷܭࢉࢿݯʹཔΔ͜ͱͳ͘ɺ  Ϋϥελ্ͰNotebook؀ڥ౳Λར༻Ͱ͖Δ  JupyterLab, RStudio, Visual Studio Code (code-server)Λ  ωΠςΟϒͰαϙʔτ͍ͯ͠Δ https://www.kube fl ow.org/docs/components/notebooks/overview/

Slide 6

Slide 6 text

σϑΥϧτͰαϙʔτ͞Ε͍ͯΔΠϝʔδ https://github.com/kube fl ow/kube fl ow/tree/master/components/example-notebook-servers#custom-images • Base: ϕʔεΠϝʔδʢUbuntuʣ • PyTorch/TensorFlow Full:     PyTorch/TensorFlow + Pandas΍ ScipyɺXGBoost౳ͷΑ͘࢖ΘΕΔ ϥΠϒϥϦ • Jupyter imageʹ͸GPU൛΋͋Δ • Custom image: BaseΛجʹ࡞੒  ʢ࡞੒ํ๏͸ԼهͷURLΛࢀরʣ https://www.kube fl ow.org/docs/components/notebooks/container-images/

Slide 7

Slide 7 text

Notebookͷ৽ن࡞੒

Slide 8

Slide 8 text

Notebookͷ৽ن࡞੒

Slide 9

Slide 9 text

Notebookͷ৽ن࡞੒ ❶ ❷ ❸ ❹

Slide 10

Slide 10 text

Kubeflow NotebooksͰJupyterLab σʔλͷղੳ΍Ϟσϧͷ։ൃɺ͞Βʹ͸Kube fl ow Pipelinesʢৄࡉ͸ࠓޙͷLTͰʣ Λ༻͍ͨύΠϓϥΠϯͷߏஙͳͲ͕ߦ͑Δ

Slide 11

Slide 11 text

Kubeflow NotebooksͰVSCode

Slide 12

Slide 12 text

࣍ճ͸… Kubeflow Pipelines

Slide 13

Slide 13 text

ࢀߟࢿྉ • https://www.kube fl ow.org/docs/components/notebooks/overview/ • https://github.com/kube fl ow/kube fl ow/tree/master/components/example- notebook-servers#custom-images • https://github.com/kube fl ow/pipelines/blob/sdk/release-1.8/samples/core/ lightweight_component/lightweight_component.ipynb • https://github.com/aws-samples/aws-do-kube fl ow