Rancherでkubeflow構築

 Rancherでkubeflow構築

Rancher Meetup #07 in Osakaでの発表資料です

89280551be1a9508293d0ca6a62cc7ab?s=128

nakayamam

March 16, 2019
Tweet

Transcript

  1. RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama

  2. ࣗݾ঺հ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,

    CNJP Kansai
  3. kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX

  4. kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ

  5. kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳ؀ڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥ΢υͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛ؅ཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ࢖͍͍ͨ

    • TensorFlowΛଞͷϓϩηεͱ૊Έ߹Θ͍ͤͨ
  6. kubeflow? kubeflowͷμογϡϘʔυ

  7. kubeflow? Լهͷ΋ͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূ௥Ճͯ͠ෳ਺ਓͰ࢖͑ΔΑ ͏ʹͨ͠΋ͷ • TFjob

    Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛ؅ཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏
  8. ߏங·ͰಓͷΓ͸௕ͦ͏ɾɾɾ

  9. ͋Δ೔RancherΧλϩάΛݟ͍ͯΔͱɾɾ

  10. ͋ʂ

  11. None
  12. ΋͔ͯ͠͠Chainer΋͙͢࢖͑Δɾɾɾʁ

  13. ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancher΁Πϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ

    ͦͪΒΛ࢖͏ํ͕ૣ͍͔΋ https://deploy.kubeflow.cloud/#/
  14. GPUΫϥελʔͷߏங on GKE

  15. GPUબΜͰ࡞੒ KZVQZUFSIVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ௿͍ͱࢮʹ·͢

  16. GPUΫϥελʔ͕Ͱ͖·ͨ͠

  17. ΫϥελʔΛ Rancher΁Πϯϙʔτ

  18. None
  19. ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH

  20. ΠϯϙʔτͰ͖·ͨ͠

  21. RancherΧλϩάͰ kubeflowσϓϩΠ

  22. None
  23. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

  24. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

  25. None
  26. 6*

  27. None
  28. Ϣʔβʔ࡞੒͢Δ

  29. ΠϝʔδΛࢦఆͯ͠TQBXO

  30. ϫʔΫεϖʔε͕࡞੒͞ΕΔ

  31. ϫʔΫεϖʔε͕ग़དྷ্͕Δ

  32. QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ

  33. None
  34. UFOTPSqPXͷδϣϒͷ࡞੒͕Ͱ͖Δ

  35. > kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h

    studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
  36. None
  37. {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}

    {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏΋manifestʹ൓ө͞Ε͍ͯͳ͍Α͏ͩ
  38. issueग़͠ͱ͖·ͨ͠ʂ

  39. Thanks!