Rancherでkubeflow構築

Transcript

1. RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama

2. ࣗݾ঺հ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,

   CNJP Kansai

3. kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX

4. kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ

5. kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳ؀ڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥ΢υͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛ؅ཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ࢖͍͍ͨ

   • TensorFlowΛଞͷϓϩηεͱ૊Έ߹Θ͍ͤͨ

6. kubeflow? kubeflowͷμογϡϘʔυ

7. kubeflow? Լهͷ΋ͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূ௥Ճͯ͠ෳ਺ਓͰ࢖͑ΔΑ ͏ʹͨ͠΋ͷ • TFjob

   Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛ؅ཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏

8. ߏங·ͰಓͷΓ͸௕ͦ͏ɾɾɾ

9. ͋Δ೔RancherΧλϩάΛݟ͍ͯΔͱɾɾ

10. ͋ʂ

11. None

12. ΋͔ͯ͠͠Chainer΋͙͢࢖͑Δɾɾɾʁ

13. ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancher΁Πϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ

    ͦͪΒΛ࢖͏ํ͕ૣ͍͔΋ https://deploy.kubeflow.cloud/#/

14. GPUΫϥελʔͷߏங on GKE

15. GPUબΜͰ࡞੒ KZVQZUFS
    IVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ௿͍ͱࢮʹ·͢

16. GPUΫϥελʔ͕Ͱ͖·ͨ͠

17. ΫϥελʔΛ Rancher΁Πϯϙʔτ

18. None

19. ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH

20. ΠϯϙʔτͰ͖·ͨ͠

21. RancherΧλϩάͰ kubeflowσϓϩΠ

22. None

23. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

24. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

25. None

26. 6*

27. None

28. Ϣʔβʔ࡞੒͢Δ

29. ΠϝʔδΛࢦఆͯ͠TQBXO

30. ϫʔΫεϖʔε͕࡞੒͞ΕΔ

31. ϫʔΫεϖʔε͕ग़དྷ্͕Δ

32. QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ

33. None

34. UFOTPSqPXͷδϣϒͷ࡞੒͕Ͱ͖Δ

35. > kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h

    studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
36. None

37. {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}

    {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏΋manifestʹ൓ө͞Ε͍ͯͳ͍Α͏ͩ

38. issueग़͠ͱ͖·ͨ͠ʂ

39. Thanks!