ScaleShift-jp-2019-summer

ScaleShift の機能概要、Kubernetes クラスタとの連携について

Transcript

1. ScaleShift
   ΦϯϓϨϛε / Ϋϥ΢υ Ͱ࣮ݱ͢Δػցֶश؀ڥ
   June, 2019
   

   View Slide

2. !2
   ScaleShift
   Docker ϕʔεɺΦʔϓϯιʔεͷ Web ΫϥΠΞϯτ ΞϓϦέʔγϣϯͰ͢
   • ϞσϧߏஙϑΣʔζ
   - NGC / ࣗࣾϦϙδτϦ͔Βػցֶश Docker ΠϝʔδΛϫϯΫϦοΫͰऔಘ
   - ͦͷ೚ҙͷ Docker ΠϝʔδΛ Jupyter notebook ίϯςφͱͯ͠ىಈ
   • ϞσϧֶशϑΣʔζ
   - ߏஙʹར༻ͨ͠ϥΠϒϥϦ͝ͱ Docker ΠϝʔδʹݻΊϦϙδτϦ΁อଘ
   - ΫϦοΫ͚ͩͰ Kubernetes Ϋϥελ / Rescale ΁େن໛ܭࢉλεΫΛૹ৴
   

   View Slide

3. جຊతͳಈ͖
   !3
   How does it work?
   

   View Slide

4. !4
   ScaleShift ͷىಈ
   ϩʔΧϧʹ Web αʔόʔ্ཱ͕͕ͪΓ·͢
   

   View Slide

5. !5
   ػցֶशιϑτ΢ΣΞͷΠϯετʔϧ
   NGC / ϓϥΠϕʔτϨδετϦ ͔ΒϫϯΫϦοΫͰμ΢ϯϩʔυ
   

   View Slide

6. !6
   Jupyter notebook ͰͷϞσϧߏங
   Jupyter Ͱϥοϓͨ͠ίϯςφ͕͔ΜͨΜʹىಈ
   ϙʔτ΋࡞ۀྖҬ΋
   ίϯςφ͝ͱʹ
   ෼཭͞Εͨ
   ΫϦʔϯͳ؀ڥ ɹ.
   
   

   View Slide

7. !7
   େن໛ܭࢉͷͨΊͷϥοϐϯά
   ґଘϥΠϒϥϦ΍ιʔείʔυ܈Λ·ͱΊɺͻͱͭͷΠϝʔδʹݻΊ·͢
   

   View Slide

8. !8
   ࣾ಺Ϋϥελ / Ϋϥ΢υ΁ܭࢉλεΫ౤ೖ
   ౤ೖઌʹԠͯ͡ඞཁͳ API ͕࣮ߦ͞Ε·͢
   ར༻ϦιʔεྔΛܾΊ
   Ϋϥελ΁λεΫ౤ೖ
   

   View Slide

9. Kubernetes ࿈ܞ
   !9
   Integration with a kubernetes cluster
   

   View Slide

10. !10
    ػցֶश ͱ Kubernetes
    Web ք۾Λத৺ʹίϯςφΦʔέετϨʔγϣϯͷσϑΝΫτʹͳͬͨ k8sɻ
    ػցֶशͷจ຺Ͱ΋ίϯςφར༻͕੝ΜʹͳΓɺԠ༻ࣄྫ͕૿͍͑ͯ·͢ɻ
    - NVIDIA ͕ެࣜʹαϙʔτΛද໌ [ GTC 2018 Keynote, March 27 ]
    - Mercari ML Ops Night Vol.1 [ גࣜձࣾ ϝϧΧϦ / May 23, 2018 ]
    ɹhttps://mercari.connpass.com/event/85931/presentation/
    - Jupyter ͚ͩͰػցֶशΛ࣮αʔϏεల։Ͱ͖Δج൫ [ גࣜձࣾϦΫϧʔτϥΠϑελΠϧ ]
    ɹhttps://engineer.recruit-lifestyle.co.jp/techblog/2018-10-04-ml-platform/
    - KubernetesʹΑΔػցֶशج൫΁ͷ௅ઓ [ גࣜձࣾ Preferred Networks / Dec 4, 2018 ]
    ɹhttps://www.slideshare.net/pfi/kubernetes-125013757
    

    View Slide

11. !11
    ScaleShift + Kubernetes ߏ੒ྫ
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ݚڀ / ։ൃνʔϜ
    ScaleShift ೖΓ
    ϩʔΧϧ୺຤
    

    View Slide

12. !12
    1. ػցֶशιϑτ΢ΣΞͷબ୒
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ݚڀ / ։ൃνʔϜ
    GUI ͔ΒબͿ͚ͩͰ
    μ΢ϯϩʔυ͕࢝·Γ·͢
    

    View Slide

13. !13
    2. Ϟσϧߏங
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ݚڀ / ։ൃνʔϜ
    ScaleShift ͕
    ϊʔτϒοΫΛىಈ͠·͢
    

    View Slide

14. !14
    3. ࣮ߦ؀ڥɾೖྗσʔλͷసૹ
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ScaleShift ͕಺෦తʹ
    ඞཁͳసૹΛߦ͍·͢
    ݚڀ / ։ൃνʔϜ
    

    View Slide

15. !15
    4. େن໛ܭࢉͷ࣮ߦΛࢦࣔ
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ݚڀ / ։ൃνʔϜ
    Kubernetes ͷ Job ͱͯ͠
    ܭࢉ৚݅Λૹ৴͠·͢
    

    View Slide

16. !16
    5. େن໛ܭࢉͷ࣮ߦ
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    Kubernetes
    ϓϥΠϕʔτ
    ϨδετϦ
    ݚڀ / ։ൃνʔϜ
    

    View Slide

17. !17
    6. ܭࢉ݁Ռͷ֬ೝ
    ετϨʔδ
    ؅ཧϊʔυ ܭࢉϊʔυ
    ࣾ಺ωοτϫʔΫ
    NGC
    DockerHub
    ϓϥΠϕʔτ
    ϨδετϦ
    Kubernetes
    ݚڀ / ։ൃνʔϜ
    

    View Slide

18. !18
    Kubernetes ઃఆ / λεΫ࣮ߦը໘
    

    View Slide

19. ScaleShift ͷઃఆ
    !19
    Configurations
    

    View Slide

20. !20
    ֎෦࿈ܞ
    ࿈ܞػೳ ઃఆ஋
    NVIDIA GPU CLOUD
    • NVIDIA ࣾͷ؅ཧ͢Δػցֶश Docker Πϝʔδͷ
    Ұཡ / ৄࡉ৘ใऔಘɺΠϝʔδͷμ΢ϯϩʔυ
    ɹAPI Ωʔ & Ϣʔβઃఆ
    ϓϥΠϕʔτϨδετϦ
    • ࣗࣾͰ؅ཧ͢Δػցֶश Docker Πϝʔδͷ
    Ұཡ৘ใऔಘɺΠϝʔδͷμ΢ϯϩʔυ
    ɹ઀ଓઌ & Ϣʔβઃఆ
    AWS
    • ػցֶश Docker Πϝʔδͷμ΢ϯϩʔυ
    • ϩʔΧϧϑΝΠϧγεςϜͱ S3 ؒͷσʔλ࿈ܞ
    ʢ࣮૷༧ఆʣ
    Kubernetes • ࣾ಺Ϋϥελ / Ϋϥ΢υͰͷେن໛ܭࢉ࣮ߦ ɹkubecfg
    Rescale • Rescale ϓϥοτϑΥʔϜͰͷେن໛ܭࢉ࣮ߦ ɹ஍Ҭࢦఆ & API Ωʔ
    

    View Slide

21. !21
    ىಈΦϓγϣϯʢൈਮʣ
    ઃఆ֓ཁ ॳظ஋
    SS_JUPYTER_MINIMUM_PORT ίϯςφ΁ͷ઀ଓϙʔτಈతׂ౰։࢝൪߸ ɾ30000
    SS_LOG_LEVEL ΞϓϦέʔγϣϯͷϩάग़ྗϨϕϧ ɹwarn
    SS_WORKSPACE_HOST_DIR ϗετଆͷ࡞ۀσʔλอଘྖҬ ɹͳ͠ʢࢦఆඞਢʣ
    SS_NGC_REGISTRY_ENDPOINT NGC ઀ଓઌ ɹhttps://registry.nvidia.com
    SS_NGC_REGISTRY_USER_NAME NGC Ϣʔβʔ໊ ɹ$oauthtoken
    SS_RESCALE_SINGULARITY_VERSION Rescale Ͱͷ Singularity ϥϯλΠϜόʔδϣϯ ɹ3.2.0
    SS_RESCALE_JOB_WALLTIME Rescale ͰͷλεΫ࣮ߦ࠷େ࣌ؒ ɾ3600
    docker-compose.yml ʹઃఆΛهࡌɺىಈͰ͖·͢
    

    View Slide