Brief description of Docker and XaaS in the AI era

Blog: https://mazgi.github.io/posts/2019.05/brief-description-of-xaas-in-the-ai-era/
================================
Samples & Demos
- https://github.com/mazgi-sandbox/201905.note.brief-description-of-docker-and-xaas-in-the-ai-era
- https://github.com/mazgi/terraform-aws-simple-vpc/tree/v2019.05.2
- https://www.youtube.com/watch?v=aJiaQASr0G4

References
- https://docs.docker.com/
- https://llminatoll.booth.pm/items/825879
- https://llminatoll.booth.pm/items/1036317
- https://www.amazon.co.jp/dp/B00VHW3PKW
- https://hub.docker.com/r/tensorflow/tensorflow/tags
- https://en.wikipedia.org/wiki/Linux_namespaces
- https://blog.docker.com/2016/03/docker-for-mac-windows-beta/
- https://brew.sh/
- https://github.com/mazgi-showcase/docker-compose.webapp-dev-envs/blob/2019.04.0/rails-webapp/docker-compose.yml

Transcript

1. AI࣌୅ͷDocker+XaaS؆୯ཧղ
   MATSUKI Hidenori, DeNA AIγεςϜ෦ٕज़ڞ༗ձ May 23, 2019
   

   View Slide

2. ࣗݾ঺հ
   • দ໦Ͱ͢
   • https://github.com/mazgi
   • MLΤϯδχΞϦϯάάϧʔϓ
   • ே׆த
   2
   

   View Slide

3. ࠓ೔ͷ͓࿩
   • Dockerͷ࿩
   • ศར͞ͷ֬ೝʙMLฤʙ
   • Dockerͬ͘͟Γཧղ
   • Docker ComposeͰ΋ͬͱศརʹ
   • DockerfileʢͪΐͬͱʣϕετϓϥΫςΟε
   • XaaSʢβʔεʣͷ࿩
   • ਎ۙͳXaaS
   • DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
   3
   

   View Slide

4. 4
   ͦͷલʹ
   

   View Slide

5. ͳͥ͜ͷςʔϚ͔
   • զʑ͕΍Γ͍ͨ͜ͱ
   • ʮ͍ͭͰ΋Ͳ͜Ͱ΋ίϯϐϡʔλʔʹܭࢉ͍ͤͨ͞ʯ
   • ʮGPU΋ඞཁͳ͚ͩ࢖͍͍ͨʯ
   • ʮ҆શʹσʔλΛѻ͍͍ͨʯ
   • ࠓ೔͸⬆ Λ࣮ݱ͢ΔͨΊͷͬ͘͟Γͱͨ͠࿩Ͱ͢
   5
   

   View Slide

6. Poll͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ
   6
   ʢ͝ଘ஌͔΋͠Ε·ͤΜ͕ʣ
   DockerΛΑΓศརʹ࢖͍ͬͯͨͩ
   ͚Δ Docker Compose ͱ IaaS ͷ
   ࿩Λ͠·͢ɻ
   

   View Slide

7. Poll͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ
   7
   ϩʔΧϧʢMacʣͱIaaSͦΕͧΕ
   Ͱ࢖͑ΔαϯϓϧΛ༻ҙ͠·͠
   

   View Slide

8. Poll͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ
   8
   ηογϣϯͷ࠷ޙʹͥͻ۩ମ
   తͳ಺༰Λڭ͍͑ͯͩ͘͞
   

   View Slide

9. ࠓ೔ͷαϯϓϧ
   • Dockerfileଞαϯϓϧ
   • mazgi-sandbox/201905.note.brief-description-of-docker-and-xaas-in-the-ai-era
   • IaCαϯϓϧ
   • mazgi/terraform-aws-simple-vpc/tree/v2019.05.2
   9
   

   View Slide

10. ँࣙʗࢀߟࢿྉ
    ⏬ Λࢀߟʹ͍͖ͤͯͨͩ͞·ͨ͠
    • ެࣜυΩϡϝϯτ https://docs.docker.com/
    • ʮϚϯΨͰΘ͔ΔDockerʯγϦʔζ
    • #ϚϯΨͰΘ͔ΔDocker ᶃ https://llminatoll.booth.pm/items/825879
    • #ϚϯΨͰΘ͔ΔDocker ᶄ https://llminatoll.booth.pm/items/1036317
    • DockerΛࢧ͑Δٕज़ https://www.amazon.co.jp/dp/B00VHW3PKW
    10
    

    View Slide

11. 11
    Dockerͷ࿩
    

    View Slide

12. ศར͞ͷ֬ೝʙMLฤʙ
    Dockerͷ࿩
    12
    

    View Slide

13. Docker͸ɾɾɾʁ
    • ؀ڥͷΠϝʔδԽ
    • ⬇ 1ߦͰ୭Ͱ΋Ͳ͜Ͱ΋TensorFlowͷಈ͘Jupyter Notebook͕ىಈͰ͖Δ
    • docker run -p 8888:8888 --rm -it tensorflow/tensorflow:latest-py3-jupyter
    13
    

    View Slide

14. Docker͸ɾɾɾʁ
    • “ίϯςφΠϝʔδ”ͷ࡞੒ɺڞ༗ɺ࣮ߦ͕Ͱ͖Δ
    • “Securely build, share and run any application, anywhere”
    • by https://www.docker.com/
    • ͢Ͱʹଟ͘ͷίϯςφΠϝʔδ͕ڞ༗͞Ε͍ͯΔ
    • https://hub.docker.com/ ͳͲͰڞ༗Մೳ
    • ྫ: https://hub.docker.com/r/tensorflow/tensorflow/tags
    • ίϯςφΠϝʔδ͸શͯʮ࣮ߦՄೳͳLinuxʢͷίϯςφʣ؀ڥʯ
    14
    

    View Slide

15. Dockerͬ͘͟Γཧղ
    Dockerͷ࿩
    15
    

    View Slide

16. Dockerͬ͘͟Γཧղ
    • “Linuxίϯςφ”ͱ͸ʁ ▶ ࣍ͷϖʔδͰਤΛ঺հ͠·͢
    • ίϯςφͱ͸ҎԼͷ෼཭
    • ϓϩηεۭؒ, ϑΝΠϧγεςϜ, ωοτϫʔΫ, ܭࢉϦιʔεʢCPU, Memʣ
    • VirtualBoxͷΑ͏ͳԾ૝ϚγϯʢVMʣͰ͸ͳ͍
    • VM͸จࣈ௨Γϋʔυ΢ΣΞͷந৅Խ
    • pipͷΑ͏ͳιϑτ΢ΣΞύοέʔδͰ͸ͳ͍
    • ιϑτ΢ΣΞύοέʔδ͸͋͘·Ͱʢ࣮ߦՄೳϑΝΠϧΛؚΉʣσʔλ
    • venvͷΑ͏ͳ؀ڥ੾Γସ͑πʔϧͰ͸ͳ͍
    • ؀ڥ੾Γସ͑πʔϧ͸ओʹ؀ڥม਺ͳͲΛ੾Γସ͍͑ͯΔ
    16
    

    View Slide

17. Container Runtime
    Process(es)
    bin lib
    Container Runtime
    Process(es)
    bin lib
    Container Runtime
    Process(es)
    bin lib
    Container Runtime
    Process(es)
    bin lib
    Dockerͬ͘͟Γཧղ
    17
    HW
    OS OS(Guest)
    OS(Host)
    HW
    HyperVisor
    pip ͳͲ
    ෺ཧϚγϯ্ͰVMΛհͣ͞ʹ
    ίϯςφΛಈ͔͢͜ͱ΋Մೳ
    Docker for Mac, GKEͳͲ͸
    VM্ͰίϯςφΛಈ͔͍ͯ͠Δ
    VirtualBox ͳͲ
    

    View Slide

18. Dockerͬ͘͟Γཧղ
    • ࣮͸ίϯςφ≠Docker
    • DockerҎ֎ͷίϯςφٕज़΋͋Δ(LXC, Solaris Containers, etc.)
    • Ͱ͕͢ࠓ೔͸Dockerͷ࿩͚ͩ
    • Docker͸LinuxͷϦιʔε෼཭ػೳ(namespace)Λ࢖༻
    • Mount namespace, PID namespace, etc.
    • https://en.wikipedia.org/wiki/Linux_namespaces
    • ͳͷͰDocker for Mac͸macOS্ͷLinux্Ͱಈ͍͍ͯΔ
    • https://blog.docker.com/2016/03/docker-for-mac-windows-beta/
    18
    

    View Slide

19. Dockerͬ͘͟Γཧղ
    • Ͳ͏΍ͬͯΠϯετʔϧ͢Ε͹͍͍ͷʁ on macOS
    • ࣮͸⬇ ͷ2ίϚϯυ͚ͩͰΠϯετʔϧͰ͖·͢
    • /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/
    master/install)"
    • brew cask install docker
    • ࢀߟ: https://brew.sh/
    19
    

    View Slide

20. Docker ComposeͰ΋ͬͱศརʹ
    Dockerͷ࿩
    20
    

    View Slide

21. Docker ComposeͰ΋ͬͱศརʹ
    • Docker Composeͱ͸ʁ
    • ෳ਺ͷίϯςφΛ؅ཧͰ͖Δπʔϧ
    • Կ͕Ͱ͖Δͷʁ
    • ʢ౰વʣෳ਺ίϯςφͷ؅ཧ
    • ྫ: WebΞϓϦέʔγϣϯ։ൃͰϑϩϯτΤϯυ, αʔόʔαΠυ, DBΛಉ࣌ʹىಈ
    • mazgi-showcase/docker-compose.webapp-dev-envs/blob/2019.04.0/rails-webapp/
    docker-compose.yml
    • ࠓ೔͸͋·Γ৮Ε·ͤΜ
    • ίϚϯυϥΠϯҾ਺ͷఆٛͱ؅ཧ
    • ʮdocker run …ͳΜ͚ͩͬʯͬͯͳΔ͜ͱͳ͍Ͱ͔͢ʁ
    • ͦΕɺYAMLܗࣜͰఆٛͰ͖·͢ɺ΋ͪΖΜGitͰόʔδϣϯ؅ཧՄೳ
    21
    

    View Slide

22. Docker ComposeͰ΋ͬͱศརʹ
    • ͔͜͜ΒεΫγϣଟΊͰ͍͖·͢
    • ͕࣌ؒ͋Ε͹Demo΋͠·͢
    • αϯϓϧʢ࠶ܝʣ
    • mazgi-sandbox/201905.note.brief-description-of-docker-and-xaas-in-the-ai-era
    22
    

    View Slide

23. Docker ComposeͰ΋ͬͱศརʹ
    23
    sample-files/01.docker-compose-2.3-tensorflow/docker-compose.yml
    ⬇ ΛYAMLͰఆٛ
    - DockerΠϝʔδ໊
    - ϙʔτϑΥϫʔυઃఆ
    

    View Slide

24. Docker ComposeͰ΋ͬͱศརʹ
    24
    sample-files/02.docker-compose-2.3-tensorflow/docker-compose.yml
    ΠϝʔδͰ͸ͳ͘DockerfileΛϏϧυ
    Dockerfileͷத਎͸લϖʔδͱಉ͡
    ※SHA256ϋογϡΛࢦఆ͢Δͱ࣮֬ʹಉ͡
    ΠϝʔδΛݩʹͰ͖Δ
    sample-files/02.docker-compose-2.3-tensorflow/Dockerfile
    

    View Slide

25. Docker ComposeͰ΋ͬͱศརʹ
    25
    sample-files/03.docker-compose-2.3-tensorflow/docker-compose.yml
    Dockerfileͷ໊લΛ”Dockerfile”Ҏ֎ʹ
    ͍ͨ͜͠ͱɺ͋Γ·͢ΑͶ
    sample-files/03.docker-compose-2.3-tensorflow/Dockerfile.03-2
    ϑΝΠϧΛ௥Ճ͍ͨ͜͠ͱ͋Γ·͢ΑͶ
    

    View Slide

26. Dockerfileʢͪΐͬͱʣ
    ϕετϓϥΫςΟε
    Dockerͷ࿩
    26
    

    View Slide

27. DEMO
    DockerfileʢͪΐͬͱʣϕετϓϥΫςΟε
    27
    sample-files/04.docker-tensorflow/Dockerfile.04-01.unfavorable
    sample-files/04.docker-tensorflow/Dockerfile.04-02.favorable
    ͍ͭ”RUN”໋ྩΛԿߦ΋ॻ͍ͯ͠·͍
    ·͕͢”RUN”͝ͱʹϨΠϠʔ͕࡞ΒΕ
    ΠϝʔδαΠζ͕૿͑ΔͷͰྑ͋͘Γ
    ·ͤΜɻ
    “RUN”໋ྩΛͰ͖Δ͚ͩগͳ͘͢Δ͜
    ͱͰॏͳΔϨΠϠʔΛݮΒ͢͜ͱ͕Ͱ
    ͖·͢ɻ
    

    View Slide

28. DEMO
    DockerfileʢͪΐͬͱʣϕετϓϥΫςΟε
    28
    sample-files/05.docker-tensorflow/Dockerfile.05-01.fail
    build࣌ʹϓϥΠϕʔτϦϙδτϦ͔Β
    git clone͍ͨ͜͠ͱ͋Γ·͢ΑͶ
    Ͱ΋݁Ռ͸ɾɾɾ伴͕ͳ͍ͨΊcloneͰ͖·ͤΜ
    Permission denied (publickey).
    fatal: Could not read from remote repository.
    

    View Slide

29. DEMO
    DockerfileʢͪΐͬͱʣϕετϓϥΫςΟε
    29
    sample-files/05.docker-tensorflow/Dockerfile.05-02.insecure
    ͦΜͳ࣌ɺ”COPY”໋ྩͰ伴ϑΝΠϧ
    Λίϐʔ͢Ε͹buildதʹgit cloneͰ͖
    ·͕͢ɺ͜Ε͸ةݥͰ͢ʂ
    “COPY”ͷϨΠϠʔΛࢦఆͯ͠؆୯ʹ伴ϑΝΠϧ
    ΛऔΓग़͢͜ͱ͕Ͱ͖ͯ͠·͍·͢ɻ
    ܁Γฦ͠·͕͢ɺ͜Ε͸ͱͯ΋ةݥͰ͢ʂ
    Ͱ΋“COPY”ͷ࣌ʹ࡞ΒΕͨϨΠϠʔ
    ͸͔ͬ͠Γͱ࢒͍ͬͯ·͢ɻ
    

    View Slide

30. DEMO
    DockerfileʢͪΐͬͱʣϕετϓϥΫςΟε
    30
    sample-files/05.docker-tensorflow/Dockerfile.05-03.secure-with-buildkit
    ͦ͜Ͱ”RUN”໋ྩʹΦϓγϣϯΛ
    ౉ͤΔΑ͏ʹͳΓ·ͨ͠ɻ
    build࣌ʹ΋͜ͷΑ͏ͳࢦఆΛ͢Δඞཁ͕͋Γ·͢
    DOCKER_BUILDKIT=1 docker build . \
    —secret id=github_private_key,src=$(pwd)/.ssh/deploy-key.id_rsa \
    -f Dockerfile.05-03.secure-with-buildkit
    

    View Slide

31. 31
    XaaSʢβʔεʣͷ࿩
    

    View Slide

32. ਎ۙͳXaaS
    XaaSʢβʔεʣͷ࿩
    32
    

    View Slide

33. ਎ۙͳXaaS
    • XaaS == Anything as a ServiceɺIaaS, FaaS, SaaS ͳͲͷ૯শ
    • IaaS == Infrastructure as a Service
    • αʔόʔϋʔυ΢ΣΞͷαʔϏεԽ
    • Ϣʔβʔ͸OSͱωοτϫʔΫΛѻ͑Δ
    • FaaS == Function as a Service
    • ʢϓϩάϥϛϯάతҙຯͷʣؔ਺࣮ߦ؀ڥͷαʔϏεԽ
    • Ϣʔβʔ͸ؔ਺Λఆ࣮ٛ͠ߦͰ͖Δ
    • SaaS == Software as a Service
    • ΞϓϦέʔγϣϯͷαʔϏεԽ
    • Ϣʔβʔ͸ʢWebϒϥ΢βӽ͠ʹʣܾ·ͬͨΞϓϦέʔγϣϯΛ࢖༻Ͱ͖Δ
    33
    

    View Slide

34. ???
    Process(es)
    bin lib
    ???
    Process(es)
    bin lib
    ਎ۙͳXaaS
    34
    OS(Guest)
    OS(Host)
    HW
    HyperVisor
    ???
    Process(es)
    bin lib
    Data
    IaaS FaaS SaaS
    VMҎԼΛ͓೚ͤ ΞϓϦ࣮ߦ؀ڥ·Ͱ͓೚ͤ σʔλҎ֎શ෦͓೚ͤ
    Gmail
    AWS Lambda
    Cloud Functions
    Google Calendar
    AWS EC2
    GCP GCE
    ౰વϋʔυ΢ΣΞ͕
    ͋Δ”͸ͣ”ɻ
    ͖ͬͱLinuxͳͲ͕
    ಈ͍͍ͯΔ”͸ͣ”ɻ
    ΋͸΍Ϣʔβʔ͔Β͸
    ࢓૊Έ͕ݟ͑ͳ͍ɻ
    

    View Slide

35. ਎ۙͳXaaS
    35
    https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html
    ྫ͑͹AWS Lambda͸Amazon
    LinuxͰಈ͍͍ͯΔɻ
    

    View Slide

36. DockerͰGPUΛ࢖͏ͨΊͷ
    IaaSͱIaC
    XaaSʢβʔεʣͷ࿩
    36
    

    View Slide

37. DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • զʑ͕΍Γ͍ͨ͜ͱ
    • ʮ͍ͭͰ΋Ͳ͜Ͱ΋ίϯϐϡʔλʔʹܭࢉ͍ͤͨ͞ʯ
    • ʮGPU΋ඞཁͳ͚ͩ࢖͍͍ͨʯ
    • ʮ҆શʹσʔλΛѻ͍͍ͨʯ
    • ⬆ Λ࣮ݱ͢ΔͨΊʹඞཁͳͷ͸ɾɾɾʁ
    37
    

    View Slide

38. DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • ʮ͍ͭͰ΋Ͳ͜Ͱ΋ίϯϐϡʔλʔʹܭࢉ͍ͤͨ͞ʯ
    • IaaSͰੈքதͲ͔͜ΒͰ΋Ծ૝Խ͞Εͨίϯϐϡʔλʔ͕࢖͑Δ✅
    • DockerΛ࢖͑͹؀ڥΛ؆୯ʹ࠶ݱͰ͖Δ✅
    • IaaSʹDockerͷΠϯετʔϧ͕ඞཁɾɾɾʁ
    38
    

    View Slide

39. DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • ʮGPU΋ඞཁͳ͚ͩ࢖͍͍ͨʯ
    • IaaSͰେྔʹGPUΛ࢖͑Δ✅
    • Docker͔ΒGPUͬͯͲ͏΍ͬͯ࢖͑͹ɾɾɾʁ
    39
    

    View Slide

40. DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • ʮ҆શʹσʔλΛѻ͍͍ͨʯ
    • IaaSͳΒ͍ͭ͘Ͱ΋ִ཭ͨ͠؀ڥ࡞Εͯ҆શ✅
    • Ͱ΋ͦͷ··Ͱ͸ੈքதͲ͔͜ΒͰ΋ΞΫηεͰ͖ͯ͠·͏ͷͰ͸ɾɾɾʁ
    • ౎౓ִ཭ͨ͠؀ڥ࡞ΔͷେมͰ͸ɾɾɾʁ
    40
    

    View Slide

41. DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • IaC == Infrastructure as Code
    • ʮΠϯϑϥΛίʔυͰఆٛ͢Δʯߟ͑ํ
    • ίʔυͳͷͰ
    • όʔδϣϯ؅ཧͰ͖Δ
    • ෳ੡Ͱ͖Δ
    • ܁Γฦ͠΍෼ذ͕Ͱ͖Δʢݶఆతʣ
    • ଟ͘ͷπʔϧ͕͋Δ
    41
    

    View Slide

42. DEMO
    DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    • αϯϓϧʢ࠶ܝʣ
    • https://github.com/mazgi/terraform-aws-simple-vpc/tree/v2019.05.2/examples/
    simple-ml
    • ࠓճͷDemo ▶ ࣍ͷϖʔδͰߏ੒ਤΛ঺հ͠·͢
    • TerraformͰAWSΛઃఆ͢Δ
    • ಈը ▶ https://www.youtube.com/watch?v=aJiaQASr0G4
    • AWSఏڙͷDeep LearningΠϝʔδ͔ΒԾ૝ϚγϯΛىಈ͢Δ
    • Ծ૝ϚγϯʢVMʣ΁ͷSSH઀ଓݩΛ೚ҙͷIPΞυϨεʹݶఆ͢Δ
    • VM্ͰDocker Composeͱnvidia-docker 2Λ࢖ͬͯTensorFlowίϯςφΛىಈ͢Δ
    • ϩʔΧϧ͔ΒWebϒϥ΢βͰDockerίϯςφ্ͷJupyter Notebookʹ઀ଓ͢Δ
    42
    

    View Slide

43. DEMO
    DockerͰGPUΛ࢖͏ͨΊͷIaaSͱIaC
    43
    AWS VPC
    https://network.yamaha.com/support/download/tool/
    Your Place ( Office )
    Other Places
    GPU Instance
    SSH
    HTTP
    SSH
    

    View Slide