Packer를 통한 AMI 자동 빌드 시스템 구축

Packer를 통한 AMI 자동 빌드 시스템 구축
2015. 09. 05 도커 서울 밋업 4번째(Open Container Korea 주최).
by nacyot http://blog.nacyot.com

패커(Packer)는 범용적인 이미지 빌더입니다. 이미지는 일반적으로 가상화된 서버의 상태를 그대로 저장해서 다시 사용할 수 있도록 해줍니다. 하지만 이렇게 만들어진 이미지는 재현도 어렵고 그 수가 많아질 수록 관리하기 어려운 단점이 있습니다. Packer는 서버의 상태를 그대로 저장하는 대신에 Provisioner(셸스크립트, chef, ansible 등)을 사용해 이미지 생성을 관리하고, Builder를 통해서 다양한 플랫폼(AWS AMI, Digital Ocean, Docker 등)에서 이미지를 생성할 수 있도록 지원합니다.

이 발표에서는 Packer를 소개하고 간단한 예제와 실제 사용 사례에 대해서 설명합니다.

Transcript

1. PACKERܳ ాೠ AMI
   ੗ز ࠽٘ दझమ ҳ୷
   1 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

2. Daekwon Kim
   SMARTSTUDY SOFTWARE & SYSTEM ENGINEER
   2 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

3. 3 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

4. PACKER
   HASHICORP
   4 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

5. PACKER
   IS A TOOL FOR CREATING MACHINE
   AND CONTAINER IMAGES FOR
   MULTIPLE PLATFORMS FROM A
   SINGLE SOURCE CONFIGURATION.
   5 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

6. PACKER
   IS A TOOL FOR CREATING MACHINE
   AND CONTAINER IMAGES FOR
   MULTIPLE PLATFORMS FROM A
   SINGLE SOURCE CONFIGURATION.
   6 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

7. PACKER
   ߧਊ੸ ੉޷૑ ࠽؊
   7 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

8. IMAGE
   8 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

9. MACHINE TO IMAGE
   ੘ز઺ੋ ݠन੄ ౠ੿ ࢚కܳ ੷
   9 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
   

   View Slide

10. IMAGE
    ▸ ݠन੄ ౠ੿ ࢚కܳ ੷੢ೡ ࡺ
    ▸ ੌױ جইоח ࢚కܳ ੷੢
    ▸ ೒ۖಬ р ҕਬೞӝ য۰਑
    ▸ ੤അೞӝ য۰਍ ҃਋о ݆਺
    ▸ ҙܻ࠺ਊ੉ ੉޷૑ࣻী ࠺۹
    10 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

11. Build!
    11 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

12. BUILDER
    AND
    PROVISIONER
    12 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

13. BUILDER
    যڃ ೒ۖಬ੄ ੉޷૑ܳ ٜ݅ Ѫੋо
    13 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

14. Amazon EC2 (AMI)
    DigitalOcean
    Docker
    Google Compute Engine
    OpenStack
    Parallels
    QEMU
    VirtualBox
    VMware
    Custom
    14 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

15. PROVISIONER
    যڃ بҳ۽ ੉޷૑ܳ ٜ݅ Ѫੋ
    15 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

16. Remote Shell
    Local Shell
    PowerShell
    Windows Shell
    Ansible
    Chef
    Puppet
    Salt
    Windows Restart
    Custom
    16 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

17. TEMPLATE
    PACKER੄ ׮নೠ ஹನք౟ܳ ੿੄ೞח JSON ౵ੌ
    17 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

18. TEMPLATE
    {
    "builders": [{
    // ...
    }],
    "provisioners": [{
    // ...
    }],
    "post-processors": [{
    // ...
    }]
    }
    18 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

19. DOCKER
    19 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

20. EXAMPLE - SHELL / DOCKER
    {
    "builders": [{
    "type": "docker"
    // ...
    }],
    "provisioners": [{
    "type": "shell"
    // ...
    }],
    "post-processors": [{
    "type": "docker-import"
    // ...
    }]
    }
    20 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

21. BUILDER - DOCKER
    {
    "type": "docker",
    "image": "ubuntu:14.04",
    "export_path": "nacyot-ubuntu-wget.tar"
    }
    21 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

22. PROVISIONER - SHELL
    {
    "type": "shell",
    "inline": [
    "apt-get update",
    "apt-get install -y wget"
    ]
    }
    22 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

23. POST-PROCESSOR - DOCKER IMPORT
    {
    "type": "docker-import",
    "repository": "nacyot/ubuntu",
    "tag": "wget"
    }
    23 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

24. {
    "builders": [{
    "type": "docker",
    "image": "ubuntu:14.04",
    "export_path": "nacyot-ubuntu-wget.tar"
    }],
    "provisioners": [{
    "type": "shell",
    "inline": [
    "apt-get update",
    "apt-get install -y wget"
    ]
    }],
    "post-processors": [{
    "type": "docker-import",
    "repository": "nacyot/ubuntu",
    "tag": "wget"
    }]
    }
    24 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

25. packer build ./template.json
    docker output will be in this color.
    ==> docker: Creating a temporary directory for sharing data...
    ==> docker: Pulling Docker image: ubuntu:14.04
    docker: 14.04: Pulling from ubuntu
    ...
    25 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

26. Build End
    ...
    ==> docker: Exporting the container
    ==> docker: Killing the container: f0e28c4f
    ==> docker: Running post-processor: docker-import
    docker (docker-import): Importing image: Container
    docker (docker-import): Repository: nacyot/ubuntu:wget
    docker (docker-import): Imported ID: 6b773d2f
    Build 'docker' finished.
    $ docker images
    REPOSITORY TAG IMAGE ID CREATED VIRTUAL SIZE
    nacyot/ubuntu wget 6b773d2f87b4 About a minute ago 190.5 MB
    26 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

27. NEW DOCKER IMAGE
    nacyot/ubuntu:wget
    27 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

28. ubuntu:14.04
    $ docker run -it ubuntu:14.04 bash
    root@79b1000960e5:/# wget --version
    bash: wget: command not found
    nacyot/ubuntu:wget
    ec2-user at ip-172-17-103-250 in ~
    $ docker run -it nacyot/ubuntu:wget bash
    root@2767bc99a7fc:/# wget --version
    GNU Wget 1.15 built on linux-gnu.
    28 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

29. AWS AMI
    29 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

30. EXAMPLE - ANSIBLE / AMAZON AMI
    {
    "builders": [{
    "type": "amazon-ebs"
    // ...
    }],
    "provisioners": [{
    "type": "ansible-local"
    // ...
    }]
    }
    30 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

31. BUILDER - AMAZON AMI
    {
    "type": "amazon-ebs",
    "access_key": "",
    "secret_key": "",
    "region": "ap-northeast-1",
    "source_ami": "ami-cbf90ecb",
    "instance_type": "m3.medium",
    "ssh_username": "ec2-user",
    "ami_name": "CustomImage {{isotime | clean_ami_name}}"
    }
    31 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

32. PROVISIONER - ANSIBLE
    {
    "type": "ansible-local",
    "playbook_file" : "ansible/playbook.yml",
    "playbook_dir": "/Users/../ansible"
    }
    32 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

33. {
    "builders": [{
    "type": "amazon-ebs",
    "access_key": "",
    "secret_key": "",
    "region": "ap-northeast-1",
    "source_ami": "ami-cbf90ecb",
    "instance_type": "m3.medium",
    "ssh_username": "ec2-user",
    "ami_name": "CustomImage {{isotime | clean_ami_name}}"
    }],
    "provisioners": [{
    "type": "ansible-local",
    "playbook_file" : "ansible/playbook.yml",
    "playbook_dir": "/Users/../ansible"
    }]
    }
    33 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

34. packer build ./template.json
    34 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

35. Build Start
    $ packer build ./tempalte.json
    amazon-ebs output will be in this color.
    ==> amazon-ebs: Inspecting the source AMI...
    ==> amazon-ebs: Creating temporary keypair: packer 55e9b978-5a49...
    ==> amazon-ebs: Creating temporary security group for this instance...
    ==> amazon-ebs: Authorizing SSH access on the temporary security group...
    ==> amazon-ebs: Launching a source AWS instance...
    amazon-ebs: Instance ID: i-12345678
    ==> amazon-ebs: Waiting for instance (i-12345678) to become ready...
    ...
    35 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

36. Build End
    ...
    ==> amazon-ebs: Stopping the source instance...
    ==> amazon-ebs: Waiting for the instance to stop...
    ==> amazon-ebs: Creating the AMI: CustomImage 2015-09-04T15-32-08Z
    amazon-ebs: AMI: ami-12345678
    ==> amazon-ebs: Waiting for AMI to become ready...
    ==> amazon-ebs: Terminating the source AWS instance...
    ==> amazon-ebs: Deleting temporary security group...
    ==> amazon-ebs: Deleting temporary keypair...
    Build 'amazon-ebs' finished.
    ==> Builds finished. The artifacts of successful builds are:
    --> amazon-ebs: AMIs were created:
    ap-northeast-1: ami-12345678
    36 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

37. NEW AMI IMAGE
    ami-12345678
    37 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

38. INFRASTRUCTURE AS CODE
    ੷੢ࣗীࢲ ҙܻೞӝ
    38 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

39. REPOSITORY
    PACKER TEMPLATE
    ANSIBLE PLAYBOOK
    39 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

40. IMAGE UPDATE?
    BASE IMAGE ߸҃
    ANSIBLE PLAYBOOK ߸҃
    40 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

41. BUILDING IMAGE WITH CI
    41 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

42. 42 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

43. ALWAYS Latest IMAGE
    43 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

44. VAGRANT
    ࢤпա૑ ঋਵࣁਃ?
    44 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

45. PACKER
    BUILDER / PROVISIONER
    VAGRANT
    PROVIDER / PROVISIONER
    45 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

46. VAGRANT
    DEVELOPMENT
    46 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

47. PACKER
    DEPLOYMENT
    47 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

48. Vagrantfile
    Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
    config.vm.box = 'dummy'
    config.vm.provider :aws do |aws, override|
    # ...
    end
    config.vm.provision 'ansible' do |ansible|
    # ...
    end
    end
    48 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

49. UP
    $ vagrant Up
    UPDATE
    $ vagrant provision
    49 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide

50. THANK YOU!
    @NACYO_T
    50 — Packerܳ ాೠ AMI ੗ز ࠽٘ दझమ ҳ୷ © nacyot 2015 -
    

    View Slide