効率的なdocker build用directory構造について

Transcript

1. 効率的なDocker build用 のdirectory構造について
2. 自己紹介 名前:金世和(@negabaro) DevOPsエンジニア 韓国人
3. やりたいこと • インフラにかかわるすべての設定をコード化したい • 一つのリポジトリー上で複数のautomation build機能を実 現したい • Git->circleCI経由でdocker build,push,deployまで実現した い • 特定ブランチにpushした場合のみ発動してほしい • 柔軟性のある構造にしたい
4. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
5. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
6. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
7. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
8. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
9. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
10. • Git push -> circleCI -> git diff -> Docker build -> docker run - > docker test -> docker push -> aws ecs create task def -> aws ecs update task def
11. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
12. circle.yml deployment: develop: branch: develop commands: - sh docker/run_deploymnet.sh: timeout: 1500 betax: branch: betax commands: - sh docker/run_deploymnet.sh: timeout: 1500 staging: branch: staging commands: - sh docker/run_deploymnet.sh: timeout: 1500 production: branch: production commands: - sh docker/run_deploymnet.sh: timeout: 1500
13. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
14. git diff使用例 #!/bin/sh changed_files="$(git diff-tree -r --name-only --no-commit-id ORIG_HEAD)“ branch_name="${CIRCLE_BRANCH}" updated_nginx_status=false updated_unicorn_status=false updated_td-agent_status=false updated_rails_status=false for var in $changed_files do if [[ $var =~ ^docker/nginx/$branch_name ]]; then updated_nginx_status =true elif [[ $var =~ ^docker/unicorn/$branch_name ]]; then updated_unicorn_status=true elif [[ $var =~ ^docker/td-agent/$branch_name ]]; then updated_td-agent_status =true else updated_rails_status=true fi done
15. git diff使用例 #!/bin/sh if [ $updated_nginx_status ]; then sh docker/nginx/$branch_name/build_docker.sh //docker build sh docker/nginx/$branch_name/run_docker.sh sh docker/nginx/$branch_name/test/run_test.sh sh docker/nginx/$branch_name/push_docker.sh else fi if [ $updated_unicorn_status ]; then sh docker/unicorn/$branch_name/build_docker.sh sh docker/unicorn/$branch_name/run_docker.sh sh docker/unicorn/$branch_name/test/run_test.sh sh docker/unicorn/$branch_name/push_docker.sh else fi
16. rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def
17. build_docker.sh PR_NUMBER ="${CIRCLE_PR_NUMBER}" // CIRCLE_PR_NUMBER環境変数をタグで利用 Docker build –t [ECR-EndPoint]/[ECR-Image]:PR_NUMBER –t [ECR-EndPoint]/[ECR- Image] –file Dockerfile . //docker build Docker repositoryはAWS ECRを使う
18. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
19. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
20. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
21. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
22. Git push -> circleCI -> git diff -> Docker build -> docker run -> docker test -> docker push -> aws ecs create task def -> aws ecs update task def rails_root docker nginx unicorn development beta staging productoon files Build_docker.s h Run_docker.sh Push_docker.s h deploy create_task_de f.sh task_def.templ ate update_task_d ef.sh dynamic_gen_t ask_def_json.s h shared test memcached redis elasticsearch td-agent mysql base Run_deployme nt.sh docker- compose.yml
23. dynamic_gen_task_def_json.sh + task_def.template #!/bin/sh cd docker/unicorn/$BRANCH/deploy/ envsubst '¥$CIRCLE_PR_NUMBER' < task_def.template > task_def.json dynamic_gen_task_def_json.sh { "containerDefinitions": [ { "name": "unicorn", "image": “xx.dkr.ecr.ap-northeast-1.amazonaws.com/xx:${CIRCLE_PR_NUMBER}", "essential": true, … task_def.template
24. create_task_def.sh #!/bin/sh cd docker/unicorn/$BRANCH/deploy/ sh dynamic_gen_task_def_json.sh aws ecs register-task-definition --cli-input-json file://task-def.json create_task_def.sh
25. update_task_def.sh 以下を参考 https://github.com/silinternational/ecs-deploy TASK_REVISIONS=`aws ecs list-task-definitions --family-prefix [family_name] --status ACTIVE --sort ASC` NUM_ACTIVE_REVISIONS=$(echo "$TASK_REVISIONS" | jq ".taskDefinitionArns|length") OUTDATED_REVISION_ARN=$(echo "$TASK_REVISIONS" | jq -r ".taskDefinitionArns[NUM_ACTIVE_REVISIONS-1]") aws ecs update-service --cluster [cluaster_name] --service-name [service_name] --task-definition $OUTDATED_REVISION_ARN update_task_def.sh
26. Docker Directory構造 rails_root docker nginx unicorn development beta staging productoon files Build_docker.sh Run_docker.sh Push_docker.sh deploy create_task_def. sh task_def.templa te update_task_def .sh dynamic_gen_ta sk_def_json.sh shared test memcached redis elasticsearch td-agent mysql base docker- compose.yml
27. Base Directory Ubuntu:14.04 Ruby:2.3.3 Unicorn:xxx common
28. Base Directory rails_root docker nginx unicorn base ruby 2.3.1 build_docker.sh 2.3.3 build_docker.sh php nginx unicorn-common docker- compose.yml
29. Question?? • 不明な点あればご連絡ださい。 https://twitter.com/negabaro • https://www.facebook.com/negabaro • negabaro@gmail.com
30. ご清聴ありがとうござい ました。 終わり