JAWS-UGおコンテナ支部 #5 発表資料 http://jawsug-container.connpass.com/event/32298/
hako: https://github.com/eagletmt/hako
&$4Λར༻ͨ͠σϓϩΠڥ,PIFJ4V[VLJ
View Slide
.F• @eagletmt• ΫοΫύου ٕज़෦։ൃج൫άϧʔϓ• Docker Λར༻ͨ͠ΞϓϦέʔγϣϯαʔόج൫ͷ։ൃɺӡ༻
ΞτϥΠϯ• ΫοΫύουͱ Docker• Docker ΞϓϦͷσϓϩΠํ๏ v1• ECS ҎલͷσϓϩΠํ๏• Docker ΞϓϦͷσϓϩΠํ๏ v2• ECS Λར༻ͨ͠σϓϩΠπʔϧ Hako ͷ։ൃ• Hako ΛͬͨσϓϩΠڥ
ΫοΫύουͱ%PDLFS• 20149݄ࠒ͔Β Docker ͷར༻Λݕ౼• ͕ࣗ৽نʹ։ൃ͢Δখ͍͞ Web API ΞϓϦέʔγϣϯΛύΠϩοτϓϩδΣΫτͱ͠ɺ12݄͔Βར༻։࢝
ΫοΫύουͱ%PDLFS• 2015͔Βɺ৽نͷ Web ΞϓϦέʔγϣϯجຊతʹ Docker Λར༻ͨ͠ڥ (v1) Ͱಈ࡞• 20166݄ݱ࣌ʹ͓͍ͯɺ• ຊ൪Քಈ͍ͯ͠ΔαʔϏε͕ 11 ݸ• εςʔδϯά༻్ʹ 14 ݸ• ࣾαʔϏεʹ 8 ݸ
ΫοΫύουͱ%PDLFS• 20159݄ࠒ͔Β ECS Λར༻ͨ͠৽ߏ (v2) Λݕ౼• 20161݄͔ΒࣾαʔϏεͰར༻։࢝• 5݄͔Βຊ൪Ͱར༻։࢝͠ɺݱ࣌Ͱ• ຊ൪Քಈ͍ͯ͠ΔαʔϏε͕ 2 ݸ• εςʔδϯά༻్ʹ 10 ݸ• ࣾαʔϏεʹ 21 ݸ
%PDLFSΞϓϦͷσϓϩΠํ๏W
&$4Λ͍࢝ΊΔલ• σϓϩΠํ๏Λߟ͑ɺϗετଆʹσϓϩΠεΫϦϓτΛ༻ҙ͢Δ͜ͱʹͨ͠• ඞཁͳ͜ͱ• Web ΞϓϦέʔγϣϯͷσϓϩΠΛແఀࢭͰߦ͏• σϓϩΠશ։ൃऀ͕ߦ͏͜ͱ͕Ͱ͖Δ• ։ൃऀʹൿಗ (DB ύεϫʔυͳͲ) Λݟͤͳ͍• ൿಗڥมͱͯ͢͠
σϓϩΠํ๏ W• 1ͭͷϗετʹ1ͭ·ͨෳͷ Docker ίϯςφ• ϗετଆʹ nginx Λ1ͭىಈ͠ɺHost ϔομͰίϯςφʹৼΓ͚• σϓϩΠ࣌ɺίϯςφΛ৽نʹىಈ͠ɺnginx ͷઃఆΛมߋͯ͠Ϧϩʔυ͠ɺݹ͍ίϯςφΛఀࢭ͢Δ• ৄ͘͠ http://techlife.cookpad.com/entry/2015/04/20/134758
σϓϩΠํ๏ WOHJOYBQQTFSWFSDPOUBJOFSWEFQMPZTDSJQU
σϓϩΠํ๏ WOHJOYBQQTFSWFSDPOUBJOFSWDPOUBJOFSWEFQMPZTDSJQUdocker run
σϓϩΠํ๏ WOHJOYBQQTFSWFSDPOUBJOFSWDPOUBJOFSWEFQMPZTDSJQUIFBMUIDIFDL
σϓϩΠํ๏ WOHJOYBQQTFSWFSDPOUBJOFSWDPOUBJOFSWEFQMPZTDSJQUnginx -s reload
σϓϩΠํ๏ WOHJOYBQQTFSWFSDPOUBJOFSWEFQMPZTDSJQUdocker stop
WͷΑ͔ͬͨ• Πϯϑϥ͕ Itamae ͰΞϓϦέʔγϣϯຖʹϓϩϏδϣχϯά͢Δख͕ؒͳ͘ͳͬͨ• ڞ௨ͷϗετͷ্ʹ༷ʑͳίϯςφ͕ಈ͘• ΞϓϦέʔγϣϯαʔόͷΦʔτεέʔϧ͕͘͢͠ͳͬͨ• શ͘ಉ͡ํ๏ͰɺͲΜͳΞϓϦέʔγϣϯεέʔϧΠϯɾεέʔϧΞτͰ͖Δ
Wͷ೦ͩͬͨ• σϓϩΠઌͷϗετͷࢦఆ͕ਓྗ• EC2 λάʹࢦఆ͍ͯͨ͠• ৽نͷαʔϏεΛՃ͢Δͱ͖ɺۭ͍ͯͦ͏ͳΠϯελϯεʹλάΛ͚ͭΔ͔ɺ৽نʹىಈ͢Δඞཁ͕͋ͬͨ• ΞϓϦέʔγϣϯαʔόҎ֎ʹඞཁͳͷ͋Δ• RDSɺRoute53ɺELBɺCapistrano ͷઃఆ• ڥมͷՃ
&$4Խ• ECS Λར༻͢Δ͜ͱͰɺσϓϩΠઌͷ੍ޚΛͤΔ͜ͱ͕Ͱ͖Δ• EC2 λά͔Βͷղ์• ECS Խʹ͋ͨͬͯൿಗͷѻ͍Λߟ͑Δ• task definition Ӆͭͭ͠ɺผͷετϨʔδ͔ΒൿಗΛೖ͢Δඞཁ͕͋Δ
&$4Խ• Route53 ͦͷଞͷઃఆ ECS ͚ͩͰ݁͠ͳ͍• ECS Λར༻ͭͭ͠ɺൿಗͷೖؔ࿈͢ΔϦιʔεઃఆΛૢ࡞͢ΔσϓϩΠπʔϧ͕ඞཁ• => Hako ͷ։ൃ
)BLP• Docker ίϯςφΛσϓϩΠ͢ΔͨΊͷπʔϧ• ࠓͷͱ͜Ζ ECS ͷΈʹରԠ• ΞϓϦέʔγϣϯͷఆٛΛ YAML Ͱهड़• ൿಗΛؚΉڥมΛѻ͑Δ• σϓϩΠ࣌ʹ༷ʑͳॲཧΛࠩ͠ࠐΉ͜ͱ͕Ͱ͖Δ
ઃܭϙϦγʔ• Ͱ͖Δ͚ͩ੩తͳఆٛʹ͢Δ• ఆٛ (ઃఆ) YAML Ͱɺίʔυ Ruby Ͱ• ఆٛͦͷ··ͰɺRuby Ҏ֎Ͱ࣮Ͱ͖Δܗ• ϓϥΨϒϧʹ͢Δ• Docker ʹඞཁͳͷͷΈίΞʹؚΊΔ• ͦΕҎ֎ͷίʔυϓϥάΠϯͱͯࠩ͠͠ସ͑Մೳʹ͢Δ
ΞϓϦέʔγϣϯఆٛscheduler:<<: !include schedulers/internal_default.ymldesired_count: 1app:image: 01234567890.dkr.ecr.us-east-1.amazonaws.com/camocpu: 128memory: 128port: 8080env:$providers:- <<: !include env_providers/etcenv.ymlroot: /envs/hako/camoCAMO_KEY: '#{CAMO_KEY}'CAMO_KEEP_ALIVE: 'true'additional_containers:front:!include containers/front.ymlconsul-register:!include containers/consul_register_internal.ymlscripts:- type: jenkins_tagjob: docker-camo- !include scripts/route53_subdomain_shared.yml- !include scripts/nginx_omniauth.yml- type: consul_register
σϓϩΠํ๏ W• Hako::Schedulers::Ecs• ECS ্ʹ serviceɺtask definitionɺELB Λ࡞• σϓϩΠ࣌ʹɺtask definition ͱ service Λߋ৽• ͓ͦΒ͘ ECS ͷී௨ͷ͍ํ
σϓϩΠํ๏ W• YAML ͷఆٛͱ DescribeTaskDefinition ͷ݁ՌΛൺֱ• ඞཁʹԠͯ͡ RegisterTaskDefinition Ͱߋ৽• CreateService / UpdateService Ͱࢦ͍ͯ͠Δ taskdefinition Λߋ৽• CreateService ࣌ʹ ELB ࡞͢Δ
σϓϩΠํ๏ W&-#UBTLW TFSWJDFIBLP
σϓϩΠํ๏ W&-#UBTLW UBTLWTFSWJDFIBLP3FHJTUFS5BTL%FpOJUJPO6QEBUF4FSWJDF
σϓϩΠํ๏ W&-#UBTLWTFSWJDFIBLP
σϓϩΠํ๏ WࣾαʔϏε൛• ͜ͷํ๏ͩͱ service ຖʹ ELB ͕ඞཁ• ͚ࣾͷࡶαʔϏεͰຖճ ELB Λ࡞Δ…?• ڞ௨ͷ ELB Λ͍ͭͭɺϦόʔεϓϩΩγͷઃఆΛ͍͍͔Μ͡ʹมߋ͢ΔΑ͏ͳผͷϞʔυΛ࣮• ࣾͷผͷج൫ʹґଘ͍ͯ͠ΔͷͰίʔυඇެ։• Hako ͳΒσϓϩΠ෦͚ͩࠩ͠ସ͑Δ͜ͱ͕Մೳ
શମߏ WࣾαʔϏε൛OHJOY&-#UBTLUBTLUBTL UBTLSFWFSTFQSPYZDPOUBJOFSJOTUBODFT
σϓϩΠํ๏ WࣾαʔϏε൛OHJOYUBTLWDPOTVMIBLPTFSWJDFW
σϓϩΠํ๏ WࣾαʔϏε൛OHJOYUBTLWDPOTVMIBLPTFSWJDFWUBTLWTFSWJDFW3FHJTUFS5BTL%FpOJUJPO$SFBUF4FSWJDF
σϓϩΠํ๏ WࣾαʔϏε൛OHJOYUBTLWDPOTVMIBLPTFSWJDFWUBTLWTFSWJDFWSFHJTUFS
σϓϩΠํ๏ WࣾαʔϏε൛OHJOYUBTLWDPOTVMIBLPTFSWJDFWUBTLWTFSWJDFWDPOTVMUFNQMBUFnginx -s reload
σϓϩΠํ๏ WࣾαʔϏε൛OHJOYDPOTVMIBLPUBTLWTFSWJDFW%FMFUF4FSWJDFEFSFHJTUFSDPOTVMUFNQMBUFnginx -s reload
ൿಗͷѻ͍• ڥมʹมͷΑ͏ʹຒΊࠐΉ͜ͱ͕Ͱ͖Δ• DATABASE_URL: 'mysql2://#{user}:#{pass}@db-nanika-001/nanika'• มσϓϩΠ࣌ʹผͷετϨʔδ͔Βऔಘ• ͨͱ͑ etcenv Λ͏߹• https://github.com/eagletmt/hako-etcenv• user ͷॴʹ /hako/nanika/user ͷ͕ೖΔ
)BLPΛͬͨσϓϩΠڥ
)BLPΛͬͨσϓϩΠڥ• ΞϓϦέʔγϣϯఆ͚ٛͩΛؚΉϦϙδτϦhako_apps Λ༻ҙ• ڥมͳͲΛมߋ͍ͨ͠ͱ͖ɺ։ൃऀ͕ࣗ༝ʹpull-requestɺmerge• ൿಗΛՃ͍ͨ͠ͱ͖ͷΈΠϯϑϥʹґཔ
)BLPΛͬͨσϓϩΠڥ• σϓϩΠίϚϯυͷ࣮ߦʹ Rundeck Λར༻• app αʔόͰ࣮ߦ͢ΔίϚϯυ͕ແ͍ͷͰɺCapistrano Λ͏ඞཁ͕ͳ͍• Rundeck ্ͰδϣϒΛ࣮ߦ͢Δͱɺ• git clone git@repository:hako_apps.git• cd hako_apps && hako deploy nanika.yml
όονॲཧ• hako oneshot Ͱ service ΛΘͣʹɺRunTask Ͱ୯ൃͷλεΫΛ࣮ߦͰ͖Δ• ࣾͰ kuroko2 ͷλεΫͱ࣮ͯ͠ߦͰ͖ΔΑ͏ʹඋ• kuroko2 ʹ͍ͭͯ http://techlife.cookpad.com/entry/2015/12/07/195732
σϓϩΠ࣌ͷϑοΫ• Hako Ͱ script ͱݺশ• σϓϩΠ࣌ʹͬͯΔ͜ͱ• Route53 ͷࣗಈઃఆ• nginx ίϯςφͷΞΫηε੍ݶͷઃఆ• σϓϩΠ͢ΔΠϝʔδͷϦϏδϣϯΛ Jenkins ͷ݁Ռ͔Βܾఆ• ʑ
Φʔτεέʔϧ• AutoScaling Group Λར༻͠ɺΫϥελ͝ͱʹΠϯελϯεΛ૿ݮͰ͖ΔΑ͏ʹ• ࠓͷͱ͜ΖεέʔϧΠϯͤͣɺσϓϩΠ࣌(service ͷ࡞ɺߋ৽࣌) ʹΠϯελϯεͷΩϟύγςΟ͕Γͯͳ͔ͬͨΒɺAutoScaling Group ͷΩϟύγςΟΛ্͛ͯεέʔϧΞτ
ϩΪϯά• Docker ͷ log driver ΛࢦఆͰ͖Δ• fluentd log driver Λͬͯɺϗετଆʹ fluentd Λཱͯͯɺ͔ͦ͜Β CloudWatch Logs సૹ• service ໊ίϯςφ໊Λ log stream ͷ໊લʹؚΊΔΑ͏ʹ͍ͯ͠Δ• దͳΞϓϦͰαʔϏε͝ͱʹϩάΛӾཡͰ͖ΔΑ͏ʹ
)BLPʹͳͬͯΑ͔ͬͨ• ΠϯελϯεΛखಈͰ࡞͠ͳͯ͘Α͍• AutoScaling Group ͷΩϟύγςΟΛ૿͚ͩ͢• ΞϓϦέʔγϣϯͷఆٛΛɺ։ൃऀ͕ࣗ༝ʹӾཡɾߋ৽Ͱ͖ΔΑ͏ʹͳͬͨ• ґཔͰͳ͘ pull-request ʹ• Route 53 ͷઃఆͳͲɺయܕతͳ࡞ۀΛࣗಈԽͰ͖ͨ• ݁ՌɺؾܰʹࣾΞϓϦ͕࡞ΒΕΔΑ͏ʹͳͬͨ
ࠓޙͷల• ϩΪϯάΛվળ͍ͨ͠• ΞϓϦέʔγϣϯͷϩάΛଈ࠲ʹ֬ೝ͍ͨ͠ͱ͖͕͋Δ͕ɺݱঢ়Ͱ͖͍ͯͳ͍• CloudWatch Logs ʹอଘ͢Δͷͦͷ··Ͱɺಉ࣌ʹใΛϩʔΧϧϑΝΠϧʹॻ͘Α͏ʹ͢Δ?
ࠓޙͷల• ECS Ҏ֎ͷαϙʔτ?• ͪΐ͏ͲઌिɺDocker 1.12 Ͱ orchestration ػೳͷڧԽ͕ൃද͞Εͨ• ͜ͷ service Λ Hako ͔Β੍ޚͰ͖ΔͱΑͦ͞͏• https://blog.docker.com/2016/06/docker-1-12-built-in-orchestration/
eagletmt
oracle4engineer
smasato
kawagoi
orimanabu
coconala_engineer
takasehideki
koheiawa
kazukihayase
moritamasami
nwiizo
masaaki_k
okamototakuyasr2
jakevdp
andyhume
geeforr
lara
rmw
sstephenson
bkeepers
akmur
mza
palkan
rasmusluckow
jrom