Share
Embed
インフラエンジニアがConsulとStretcherをつかったデプロイ改善で開発効率の向上に貢献した話(短縮版 + α) / omotesando.rb #33
Shuichi Ohsawa
April 05, 2018
Transcript
20 slides
-
ΠϯϑϥΤϯδχΞ͕ ConsulͱStretcherΛ͔ͭͬͨσϓϩΠվળͰ ։ൃޮͷ্ʹߩݙͨ͠ (ॖ൛ + α) දࢀಓ.rb #33 ~Deploy~ Shuichi
Ohsawa (@ohsawa0515) 1/20 -
ࣗݾհ • େᖒलҰ (@ohsawa0515) • Blogͬͯ·͢ http://blog.jicoman.info/ • Sansanגࣜձࣾ Data
Strategy & Operation Center • σʔλԽγεςϜͷΠϯϑϥߏஙɾӡ༻ɾվળɺ͓ۚ ͷܭࢉͳͲΛ୲ • AWSϦιʔεͷແବݣ͍͍ͯ͠ΔਓΛಛఆ͠ҙ͢Δਓ • ༻ݴޠ: PHP(ݩͪͺʔ), Golang(গ͠), Ruby(গ͠) • RubyFluentdϓϥάΠϯͱ͔ͭͬͨ͘͜ͱ͋Δ͚Ͳ͋·Γॻ͚ͳ͍ • GolangͰAutoScaling + Blue-Green Deployment πʔϧ͚ͭͬͨ͘Ͳ͋·Γॻ͚ͳ͍ 2/20 -
ΞδΣϯμ • αʔόߏ • ΞϓϦέʔγϣϯߏ • ैདྷͷσϓϩΠͱ՝ • ৽σϓϩΠ •
σϓϩΠϑϩʔ • ൿಗใͷ҉߸Խɾ෮߸ (+αͷ෦) 4/20 -
αʔόߏ • ϩʔϧ • WebɺBatchɺDeploy etc • Webαʔό • ELB
+ EC2(c3.2xlarge × 20ऑ) • Batchαʔό • EC2(r3.xlarge × 20ڧ) • Deployαʔό • Web/BatchαʔόʹσϓϩΠ 5/20 -
ैདྷͷσϓϩΠ • ఆظϦϦʔε(िҰ) • ͯ͢ͷRailsΞϓϦΛσϓϩΠ • ඞཁʹԠͯ͡hotfixϦϦʔε(िʹճ) • ඞཁͳΞϓϦ͚ͩσϓϩΠ •
Web/BatchαʔόશҰ੪ʹσϓϩΠ • σϓϩΠαʔό͔Β࣮ߦ • PushܕσϓϩΠ/In place/All at once 7/20 -
ैདྷͷσϓϩΠ • σϓϩΠεΫϦϓτ(Rakefile)ͰσϓϩΠ࣮ߦ • Capistrano 2ϕʔε • ΞϓϦຖʹCapλεΫϑΝΠϧͷੜ • ฒྻͰෳΞϓϦΛσϓϩΠ
• ϩʔϧChef ServerͷλάͰཧ • Web, BatchͰॲཧ͕ҟͳΔͨΊϩʔϧͰ۠ผ • knife tagίϚϯυͰ͚֎͢͠Δ 8/20 -
Capistrano + Stretchr + Consul • PullܕσϓϩΠ • αʔό͕ࣗσϓϩΠ͢Δ •
σϓϩΠ͕࣌ؒҰఆ(ʹൺྫ͠ͳ͍) • Amazon S3ʹϏϧυࡁͷϑΝΠϧΛஔ • μϯϩʔυ͠ஔɺ࠶ىಈ͢Δ͚ͩͰσϓϩΠྃ • S3ͷՄ༻ੑ99.99ˋ • In place/All at once • CapistarnoͷΈ(γϯϘϦοΫϦϯΫʹΑΔΓସ͑)Λ׆༻ • ConsulʹΑΔαʔϏεσΟεΧόϦػೳͰϗετͷొɾআࣗಈ 10/20 -
Capistrano • ݱߦͷCapistrano 2ͷεΫϦϓτΛվम • capistrano-stretcher Capistrano 3ͷΈରԠͳͷͰݟૹΓ •
https://github.com/pepabo/capistrano-stretcher • Capistrano͔ΒStretcher + ConsulΛݺͼग़ͯ͠σϓϩΠ • ࢀߟʹͭͭ͠ॲཧΛ࣮ • ࠓ·Ͱ࣮ߦ͖ͯͨ͠capίϚϯυΛେ͖͘ม͑͗͢ͳ͍Α͏ʹ 11/20 -
Stretcher • https://github.com/fujiwara/stretcher • ConsulͱΈ߹ΘͤΔ͜ͱͰɺΠϕϯτΛτϦΨʔͱͨ͠PullܕσϓϩΠ͕Մೳ • ࠾༻ͨ͠ཧ༝ ! • ෳΞϓϦΛҰ੪ʹσϓϩΠͯ͠ૣ͍
• 20ऑͷRailsΞϓϦΛฒྻσϓϩΠ͢Δͱ1ʙ2ఔͰऴΘΔ • ෳͷઃఆϑΝΠϧ(ϚχϑΣετϑΝΠϧ)Λ༻ҙ͢Δ͜ͱͰɺৼΔ͍Λม͑Δ͜ͱ͕Ͱ͖Δ • σϓϩΠϑΝΠϧஔ༻ • γϯϘϦοΫϦϯΫସ༻ • Consulͱͷੑ͕ߴ͍ 12/20 -
Consul • https://www.consul.io/ • HashiCorpࣾఏڙͷΦʔέετϨʔγϣϯπʔϧ • αʔόͱΫϥΠΞϯτͱ͍͏̎ͭͷׂͰߏ͞ΕɺΫϥελΛܗ͢Δ • োݕɺ෦DNSɺKey/ValueετΞ(KVS) •
Πϕϯτൃߦ • ֤ConsulΫϥΠΞϯτΠϕϯτΛͪड͚͍ͯΔঢ়ଶͰɺಛఆͷΠϕϯτ͕ൃߦ͞ΕͨΒҙͷΞΫγϣϯΛ࣮ ߦ • αʔϏελάʹΑΔϩʔϧཧ • αʔϏεσΟεΧόϦ • ىಈ࣌ʹΫϥελࣗಈδϣΠϯ 13/20 -
·ͱΊͯσϓϩΠ͢Δ ͯ͢ͷΞϓϦΛϚϧνεϨουͰฒྻσϓϩΠ task deploy_all: :setup do deploy_projects = "application_A,apllication_B,..." threads_count
= ENV['THREADS'] Parallel.map(deploy_projects, in_threads: threads_count.to_i) do |project| # ϏϧυαʔόͷσϓϩΠ # ϚχϑΣετϑΝΠϧͷੜ # S3ͷΞοϓϩʔυ # ΞϓϦέʔγϣϯαʔόʹ end end task release_all: :setup do deploy_projects = "application_A,apllication_B,..." threads_count = ENV['THREADS'] Parallel.map(deploy_projects, in_threads: threads_count.to_i) do |project| # σϓϩΠ(γϯϘϦοΫϦϯΫସ) end end 15/20 -
݁Ռ 1. σϓϩΠʹ͕͔͔࣌ؒΔ • => ϦϦʔε࣌ؒͷॖ(30->5) 2. αʔόͷՃ͕໘ • =>
࠷৽ͷσϓϩΠϑΝΠϧΛ࣋ͬͯ͘Δ͚ͩ 3. GitHub/RubyGems͕མͪΔͱσϓϩΠͰ͖ͳ͍ • => S3ͳͷͰ΄΅ͳ͠ 17/20 -
ൿಗใͷ҉߸Խɾ෮߸ • DBύεϫʔυΩʔใΛઃఆϑΝΠϧ(YAML)ʹੜͰॻ͍͓ͯ ͘ͷةݥ • ൿಗใΛEC2 Parameter Storeʹอ͓͖࣋ͯ͠ɺઃఆϑΝΠϧ ʹEC2 Parameter
Storeͷσʔλ໊ʹஔ͖͑ • σϓϩΠ࣌ʹ෮߸͠ઃఆϑΝΠϧΛॻ͖͑ • σϓϩΠαʔό͔͠෮߸Ͱ͖ͳ͍Α͏ʹKMSͷIAMݖݶΛઃఆ 18/20