Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
日々の運用をconsulで楽にし隊
Search
tjinjin
February 21, 2016
Technology
490
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
日々の運用をconsulで楽にし隊
社内勉強会の資料です
tjinjin
February 21, 2016
Transcript
115 slides
ʑͷӡ༻ΛConsulͰָʹ͠ୂ ~एऀເΛݟΔ~ 2016/2/19 tjinjin
Who? • feedforce, Inc. • Infrastructure engineer • twitter :
cross_black777 • github : tjinjin
φͰϠϯάͳڥΛ ࡞Γ·͢ʢʆΣ´ʣ
ࠓͷ͓ • Consulͷجૅ • σϓϩΠͷ • ϓϩϏδϣχϯάͷ • ʑͷӡ༻ͷ •
σϞʁ
ࠓ͞ͳ͍͜ͱ • ࠓظΠνΦγΞχϝͷ • γϦίϯόϨʔࣜμΠΤοτͷ • SHIROBAKOʹ͓͚ΔٶकͷϓϩϑΣογϣ φϦζϜͱ
Consulͷجૅ
Consulͱ • Hashicorp • αʔόಉ࢜ͰΫϥελΛΜͰɺͦͷΫϥελ ʹର͍͠ΖΜͳ͜ͱ͕Ͱ͖Δ
͏গ͠ৄ͘͠ • ىಈ࣌ͷΦϓγϣϯͰServer/ClientϞʔυʹ ͔ΕΔ • ServerͰىಈͨ͠Consulͷத͔ΒLeaderΛબ ग़͢Δɻ • ͦͷLeaderΛத৺ʹΫϥελ͕ػೳ͢Δ
https://www.consul.io/docs/internals/architecture.html
ઃఆϑΝΠϧ { "server": true, "client_addr": "0.0.0.0", "bootstrap_expect": 3, "data_dir": "/var/consul/data",
"watches": [ { "type": "event", "name": "deploy_bastion_development", "handler": "stretcher" } ] }
bootstrap-expect • consulΫϥελʹServerϊʔυ͕͜ͷࢦఆΛ ͨ͠ʹୡͨ࣌͠ʹLeaderͷબग़͕ߦΘΕ Δɻ
consul watch • ಛఆͷมԽΛݕͯ͠ɺॲཧΛ࣮ߦ͢Δ • event/nodes/serviceͳͲͳͲɽɽɽ
Ϋϥελͷ࡞Γํ
Ϋϥελͷ࡞Γํ • Ϋϥελͷؔʹ͍ͨ͠αʔόʢͲͪΒͰ ՄʣͰconsul joinίϚϯυୟ͘ • ىಈ࣌ʹstart_joinΦϓγϣϯΛࢦఆ͢Δͱࣗ ಈͰΫϥελʹjoin͞ΕΔ
None
ʁ
͍͠ɽɽɽ
ਓؒؔͰߟ͑Α͏
͜͜ʹήʔϜ͖΅͕ͬͪ3ਓ ͍Δͱ͢Δ
None
%2# ͓Ζʔ .)9 Ϋοι͆͆͆ ࣌ 'BMMPVU
ҰॹʹϓϨΠͰ͖ͳ͍…
͜ͷ··͡Ό΅ͬ ͪͷ··ʜ
ؒʢΫϥελʣ ʹͳΖ͏ͥ consul join hoge fuga
ϦʔμܾΊΑ͏ consul join hoge fuga ϦʔμܾΊΑ͏ ϦʔμܾΊΑ͏
͍͑͢ɺΏ͋ ͍Ͷ͢ ΦϨϦʔμͰΑ ͍ʁ :P ΫϥελԽ raftʹΑΓϦʔμ͕બग़͞Ε·͢
ΫϥελԽ ༑ୡͷ༑ୡ༑ୡ
͓̺ ύϫϓϩΔͧ ʢDPOTVMFWFOUʣ ͓̺ ΫϥελԽ
ͪͳΈʹjoinٯՄೳ
ؒʢΫϥελʣ ʹͳΖ͏ͥ consul join bar consul join bar ؒʢΫϥελʣ ʹͳΖ͏ͥ
ConsulΛ͑༑ୡ͕Ͱ͖Δ ͧʂʂʂ
start_join༮ͳ͡Έతͳͷ
σϓϩΠͷ
ैདྷΞϓϦέʔγϣϯͷ σϓϩΠ
capistranoΛͬͨ pushܕσϓϩΠ
http://tech.feedforce.jp/stretcher-consul-capistrano.html
ͪΐͬͱਐԽͨ͠σϓϩΠ
Consul + StretcherΛͬͨ pullܕσϓϩΠ
http://tech.feedforce.jp/stretcher-consul-capistrano.html
ϝϦοτ • ΞϓϦέʔγϣϯαʔόͷSSHଓߟ͑ͳ ͍͍ͯ͘ʢ͕૿͑ͯӨڹͳ͍ʂʣ • ຊ൪αʔόͰbundle installͳͲͷॏ͍ॲཧ͠ ͳͯ͘Α͍
ͱ͍͏ΛઌʑिͷษڧձͰ ͨ͠
hogeʮbuildαʔόͷӡ༻Ί ΜͲ͍ͳ͊ɻSPOFͳΔ͡Ό Μʯ
fugaʮCircleCIͰbuildͱ͔Ͱ ͖ͳ͍ͷʁʯ
fooʮ͜ΕRailsΞϓϦલఏͩ ΑͶʁϑϩϯτΤϯυʁʯ ※capistrano-stretcher-npmΛ͍͍͔͑
barʮσϓϩΠ͕ඇಉظʹͳ ΔͷͰ௨Ͳ͏͢Δͷʁʯ
tjinjinʮ…ʯ
http://jigokuno.com/eid_679.html
࡞ͬͨ
ɾrake-stretcher ɾrake-stretcher-rails npmؒʹ߹Θͳ͔ͬͨ
Կ͕Ͱ͖Δ • buildαʔόͳ͠ͰϩʔΧϧͰͷbuildΛՄೳʹ • consul eventͷൃՐΛHTTP APIϕʔεͰͰ͖ ΔΑ͏ʹ • 1ੈલͷrollbackͰ͖ΔΑ͏ʹ
σϓϩΠͷΠϝʔδ
গ͠γϯϓϧʹͳͬͨʁ
APIͰͷΠϕϯτൃՐ • ΫϥελͰίϚϯυୟ͘ඞཁ͕ͳ͍ • SSHͳ͠ͰσϓϩΠͰ͖Δ • AWS lambdaͬͯslack͔ΒσϓϩΠ࣮ߦ Ͱ͖Δʂʁ •
CircleCI͔ΒσϓϩΠͰ͖Δʁ
ເ͕ͻΖ͕ΓΜ͙ (∩´∀ʆ)∩ƂŖŘ
σϓϩΠ௨slack͔ consul-kv-dashboard
ϓϩϏδϣχϯάͷ
hogeʮpullܕσϓϩΠͰ͖Δ ͷΘ͔͚ͬͨͲɺͲ͏ͬ ͯͦͷঢ়ଶʹ͢ΔΜʁʯ
tjinjinʮ…ʯ
http://jigokuno.com/eid_679.html
pullܕσϓϩΠ͢ΔͨΊʹʁ • αʔό͕ىಈ͍ͯ͠Δ • ConsulΫϥελΛطʹܗ͍ͯ͠Δ • σϓϩΠʹඞཁͳϛυϧΣΞ͕Πϯετʔ ϧ͞Ε͍ͯΔʢstretcherͱ͔Ͷʣ
tjinjinʮஈ֊Λ͚࣮ͯݱ͠ Α͏ʂʯ
Phase1 ڥߏஙˍConsulΫϥελԽ • αʔόߏஙͨ͠λΠϛϯάͰConsulΫϥελ Խ͍ͤͨ͞ • ࣍ϖʔδͷਤͷߏΛఆ
શମߏਤ
Packer & Terraform
Packerͱ • HashiCorp • AWSΛىಈ͢Δͱ͖ʹ༻͢ΔAMIΛΧελ ϚΠζ͕؆୯ʹͰ͖Δ • AWSҙ֎ରԠͯ͠ΔΑʂ
stretcher/consul/awscliΛಋೖ
PackerͰ͍ͬͯΔ͜ͱ • stretcherಋೖ • awscliಋೖ • consulಋೖ
࣍
PackerͰ࡞ͬͨΧελϜAMI ΛͬͯTerraformͰڥߏ ங͢Δ͍ͧʂ
͍ͧ…ʁ
None
Terraformͱ • Hashicorp • αʔόڥͳͲΛίʔυͰநԽͰ͖Δ • ϘλϯҰͭͰڥͷߏஙɾഁյ͕Ͱ͖ɺॾਕ ͷ
ConsulΫϥελΛΉͨΊʹ • αʔόىಈޙʹ୭͔͕consul joinΛൃߦ͢Ε Α͍ • start_joinΛઃఆ͓͖ͯ͠ɺىಈޙʹjoinͤ͞ Ε͍͍͔
start_joinʹઃఆ͢ΔIP Ͳ͏͢Δʁ
Ͳ͜ʹjoin͢Δ͔ • AWSͰجຊతʹࢦఆ͞ΕͨIPϨϯδͰɺ։ ͍͍ͯΔIP͔ΒదͳͷΛબΜͰىಈ͢Δ • αʔόͷIPݻఆͯ͠ɺઃఆϑΝΠϧݻఆ͢Δ ͜ͱͰ͖Δ͚Ͳʢεέʔϧ͠ͳͦ͏…ʣ
TerraformͷTemplateΛར༻ ͢Δ
Template provider • TerraformͰ࡞ͨ͠ϦιʔεͷมΛར༻Ͱ ͖Δ • ࠓճͰݴ͏ͱbastionαʔόͷprivate_ipΛऔ ಘͯ͠ɺͦͷଞαʔό͕bastionαʔόʹ consul join͢ΔઃఆΛ࡞Δ
None
boot-consul.sh.tpl
Phase2 ΞϓϦʹඞཁͳϛυϧΣ Ξͷ४උ • ΞϓϦΛಈ͔ͨ͢ΊͷϛυϧΣΞΛಋೖ͠ ͍ͨ
ैདྷknife-soloʢchefʣΛ ͬͯͬͯͨ
knife-soloΠϝʔδ http://www.creationline.com/lab/6401 ΑΓҾ༻
ࠓճchef-soloΛͬͯ stretcherͰ
࡞ͬͨ ɾrake-stretcher-chef
Կ͕Ͱ͖Δʁ • chefͷϦιʔεΛtarballʹݻΊͯS3Ξοϓ ϩʔυ • APIϕʔεͰͷeventͷൃՐ
rake-stretcherΛ෦Ͱར༻ ͯ͠Δ͚ͩɻ
͜͜·ͰͰڥߏஙɾσϓϩ ΠͰ͖Δ४උ͕ྃͨ͠
Ͱɺڥ࡞ͬͯ ऴΘΓ͡Όແ͍
ӡ༻ͷ
ਓؒੜ͖͍ͯΕ͍ΖΜͳ͜ ͱ͕͋Γ·͢…
ӡ༻தͷαʔόಉ͡ʂʂ
Α͋͘Δͭ • ϛυϧΣΞͷηΩϡϦςΟΞοϓσʔτ • εέʔϧΞοϓ/μϯ • εέʔϧΞτ/Πϯ
None
Կ͕͋ͬͯαʔϏεͱΊ ͪΌ͍͚ͳ͍
҆શʹؾܰʹΓ͍ͨ
ࠓࢥ͍ඳ͍͍ͯΔߏ
εέʔϧΞτɾΠϯ
ࣈΛมߋ͢Δ͚ͩ
εέʔϧΞοϓ εέʔϧμϯ ηΩϡϦςΟΞοϓσʔτ
Blue greenతͳͭͰ
Blue-Green deployment • > ՔಇதͷBlueʹରͯ͠ԿͤͣɺผͷΠϯ ελϯεͰ৽͍͠ϦϏδϣϯͷGreenΛ࡞ͬ ͯɺҙͷઓུʹԊͬͯશମΛGreenʹΓସ ͍͑ͯ͘ http://aws.typepad.com/sajp/2015/12/what-is-blue-green-deployment.html
None
None
None
͜ΕΛTerraformͰ؆୯ɾ҆ શʹΓ͍ͨ
ʢ5ׂͰ͖ͯΔʣ
None
None
None
՝ • υϝΠϯͷΓସ͑ࠓͷͱ͜ΖखͰ ʢRoute53ͷϦιʔεͬͯྑ͍ʣ • Γସ͑ʹͨͬͯtfϑΝΠϧΛԿมߋ͠ ͳ͍ͱ͍͚ͳ͍͔…
·ͱΊ
՝ • ϑϩϯτͷσϓϩΠඋ • chef-solo͔Βͷ٫ • ͦͷଞpullܕσϓϩΠͱͷൺֱ • ʑͷӡ༻Λߟ͑ͯͷΑΓϕλʔͳͷΛ୳ ͢
ࣗಈԽ·ͰͷಓͷΓ ·ͩ·ͩԕ͍
ҰͭҰͭղܾ͍͖͍ͯͨ͠ʂ
More Decks by tjinjin
See All by tjinjin
Severlessでslack botを作る会
tjinjin
0
1.6k
Other Decks in Technology
See All in Technology
Terraform 0 to 100:100個以上のリポジトリを常に最新にし続けるための自動化
sue445
3
1.4k
自動計装なしでECSサービスをApplication Signalsに載せるまで
ota1022
2
470
そのイメージ、どのCIが作った? Artifact Attestationsで来歴を固定する / Which CI system created that image? Pinning provenance with Artifact Attestations
chmikata
0
270
閉域網でのAPI公開の選択肢全部比較!
takano0131
5
700
専門家に使ってもらうAIプロダクトをつくる - 病院の医事課向けDPCコーディング支援システムの設計と評価
hagino3000
4
1k
HTTP QUERY時代の型安全な検索APIをKotlinで設計する
sansantech
PRO
1
130
おうち環境でも「なるべく止めたくない!」 ― おうち環境の機器冗長化の理想と現実
yuutosi
1
700
Web Performance Is a Journey [PerfNow 2026]
tammyeverts
2
150
メルカリの小規模チーム「Pod」で、 エンジニアがデータアナリストなしで、 AIを使ってデータ分析の自走を目指す取り組み
jackojacko_
1
350
SBOM 生成ツールで 2026 Minimum Elements はどこまで満たせるのか
gokken
0
160
gradle-best-practices 使ってみた
mikanichinose
0
230
Amazon EFS のマルウェアスキャンをClamAV で自前実装したら苦労した話
mtmtfactory01
0
110
Featured
See All Featured
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
640
Digital Ethics as a Driver of Design Innovation
axbom
PRO
2
560
Building a Scalable Design System with Sketch
lauravandoore
464
34k
Site-Speed That Sticks
csswizardry
13
1.6k
sira's awesome portfolio website redesign presentation
elsirapls
0
520
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
31
10k
Fashionably flexible responsive web design (full day workshop)
malarkey
409
67k
Tell your own story through comics
letsgokoyo
1
1.1k
Scaling GitHub
holman
464
140k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
tammyeverts
2
580
The browser strikes back
jonoalderson
0
2k
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
590