日々の運用をconsulで楽にし隊

社内勉強会の資料です

Transcript

1. ೔ʑͷӡ༻ΛConsulͰָʹ͠ୂ ~एऀ͸ເΛݟΔ~ 2016/2/19 tjinjin
2. Who? • feedforce, Inc. • Infrastructure engineer • twitter : cross_black777 • github : tjinjin
3. φ΢ͰϠϯάͳ؀ڥΛ ࡞Γ·͢ʢʆΣ´ʣ
4. ࠓ೔ͷ͓࿩ • Consulͷجૅ • σϓϩΠͷ࿩ • ϓϩϏδϣχϯάͷ࿩ • ೔ʑͷӡ༻ͷ࿩ • σϞʁ
5. ࠓ೔࿩͞ͳ͍͜ͱ • ࠓظΠνΦγΞχϝͷ࿩ • γϦίϯόϨʔࣜμΠΤοτͷ࿩ • SHIROBAKOʹ͓͚ΔٶकͷϓϩϑΣογϣ φϦζϜͱ͸
6. Consulͷجૅ
7. Consulͱ͸ • Hashicorp੡ • αʔόಉ࢜ͰΫϥελΛ૊ΜͰɺͦͷΫϥελ ʹର͍͠ΖΜͳ͜ͱ͕Ͱ͖Δ
8. ΋͏গ͠ৄ͘͠ • ىಈ࣌ͷΦϓγϣϯͰServer/ClientϞʔυʹ ෼͔ΕΔ • ServerͰىಈͨ͠Consulͷத͔ΒLeaderΛબ ग़͢Δɻ • ͦͷLeaderΛத৺ʹΫϥελ͕ػೳ͢Δ
9. https://www.consul.io/docs/internals/architecture.html
10. ઃఆϑΝΠϧ { "server": true, "client_addr": "0.0.0.0", "bootstrap_expect": 3, "data_dir": "/var/consul/data", "watches": [ { "type": "event", "name": "deploy_bastion_development", "handler": "stretcher" } ] }
11. bootstrap-expect • consulΫϥελʹServerϊʔυ͕͜ͷࢦఆΛ ͨ͠୆਺ʹୡͨ࣌͠ʹLeaderͷબग़͕ߦΘΕ Δɻ
12. consul watch • ಛఆͷมԽΛݕ஌ͯ͠ɺॲཧΛ࣮ߦ͢Δ • event/nodes/serviceͳͲͳͲɽɽɽ
13. Ϋϥελͷ࡞Γํ
14. Ϋϥελͷ࡞Γํ • Ϋϥελͷؔ܎ʹ͍ͨ͠αʔόʢͲͪΒͰ΋ ՄʣͰconsul joinίϚϯυୟ͘ • ىಈ࣌ʹstart_joinΦϓγϣϯΛࢦఆ͢Δͱࣗ ಈͰΫϥελʹjoin͞ΕΔ
16. ʁ
17. ೉͍͠ɽɽɽ
18. ਓؒؔ܎Ͱߟ͑Α͏
19. ͜͜ʹήʔϜ޷͖΅͕ͬͪ3ਓ ͍Δͱ͢Δ
21. %2#
    ͓΋Ζʔ .)9
    Ϋοι͆͆͆ ࣌୅͸
    'BMMPVU
22. ҰॹʹϓϨΠͰ͖ͳ͍…
23. ͜ͷ··͡Ό΅ͬ ͪͷ··ʜ
24. ஥ؒʢΫϥελʣ ʹͳΖ͏ͥ consul join hoge fuga
25. ϦʔμܾΊΑ͏ consul join hoge fuga ϦʔμܾΊΑ͏ ϦʔμܾΊΑ͏
26. ͍͑͢ɺΏ͋ ͸͍Ͷ͢ ΦϨϦʔμͰΑ ͍ʁ :P ΫϥελԽ raftʹΑΓϦʔμ͕બग़͞Ε·͢
27. ΫϥελԽ ༑ୡͷ༑ୡ͸༑ୡ
28. ͓̺ ύϫϓϩ΍Δͧ
    ʢDPOTVM
    FWFOUʣ ͓̺ ΫϥελԽ
29. ͪͳΈʹjoin͸ٯ΋Մೳ
30. ஥ؒʢΫϥελʣ ʹͳΖ͏ͥ consul join bar consul join bar ஥ؒʢΫϥελʣ ʹͳΖ͏ͥ
31. ConsulΛ࢖͑͹༑ୡ͕Ͱ͖Δ ͧʂʂʂ
32. start_join͸༮ͳ͡Έతͳ΋ͷ
33. σϓϩΠͷ࿩
34. ैདྷΞϓϦέʔγϣϯͷ σϓϩΠ
35. capistranoΛ࢖ͬͨ pushܕσϓϩΠ
36. http://tech.feedforce.jp/stretcher-consul-capistrano.html
37. ͪΐͬͱਐԽͨ͠σϓϩΠ
38. Consul + StretcherΛ࢖ͬͨ pullܕσϓϩΠ
39. http://tech.feedforce.jp/stretcher-consul-capistrano.html
40. ϝϦοτ • ΞϓϦέʔγϣϯαʔό΁ͷSSH઀ଓߟ͑ͳ ͍͍ͯ͘ʢ୆਺͕૿͑ͯ΋Өڹͳ͍ʂʣ • ຊ൪αʔόͰbundle installͳͲͷॏ͍ॲཧ͠ ͳͯ͘Α͍
41. ͱ͍͏࿩ΛઌʑिͷษڧձͰ ͨ͠
42. hogeʮbuildαʔόͷӡ༻Ί ΜͲ͍ͳ͊ɻSPOFͳΔ͡Ό Μʯ
43. fugaʮCircleCIͰbuildͱ͔Ͱ ͖ͳ͍ͷʁʯ
44. fooʮ͜ΕRailsΞϓϦલఏͩ ΑͶʁϑϩϯτΤϯυ͸ʁʯ ※capistrano-stretcher-npmΛ࢖͑͹͍͍͔΋
45. barʮσϓϩΠ͕ඇಉظʹͳ ΔͷͰ௨஌͸Ͳ͏͢Δͷʁʯ
46. tjinjinʮ…ʯ
47. http://jigokuno.com/eid_679.html
48. ࡞ͬͨ
49. ɾrake-stretcher ɾrake-stretcher-rails npmؒʹ߹Θͳ͔ͬͨ
50. Կ͕Ͱ͖Δ • buildαʔόͳ͠ͰϩʔΧϧͰͷbuildΛՄೳʹ • consul eventͷൃՐΛHTTP APIϕʔεͰͰ͖ ΔΑ͏ʹ • 1ੈ୅લ΁ͷrollbackͰ͖ΔΑ͏ʹ
51. σϓϩΠͷΠϝʔδ
52. গ͠γϯϓϧʹͳͬͨʁ
53. APIͰͷΠϕϯτൃՐ • Ϋϥελ಺ͰίϚϯυୟ͘ඞཁ͕ͳ͍ • SSHͳ͠ͰσϓϩΠͰ͖Δ • AWS lambda࢖ͬͯslack͔ΒσϓϩΠ࣮ߦ΋ Ͱ͖Δʂʁ • CircleCI͔Β௚઀σϓϩΠ΋Ͱ͖Δʁ
54. ເ͕ͻΖ͕ΓΜ͙ (∩´∀ʆ)∩ƂŖŘ
55. σϓϩΠ௨஌͸slack͔ consul-kv-dashboard
56. ϓϩϏδϣχϯάͷ࿩
57. hogeʮpullܕσϓϩΠͰ͖Δ ͷ͸Θ͔͚ͬͨͲɺͲ͏΍ͬ ͯͦͷঢ়ଶʹ͢ΔΜʁʯ
58. tjinjinʮ…ʯ
59. http://jigokuno.com/eid_679.html
60. pullܕσϓϩΠ͢ΔͨΊʹ͸ʁ • αʔό͕ىಈ͍ͯ͠Δ • ConsulΫϥελΛطʹܗ੒͍ͯ͠Δ • σϓϩΠʹඞཁͳϛυϧ΢ΣΞ͕Πϯετʔ ϧ͞Ε͍ͯΔʢstretcherͱ͔Ͷʣ
61. tjinjinʮஈ֊Λ෼͚࣮ͯݱ͠ Α͏ʂʯ
62. Phase1 ؀ڥߏஙˍConsulΫϥελԽ • αʔόߏஙͨ͠λΠϛϯάͰConsulΫϥελ Խ͍ͤͨ͞ • ࣍ϖʔδͷਤͷߏ੒Λ૝ఆ
63. શମߏ੒ਤ
64. Packer & Terraform
65. Packerͱ͸ • HashiCorp੡ • AWSΛىಈ͢Δͱ͖ʹ࢖༻͢ΔAMIΛΧελ ϚΠζ͕؆୯ʹͰ͖Δ • AWSҙ֎΋ରԠͯ͠ΔΑʂ
66. stretcher/consul/awscliΛಋೖ
67. PackerͰ΍͍ͬͯΔ͜ͱ • stretcherಋೖ • awscliಋೖ • consulಋೖ
68. ࣍
69. PackerͰ࡞ͬͨΧελϜAMI Λ࢖ͬͯTerraformͰ؀ڥߏ ங͢Δ͍ͧʂ
70. ͍ͧ…ʁ
72. Terraformͱ͸ • Hashicorp੡ • αʔό؀ڥͳͲΛίʔυͰந৅ԽͰ͖Δ • ϘλϯҰͭͰ؀ڥͷߏஙɾഁյ͕Ͱ͖ɺॾਕ ͷ݋
73. ConsulΫϥελΛ૊ΉͨΊʹ͸ • αʔόىಈޙʹ୭͔͕consul joinΛൃߦ͢Ε ͹Α͍ • start_joinΛઃఆ͓͖ͯ͠ɺىಈޙʹjoinͤ͞ Ε͹͍͍͔
74. start_joinʹઃఆ͢ΔIP͸ Ͳ͏͢Δʁ
75. Ͳ͜ʹjoin͢Δ͔ • AWSͰ͸جຊతʹࢦఆ͞ΕͨIPϨϯδͰɺ։ ͍͍ͯΔIP͔Βద౰ͳ΋ͷΛબΜͰىಈ͢Δ • αʔόͷIPݻఆͯ͠ɺઃఆϑΝΠϧ΋ݻఆ͢Δ ͜ͱ΋Ͱ͖Δ͚Ͳʢεέʔϧ͠ͳͦ͏…ʣ
76. TerraformͷTemplateΛར༻ ͢Δ
77. Template provider • TerraformͰ࡞੒ͨ͠Ϧιʔεͷม਺Λར༻Ͱ ͖Δ • ࠓճͰݴ͏ͱbastionαʔόͷprivate_ipΛऔ ಘͯ͠ɺͦͷଞαʔό͕bastionαʔόʹ consul join͢ΔઃఆΛ࡞Δ
79. boot-consul.sh.tpl
80. Phase2 ΞϓϦʹඞཁͳϛυϧ΢Σ Ξͷ४උ • ΞϓϦΛಈ͔ͨ͢Ίͷϛυϧ΢ΣΞΛಋೖ͠ ͍ͨ
81. ैདྷ͸knife-soloʢchefʣΛ ࢖ͬͯ΍ͬͯͨ
82. knife-soloΠϝʔδ http://www.creationline.com/lab/6401 ΑΓҾ༻
83. ࠓճ͸chef-soloΛ࢖ͬͯ stretcherͰ
84. ࡞ͬͨ ɾrake-stretcher-chef
85. Կ͕Ͱ͖Δʁ • chefͷϦιʔεΛtarballʹݻΊͯS3΁Ξοϓ ϩʔυ • APIϕʔεͰͷeventͷൃՐ
86. rake-stretcherΛ಺෦Ͱར༻ ͯ͠Δ͚ͩɻ
87. ͜͜·ͰͰ؀ڥߏஙɾσϓϩ ΠͰ͖Δ४උ͕׬ྃͨ͠
88. Ͱ΋ɺ؀ڥ͸࡞ͬͯ ऴΘΓ͡Όແ͍
89. ӡ༻ͷ࿩
90. ਓؒੜ͖͍ͯΕ͹͍ΖΜͳ͜ ͱ͕͋Γ·͢…
91. ӡ༻தͷαʔό΋ಉ͡ʂʂ
92. Α͋͘Δ΍ͭ • ϛυϧ΢ΣΞͷηΩϡϦςΟΞοϓσʔτ • εέʔϧΞοϓ/μ΢ϯ • εέʔϧΞ΢τ/Πϯ
94. Կ͕͋ͬͯ΋αʔϏε͸ͱΊ ͪΌ͍͚ͳ͍
95. ҆શʹؾܰʹ΍Γ͍ͨ
96. ࠓࢥ͍ඳ͍͍ͯΔߏ૝
97. εέʔϧΞ΢τɾΠϯ
98. ਺ࣈΛมߋ͢Δ͚ͩ
99. εέʔϧΞοϓ εέʔϧμ΢ϯ ηΩϡϦςΟΞοϓσʔτ
100. Blue greenతͳ΍ͭͰ
101. Blue-Green deployment • > ՔಇதͷBlueʹରͯ͠͸Կ΋ͤͣɺผͷΠϯ ελϯεͰ৽͍͠ϦϏδϣϯͷGreenΛ࡞ͬ ͯɺ೚ҙͷઓུʹԊͬͯશମΛGreenʹ੾Γସ ͍͑ͯ͘ http://aws.typepad.com/sajp/2015/12/what-is-blue-green-deployment.html
105. ͜ΕΛTerraformͰ؆୯ɾ҆ શʹ΍Γ͍ͨ
106. ʢ5ׂͰ͖ͯΔʣ
110. ՝୊ • υϝΠϯͷ੾Γସ͑͸ࠓͷͱ͜ΖखͰ ʢRoute53ͷϦιʔε࢖ͬͯ΋ྑ͍ʣ • ੾Γସ͑ʹ౰ͨͬͯtfϑΝΠϧΛԿ౓΋มߋ͠ ͳ͍ͱ͍͚ͳ͍͔΋…
111. ·ͱΊ
112. ՝୊ • ϑϩϯτͷσϓϩΠ੔උ • chef-solo͔Βͷ୤٫ • ͦͷଞpullܕσϓϩΠͱͷൺֱ • ೔ʑͷӡ༻Λߟ͑ͯͷΑΓϕλʔͳ΋ͷΛ୳ ͢
113. ࣗಈԽ·ͰͷಓͷΓ͸ ·ͩ·ͩԕ͍
114. ҰͭҰͭղܾ͍͖͍ͯͨ͠ʂ
115. ׬