Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
consul-atlas-alerts
rrreeeyyy
August 05, 2015
Technology
5
8.2k
consul-atlas-alerts
#hashi_wantedly
rrreeeyyy
August 05, 2015
Tweet
Share
More Decks by rrreeeyyy
See All by rrreeeyyy
SRE の歩き方・進め方 / sre-walk-through-procedure
rrreeeyyy
0
6.3k
「信頼性」を保ちつつ大規模サービスをリニューアルする / cookpad-tech-kitchen-service-embedded-sres
rrreeeyyy
11
10k
Cookpad and Prometheus
rrreeeyyy
6
19k
SRE-Lounge-8-Cookpad-Microservice-Architecture-Overview
rrreeeyyy
5
4.5k
A survey of anomaly detection methodologies for web system
rrreeeyyy
5
870
エンジニアリングをちゃんとやる あるいは 人類の平和 について / wsa02-rrreeeyyy
rrreeeyyy
13
2.6k
「自立」したWebシステムを創る。自分の好きなことをする世界を目指して。/ ipsj-one-2018-rrreeeyyy
rrreeeyyy
3
1.5k
Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy
rrreeeyyy
12
6.9k
SRE at Cookpad
rrreeeyyy
1
1k
Other Decks in Technology
See All in Technology
“Do you have a virtual router?” Discuss how to use virtual routers
line_developers
PRO
0
420
チケットNFTの仕組み
sbtechnight
0
320
20230117_JAWS-UG_朝会_41_LT資料
tsumita
0
290
ついに来る!TypeScript5.0の新機能
uhyo
16
8.6k
Things you should know about PHP
opdavies
1
470
Technologies for developing editors / Webエディタ開発を支える技術
shuta13
1
220
Cloudflare Workersで動くOG画像生成器
aiji42
1
430
成長が鈍化したチームを変えるためにやったこと / #RSGT2023
mongolyy
2
2.7k
CEXやDEXに依存しないブロックチェーン取引について考える
sbtechnight
0
310
RDS/Aurora バージョンアップのポイント
hmatsu47
PRO
8
1.6k
Airdrop for Open Source Projects
epicsdao
0
210
大企業がアジャイルになる途中で 起きること/What happens on the way big company becomes agile
chinmo
0
2.6k
Featured
See All Featured
Statistics for Hackers
jakevdp
784
210k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
239
19k
The Power of CSS Pseudo Elements
geoffreycrofte
52
4.3k
Robots, Beer and Maslow
schacon
154
7.3k
The Brand Is Dead. Long Live the Brand.
mthomps
48
2.9k
From Idea to $5000 a Month in 5 Months
shpigford
374
44k
Three Pipe Problems
jasonvnalue
89
8.9k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
29
7.7k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
13
1.1k
Making the Leap to Tech Lead
cromwellryan
116
7.6k
For a Future-Friendly Web
brad_frost
166
7.7k
Pencils Down: Stop Designing & Start Developing
hursman
114
10k
Transcript
Consul'in'Atlas !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 1
!Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)!
2
Hashicorp*ͱΘͨ͠(ͱձࣾ) • h#ps:/ /speakerdeck.com/rrreeeyyy/hashicorp3tools3overview • Vagrant;→;(΄΅ΈΜͳͬͯΔ) • Packer;→;(ͬͯͳ͍) • Serf;→;(ͬͯͳ͍)
• Consul;→;(ͬͯΔҊ͕݅;1;ͭ͋Δ/͕ࣗ৮ͬͯΔ/ଞʹ৮ͬͯΔਓ͕͍Δ) • Terraform;→;(͍͍ͨ/ݕূͯ͠ΔਓࣗҎ֎ʹډΔ) • Vault;→;(Θ͕ͨ͠৮ͬͯΔ) !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 3
લճ·Ͱͷ͋Β͢͡!(1)!1 • consul(ͱ(consul)alerts(2(ͰΞϥʔτൃใ͢ΔγεςϜ 2"h$ps:/ /github.com/AcalephStorage/consul9alerts 1"h$p:/ /www.slideshare.net/rrreeeyyy117/consul8andalertsmonitoring !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 4
લճ·Ͱͷ͋Β͢͡!1 • consul(ͷ(health-check(3(͕ࣦഊͨ͠Β(Pagerduty/Slack/Hipchat/ email...(ʹΞϥʔτൃใ • consul-alert(Λ࣮ͬͯݱ • Nagios/Sensu(ͷεΫϦϓτΛྲྀ༻ͯ͠ઃఆՄೳ • HTTP(API(͔Βࢹ/αʔϏεొ͕ग़དྷͯศར
3"h$p:/ /www.consul.io/docs/agent/checks.html 1"h$p:/ /www.slideshare.net/rrreeeyyy117/consul8andalertsmonitoring !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 5
Atlas • ࠷ۙ(7$݄಄ࠒ)Ұൠ͚ϦϦʔε͞Εͨ$4 • Hashicorp$֤πʔϧͱͷ࿈ܞ͢ΔϓϥοτϑΥʔϜ • ͪΖΜ$Consul$࿈ܞ͋Δ • લड़ͷΞϥʔτγεςϜ$Atlas$Λ͑ग़དྷΔ •
Consul$+$Atlas$͚ͩͰՄೳ 4"h$ps:/ /hashicorp.com/blog/atlas4general4availability.html !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 6
Atlas&+&Consul • /etc/consul.conf { "server": true, "node_name": "NODE-NAME", "datacenter": "DC-NAME",
"data_dir": "/usr/local/consul/data", "bind_addr": "192.168.2.1", "bootstrap_expect": 3, "addresses": { "http": "192.168.2.1" }, "log_level": "INFO", "atlas_token": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX", "atlas_join": true, "atlas_infrastructure": "topotal/groupname" } !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 7
Atlas&+&Consul • consul.service : [Service] User=consul Group=consul ExecStart=/usr/local/bin/consul agent -config-file
/etc/consul.conf ExecReload=/bin/kill -HUP $MAINPID KillMode=process Restart=on-failure RestartSec=10s : !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 8
Atlas&+&Consul • ͜Μͳײ͡ʹͳΔ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 9
Service/Check+ొํ๏ • ىಈ࣌ʹ"json"Λͯ͠ొ • HTTP"API"ܦ༝Ͱొ • (Terraform"ӽ͠ʹొ) !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 10
ىಈ࣌ʹ!json!Λͯ͠ొ • ࣍ͷΑ͏ͳ"json"Λىಈ࣌ʹͯ͋͛͠Δ • -config-file"͘͠"-config-dir { "service": { "id": "linux-server",
"name": "linux-server", "tags": ["linux-server"] } } { "check": { "id": "check_load", "name": "Load Average", "script": "/usr/lib64/nagios/plugins/check_load -w 15,12,12 -c 30,25,20", "interval": "30s", "service_id": "linux-server" } } !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 11
ىಈ࣌ʹ!json!Λͯ͠ొ • config-dir"σΟϨΫτϦΛ࠶ؼతʹಡ·ͳ͍ • -config-dir /etc/consul.d/"Λࢦఆͨ͠߹ • -config-dir /etc/consul.d/*.json"ΛΞϧϑΝϕοτॱͰಡΉ •
/etc/consul.d/role/*.json"ಡ·ͳ͍ • ಉ͡σΟϨΫτϦʹ"Service/Check"༻ͷ"json"Λஔ͔ͳ͍ํ͕ྑ͍ • ઌʹ"Service"༻ͷ"json"͕ಡ·Εͳ͍ͱىಈ࣌ʹࢮ͵ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 12
HTTP$API$ӽ͠Ͱొ • ࣍ͷΑ͏ʹͯ͛͠Δ • json"ͷॻ͕ࣜىಈ࣌ʹ͢ͷͱҧ͏ͷͰҙ͢Δ [
[email protected]
~]# cat load.json {
"id": "check_load", "name": "Load Average", "script": "/usr/lib64/nagios/plugins/check_load -w 15,12,12 -c 30,25,20", "interval": "30s", "service_id": "linux-server" } [
[email protected]
~]# curl -vvv -X PUT -d \ > @disk_root.json http://192.168.2.1:8500/v1/agent/check/register !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 13
HTTP$API$ӽ͠Ͱొ • ಉ͡"id"Λ࣋ͬͨ"json"Λ"v1/agent/check/register"ʹ͛ΔͱҰॠΞ ϥʔτʹͳΔ • ᮢม͑ͨΓ͢Δͱ͖ʹগ͠໘ष͍ • ࣍ͷ"HTTP"API"Λۦ͢Δ͜ͱͰճආՄೳ • /v1/agent/service/maintenance/
• /v1/agent/check/pass • /v1/agent/check/deregister/<checkId> !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 14
Terraform(ӽ͠ʹొ • consul(integra/on(͋Δ͠ͳΜͱ͔ͳΒͳ͍Ͱ͔͢Ͷʁ • ৄ͍͠ํ͋ͱͰڭ͍͑ͯͩ͘͞... • ͘͠(PR(ΛૹΔ • 0.8(͙Β͍͔Β(5state(͕ཁΒͳ͘ͳΔͱ͍͏༧(5 5"h$p:/
/www.infoq.com/news/2015/06/hashimoto9consul9terraform !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 15
Ξϥʔτͷ༷ࢠ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 16
Status&output&ͷ༷ࢠ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 17
Alert&history&ͷ༷ࢠ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 18
·ͱΊ • ࠓճ"Consul"+"Atlas"ͰΞϥʔτγεςϜΛ࡞ͬͨ • consul-alerts"ͷ͜ͱΛߟ͑ͳͯ͘ྑ͘ͳΔͷͰָ • Ϋϥελͷॳظߏஙָ͕ʹͳΔ • Atlas""10"͙Β͍·Ͱແྉʂ •
ݸਓنͰ"Nagios/Zabbix"ཱͯͨ͘ͳ͍ͬͯਓʹΦεεϝ • ֎ܗࢹΈ͍ͨͳͷผ్ߟ͑Δඞཁ͕͋Γͦ͏ • Pingdom"ͱ͔ʁ • ຊ"Mackerel""Datadog"ͱΈ߹Θ͍ͤͨͳʙ !Hashicorp!meetup!2015/08/05!5!Yoshikawa!Ryota!(
[email protected]
!)! 19