Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Monitoring Casual in Kyoto / Sensu + Graphite
Search
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Technology
6
27k
Monitoring Casual in Kyoto / Sensu + Graphite
Monitoring Casual in Kyoto 11/30
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Tweet
Share
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
MetricSifter:クラウドアプリケーションにおける故障箇所特定の効率化のための多変量時系列データの特徴量削減 / FIT 2024
yuukit
2
91
工学としてのSRE再訪 / Revisiting SRE as Engineering
yuukit
18
10k
Cloudless Computingの論文紹介
yuukit
2
380
#SRE論文紹介 Detection is Better Than Cure: A Cloud Incidents Perspective V. Ganatra et. al., ESEC/FSE’23
yuukit
3
1.4k
エンジニアのためのSRE論文への招待 / Introduction to SRE Papers for Engineers
yuukit
2
10k
博士課程での研究まとめ 2023年1月版 / Summary of my research in the PhD course
yuukit
1
230
AI時代に向けたクラウドにおける信頼性エンジニアリングの未来構想 / DICOMO2022 6A-1
yuukit
7
2.8k
AIOps研究録―SREのための システム障害の自動原因診断 / SRE NEXT 2022
yuukit
10
12k
Interactive AIOps
yuukit
0
2k
Other Decks in Technology
See All in Technology
Case Study: Concurrent Counting
ennael
PRO
0
120
今こそ変化対応力を向上させるとき 〜ログラスが FAST に挑戦する理由〜 / Why Loglass is Talking on the Challenge of Agile Framework FAST
shioyang
0
110
DenoでもViteしたい!インポートパスのエイリアスを指定してラクラクアプリ開発
bengo4com
2
2k
I tried the newly introduced certification "Applied Skills" on Microsoft Learn
mappie_kochi
0
200
【shownet.conf_】ShowNet伝送改めShowNet APN 2024
shownet
PRO
0
450
軽いノリで"自動化"に取り組んではいけないという話
tetsuyaooooo
1
550
【shownet.conf_】トポロジ図の歩き方
shownet
PRO
0
530
ゼロから実装まで!機械学習入門
natsuki0726
0
190
Develop to Survive - YAPC::Hakodate 2024 Keynote
moznion
8
2.5k
AWS Lambdaで実現するスケーラブルで低コストなWebサービス構築/YAPC::Hakodate2024
fujiwara3
7
3.5k
見えづらい活動の成果の伝え方は日頃からめちゃくちゃ悩んでるけど、実際こんな取り組みをしな がら温度感を合わせにいってるよ / Conveying Hard-to-See Results
kakehashi
4
1.9k
【shownet.conf_】3Dアプローチで守るセキュリティ
shownet
PRO
0
390
Featured
See All Featured
Designing with Data
zakiwarfel
98
5.1k
4 Signs Your Business is Dying
shpigford
180
21k
Clear Off the Table
cherdarchuk
91
320k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
41
9.2k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
327
21k
Adopting Sorbet at Scale
ufuk
73
9k
YesSQL, Process and Tooling at Scale
rocio
167
14k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
39
2.1k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
126
18k
Navigating Team Friction
lara
183
14k
Fontdeck: Realign not Redesign
paulrobertlloyd
81
5.2k
Transcript
Sensu & Graphite Moden Monitoring Tool .POJUPSJOH$BTVBM5BML*O,ZPUP JEZ@VVLJ
id:y_uuki
2011 / 08 ͯͳΠϯλʔϯ
2012 / 09 ΞϧόΠτࢯ
2013 / 07
2013 / 09
2013 / 11
2013 / 12
None
In Kyoto
Monitoring
NFUSJDTDPMMFDUJPO Today NFUSJDTWJTVBMJTBUJPO health check alert notification
Monitoring Tool
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
Case 1
None
? Scalable & Robust - Munin 2.0 ? ✓ Pluggable
- munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
Case 2
Collectd + Cacti + RRDtool
✗ Scalable & Robust - because of RRDtool (cannot replicate)
✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
Case 3
Graduate from
(SBQIJUF Scalable Realtime Graphing
Graphite Data Flow Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics Graph JSON Store Get Graphite
3&45"1* - Graph rendering - JSON ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - Webapp
Frontend - Storage
Replication / Sharding Carbon Relay Whisper metrics Carbon Whisper Carbon
Whisper Carbon
Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
4FOTV A monitoring framework that aims! to be simple, malleable,
and scalable
.POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down
- Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server
Redis sensu- client run checks checks run handlers store notification checks check request
None
None
More Detail • https://speakerdeck.com/joemiller/introduction- to-sensu • http://www.slideshare.net/jeremy_carroll/ sensu-14485155 • https://speakerdeck.com/joemiller/practical-
examples-with-sensu-monitoring-framework
(SBQIJUF 4FOTV
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
✓ Scalable & Robust - Maybe ✓ Pluggable - sensu
plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
Graphite & RabbitMQ Integration
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
Stack Visualisation Storage Collector Collector Agent .VOJO $BDUJ $PMMFDUE (SBQIJUF
4FOTV 33%UPPM
Other Solution Storage
OpenTSDB Kairos InfluxDB
Other Solution Collector
fluentd?
Integration with other tools
log health Infrastructure Information metrics Dynamic Static Host, Service, Role,
Network, Location …
log health Integration Viewer metrics Dynamic Static Integration View Host,
Service, Role, Network, Location …
log health Host, Service, Role, Network, Location … Integration with
API metrics Dynamic Static Integration View JSON
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
ҟৗͳྗ͕ඞཁͳπʔϧʹݻࣥͤͣʹ ےͷྑ͍πʔϧΛબΜͰ͍͖͍ͨ
Graduate from
Sensu & Graphite Moden Monitoring Tool Monitoring Casual Talk In
Kyoto id:y_uuki
Thanks