Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Monitoring Casual in Kyoto / Sensu + Graphite
Search
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Technology
6
27k
Monitoring Casual in Kyoto / Sensu + Graphite
Monitoring Casual in Kyoto 11/30
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Tweet
Share
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
博士学位論文予備審査 / Scaling Telemetry Workloads in Cloud Applications: Techniques for Instrumentation, Storage, and Mining
yuukit
1
1.7k
MetricSifter:クラウドアプリケーションにおける故障箇所特定の効率化のための多変量時系列データの特徴量削減 / FIT 2024
yuukit
2
180
工学としてのSRE再訪 / Revisiting SRE as Engineering
yuukit
19
12k
Cloudless Computingの論文紹介
yuukit
2
480
#SRE論文紹介 Detection is Better Than Cure: A Cloud Incidents Perspective V. Ganatra et. al., ESEC/FSE’23
yuukit
3
1.7k
エンジニアのためのSRE論文への招待 / Introduction to SRE Papers for Engineers
yuukit
2
11k
博士課程での研究まとめ 2023年1月版 / Summary of my research in the PhD course
yuukit
1
280
AI時代に向けたクラウドにおける信頼性エンジニアリングの未来構想 / DICOMO2022 6A-1
yuukit
7
3k
AIOps研究録―SREのための システム障害の自動原因診断 / SRE NEXT 2022
yuukit
10
12k
Other Decks in Technology
See All in Technology
Fintech SREの挑戦 PCI DSS対応をスマートにこなすインフラ戦略/Fintech SRE’s Challenge: Smart Infrastructure Strategies for PCI DSS Compliance
maaaato
0
450
Building Products in the LLM Era
ymatsuwitter
10
4.5k
The 5 Obstacles to High-Performing Teams
mdalmijn
0
270
All you need to know about InnoDB Primary Keys
lefred
0
120
データ基盤の成長を加速させる:アイスタイルにおける挑戦と教訓
tsuda7
3
660
転生CISOサバイバル・ガイド / CISO Career Transition Survival Guide
kanny
3
570
High Performance PHP
cmuench
0
140
急成長する企業で作った、エンジニアが輝ける制度/ 20250214 Rinto Ikenoue
shift_evolve
2
930
偶然 × 行動で人生の可能性を広げよう / Serendipity × Action: Discover Your Possibilities
ar_tama
1
790
第13回 Data-Centric AI勉強会, 画像認識におけるData-centric AI
ksaito_osx
0
360
AWSでRAGを実現する上で感じた3つの大事なこと
ymae
3
1k
まだ間に合う! エンジニアのための生成AIアプリ開発入門 on AWS
minorun365
PRO
5
580
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Designing for Performance
lara
604
68k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
175
51k
Why You Should Never Use an ORM
jnunemaker
PRO
55
9.2k
Optimising Largest Contentful Paint
csswizardry
34
3.1k
Become a Pro
speakerdeck
PRO
26
5.1k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
Bash Introduction
62gerente
610
210k
Navigating Team Friction
lara
183
15k
Writing Fast Ruby
sferik
628
61k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Transcript
Sensu & Graphite Moden Monitoring Tool .POJUPSJOH$BTVBM5BML*O,ZPUP JEZ@VVLJ
id:y_uuki
2011 / 08 ͯͳΠϯλʔϯ
2012 / 09 ΞϧόΠτࢯ
2013 / 07
2013 / 09
2013 / 11
2013 / 12
None
In Kyoto
Monitoring
NFUSJDTDPMMFDUJPO Today NFUSJDTWJTVBMJTBUJPO health check alert notification
Monitoring Tool
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
Case 1
None
? Scalable & Robust - Munin 2.0 ? ✓ Pluggable
- munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
Case 2
Collectd + Cacti + RRDtool
✗ Scalable & Robust - because of RRDtool (cannot replicate)
✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
Case 3
Graduate from
(SBQIJUF Scalable Realtime Graphing
Graphite Data Flow Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics Graph JSON Store Get Graphite
3&45"1* - Graph rendering - JSON ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - Webapp
Frontend - Storage
Replication / Sharding Carbon Relay Whisper metrics Carbon Whisper Carbon
Whisper Carbon
Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
4FOTV A monitoring framework that aims! to be simple, malleable,
and scalable
.POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down
- Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server
Redis sensu- client run checks checks run handlers store notification checks check request
None
None
More Detail • https://speakerdeck.com/joemiller/introduction- to-sensu • http://www.slideshare.net/jeremy_carroll/ sensu-14485155 • https://speakerdeck.com/joemiller/practical-
examples-with-sensu-monitoring-framework
(SBQIJUF 4FOTV
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
✓ Scalable & Robust - Maybe ✓ Pluggable - sensu
plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
Graphite & RabbitMQ Integration
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
Stack Visualisation Storage Collector Collector Agent .VOJO $BDUJ $PMMFDUE (SBQIJUF
4FOTV 33%UPPM
Other Solution Storage
OpenTSDB Kairos InfluxDB
Other Solution Collector
fluentd?
Integration with other tools
log health Infrastructure Information metrics Dynamic Static Host, Service, Role,
Network, Location …
log health Integration Viewer metrics Dynamic Static Integration View Host,
Service, Role, Network, Location …
log health Host, Service, Role, Network, Location … Integration with
API metrics Dynamic Static Integration View JSON
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
ҟৗͳྗ͕ඞཁͳπʔϧʹݻࣥͤͣʹ ےͷྑ͍πʔϧΛબΜͰ͍͖͍ͨ
Graduate from
Sensu & Graphite Moden Monitoring Tool Monitoring Casual Talk In
Kyoto id:y_uuki
Thanks