Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Monitoring Casual in Kyoto / Sensu + Graphite
Search
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Technology
28k
6
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Monitoring Casual in Kyoto / Sensu + Graphite
Monitoring Casual in Kyoto 11/30
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Transcript
52 slides
Sensu & Graphite Moden Monitoring Tool .POJUPSJOH$BTVBM5BML*O,ZPUP JEZ@VVLJ
id:y_uuki
2011 / 08 ͯͳΠϯλʔϯ
2012 / 09 ΞϧόΠτࢯ
2013 / 07
2013 / 09
2013 / 11
2013 / 12
None
In Kyoto
Monitoring
NFUSJDTDPMMFDUJPO Today NFUSJDTWJTVBMJTBUJPO health check alert notification
Monitoring Tool
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
Case 1
None
? Scalable & Robust - Munin 2.0 ? ✓ Pluggable
- munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
Case 2
Collectd + Cacti + RRDtool
✗ Scalable & Robust - because of RRDtool (cannot replicate)
✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
Case 3
Graduate from
(SBQIJUF Scalable Realtime Graphing
Graphite Data Flow Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics Graph JSON Store Get Graphite
3&45"1* - Graph rendering - JSON ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - Webapp
Frontend - Storage
Replication / Sharding Carbon Relay Whisper metrics Carbon Whisper Carbon
Whisper Carbon
Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
4FOTV A monitoring framework that aims! to be simple, malleable,
and scalable
.POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down
- Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server
Redis sensu- client run checks checks run handlers store notification checks check request
None
None
More Detail • https://speakerdeck.com/joemiller/introduction- to-sensu • http://www.slideshare.net/jeremy_carroll/ sensu-14485155 • https://speakerdeck.com/joemiller/practical-
examples-with-sensu-monitoring-framework
(SBQIJUF 4FOTV
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
✓ Scalable & Robust - Maybe ✓ Pluggable - sensu
plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
Graphite & RabbitMQ Integration
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
Stack Visualisation Storage Collector Collector Agent .VOJO $BDUJ $PMMFDUE (SBQIJUF
4FOTV 33%UPPM
Other Solution Storage
OpenTSDB Kairos InfluxDB
Other Solution Collector
fluentd?
Integration with other tools
log health Infrastructure Information metrics Dynamic Static Host, Service, Role,
Network, Location …
log health Integration Viewer metrics Dynamic Static Integration View Host,
Service, Role, Network, Location …
log health Host, Service, Role, Network, Location … Integration with
API metrics Dynamic Static Integration View JSON
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
ҟৗͳྗ͕ඞཁͳπʔϧʹݻࣥͤͣʹ ےͷྑ͍πʔϧΛબΜͰ͍͖͍ͨ
Graduate from
Sensu & Graphite Moden Monitoring Tool Monitoring Casual Talk In
Kyoto id:y_uuki
Thanks
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
「アラーティング」の話をしよう— SREconや論文等の最先端とのギャップをみる
yuukit
7
2.2k
SAKURAONE:An Open Ethernet-based AI HPC System And Its Observed Workload Dynamicsin a Single-Tenant LLM Development Environment
yuukit
1
770
AIスーパーコンピュータにおけるLLM学習処理性能の計測と可観測性 / AI Supercomputer LLM Benchmarking and Observability
yuukit
1
1.3k
SREはサイバネティクスの夢をみるか? / Do SREs Dream of Cybernetics?
yuukit
3
880
SREのためのテレメトリー技術の探究 / Telemetry for SRE
yuukit
14
4.1k
AIスパコン「さくらONE」の オブザーバビリティ / Observability for AI Supercomputer SAKURAONE
yuukit
2
1.6k
AIスパコン「さくらONE」のLLM学習ベンチマークによる性能評価 / SAKURAONE LLM Training Benchmarking
yuukit
2
1.4k
とあるSREの博士「過程」 / A Certain SRE’s Ph.D. Journey
yuukit
11
7.8k
eBPFを用いたAIネットワーク監視システム論文の実装 / eBPF Japan Meetup #4
yuukit
3
2k
Other Decks in Technology
See All in Technology
個人ASを取得して、自宅Kubernetes上のVMをグローバルIPで公開した話
munenick
0
220
AI-Ready なデータ基盤ってなに? & 新卒未経験が、いま考えていること
imuta
0
1.1k
農家は秘伝のタレを知らない - NOBODY KNOWS THE HIDDEN SOURCE - Kaggriculture 3rd Place Solution
masspeaks
3
670
SORACOM × AWS IoT Core でSREする
butadora
0
120
Context parameters で作る!はじめての型クラス
kworkdev
PRO
1
170
IP重複は"ランディングVPC"で受け止める ― PrivateLink と Transit Gatewayによるマルチテナント接続基盤の設計
hatahata021
3
260
目を覚ませ!僕らの認証情報が何者かに侵略されてるぞ
tkito
2
480
みん強Lightning! データ基盤ひとりでできるかな
endonanana
0
170
異夢同船〜異なる夢でも同じ船でなんとかする〜
fortegp05
1
580
そのイメージ、どのCIが作った? Artifact Attestationsで来歴を固定する / Which CI system created that image? Pinning provenance with Artifact Attestations
chmikata
0
220
専門家に使ってもらうAIプロダクトをつくる - 病院の医事課向けDPCコーディング支援システムの設計と評価
hagino3000
4
990
メール到達性を支える、リンク先URLのドメイン評価の扱い方
wind111
0
190
Featured
See All Featured
What does AI have to do with Human Rights?
axbom
PRO
1
2.5k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
reverentgeek
1
680
Principles of Awesome APIs and How to Build Them.
keavy
128
18k
The World Runs on Bad Software
bkeepers
PRO
72
12k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.7k
YesSQL, Process and Tooling at Scale
rocio
174
15k
It's Worth the Effort
3n
188
29k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
46
3.1k
30 Presentation Tips
portentint
PRO
1
480
Web Performance Is a Journey [PerfNow 2026]
tammyeverts
2
110
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
123
22k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
50
10k