Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Monitoring Casual in Kyoto / Sensu + Graphite
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Technology
6
26k
Monitoring Casual in Kyoto / Sensu + Graphite
Monitoring Casual in Kyoto 11/30
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Tweet
Share
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
AIOps研究録―SREのための システム障害の自動原因診断 / SRE NEXT 2022
yuukit
7
5k
Interactive AIOps
yuukit
0
850
Meltria: マイクロサービスにおける 異常検知・原因分析のための データセットの動的生成システム / Meltria in IOTS2021
yuukit
1
720
AIOpsの研究動向と AIOps向けデータセットの動的生成の研究 / Introducing AIOps and A Dynamic Datasets Generating System
yuukit
1
280
分散アプリケーションの高信頼化のための 運用技術に関する研究 / A Study on Operation Technology for High Reliability of Distributed Applications
yuukit
1
390
ネットワークサービスの依存発見に向いた TCP/UDP通信の低負荷なトレース手法 / Low Overhead TCP-UDP Tracing in Kernel
yuukit
5
2.9k
クラウドのシステム運用技術に機械学習を応用する研究 / CLOUD AI
yuukit
4
2.4k
TSifter: マイクロサービスにおける性能異常の迅速な診断に向いた時系列データの次元削減手法 / TSifter in proceedings of IOTS2020
yuukit
1
1.5k
TSifter: マイクロサービスにおける性能異常の 迅速な診断に向いた時系列データの次元削減手法
yuukit
0
98
Other Decks in Technology
See All in Technology
Design for Humans: How to make better modernization decisions
indualagarsamy
2
130
【個人的】オブジェクト指向の現在地
toranoana
0
190
ソフトウェアテスト自動化、一歩前へ
yoshikiito
7
1.1k
FoodTechにおける商流・金流・物流の進化/Evolution of Commercial, Financial, and Logistics in FoodTech
dskst
0
420
220628 「Google AppSheet」タスク管理アプリをライブ作成 吉積情報伊藤さん
comucal
PRO
0
250
eBPF for Security Observability
lizrice
0
220
データ分析で切り拓け! エンジニアとしてのデータ分析職キャリア戦略
ksnt
0
180
Apple M1 CPUの脆弱性「PACMAN」について解説する
kuzushiki
0
110
2024卒_freee_エンジニア職(ポテンシャル採用)_説明資料
freee
0
320
要約 "Add Live Text interaction to your app"
ushisantoasobu
0
150
実際にリビルドを完遂してみて
tmiura0203
0
100
サイボウズの アジャイル・クオリティ / Agile Quality at Cybozu
cybozuinsideout
PRO
4
2.5k
Featured
See All Featured
How New CSS Is Changing Everything About Graphic Design on the Web
jensimmons
213
11k
Fontdeck: Realign not Redesign
paulrobertlloyd
73
4.1k
Intergalactic Javascript Robots from Outer Space
tanoku
261
25k
Agile that works and the tools we love
rasmusluckow
319
19k
GraphQLの誤解/rethinking-graphql
sonatard
28
6.6k
Imperfection Machines: The Place of Print at Facebook
scottboms
253
12k
Creatively Recalculating Your Daily Design Routine
revolveconf
207
10k
Bash Introduction
62gerente
597
210k
The Mythical Team-Month
searls
209
39k
It's Worth the Effort
3n
172
25k
Web development in the modern age
philhawksworth
197
9.3k
Documentation Writing (for coders)
carmenhchung
48
2.6k
Transcript
Sensu & Graphite Moden Monitoring Tool .POJUPSJOH$BTVBM5BML*O,ZPUP JEZ@VVLJ
id:y_uuki
2011 / 08 ͯͳΠϯλʔϯ
2012 / 09 ΞϧόΠτࢯ
2013 / 07
2013 / 09
2013 / 11
2013 / 12
None
In Kyoto
Monitoring
NFUSJDTDPMMFDUJPO Today NFUSJDTWJTVBMJTBUJPO health check alert notification
Monitoring Tool
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
Case 1
None
? Scalable & Robust - Munin 2.0 ? ✓ Pluggable
- munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
Case 2
Collectd + Cacti + RRDtool
✗ Scalable & Robust - because of RRDtool (cannot replicate)
✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
Case 3
Graduate from
(SBQIJUF Scalable Realtime Graphing
Graphite Data Flow Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics Graph JSON Store Get Graphite
3&45"1* - Graph rendering - JSON ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - Webapp
Frontend - Storage
Replication / Sharding Carbon Relay Whisper metrics Carbon Whisper Carbon
Whisper Carbon
Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
4FOTV A monitoring framework that aims! to be simple, malleable,
and scalable
.POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down
- Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server
Redis sensu- client run checks checks run handlers store notification checks check request
None
None
More Detail • https://speakerdeck.com/joemiller/introduction- to-sensu • http://www.slideshare.net/jeremy_carroll/ sensu-14485155 • https://speakerdeck.com/joemiller/practical-
examples-with-sensu-monitoring-framework
(SBQIJUF 4FOTV
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
✓ Scalable & Robust - Maybe ✓ Pluggable - sensu
plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
Graphite & RabbitMQ Integration
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
Stack Visualisation Storage Collector Collector Agent .VOJO $BDUJ $PMMFDUE (SBQIJUF
4FOTV 33%UPPM
Other Solution Storage
OpenTSDB Kairos InfluxDB
Other Solution Collector
fluentd?
Integration with other tools
log health Infrastructure Information metrics Dynamic Static Host, Service, Role,
Network, Location …
log health Integration Viewer metrics Dynamic Static Integration View Host,
Service, Role, Network, Location …
log health Host, Service, Role, Network, Location … Integration with
API metrics Dynamic Static Integration View JSON
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
ҟৗͳྗ͕ඞཁͳπʔϧʹݻࣥͤͣʹ ےͷྑ͍πʔϧΛબΜͰ͍͖͍ͨ
Graduate from
Sensu & Graphite Moden Monitoring Tool Monitoring Casual Talk In
Kyoto id:y_uuki
Thanks