Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Monitoring Casual in Kyoto / Sensu + Graphite
Search
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Technology
6
27k
Monitoring Casual in Kyoto / Sensu + Graphite
Monitoring Casual in Kyoto 11/30
Yuuki Tsubouchi (yuuk1)
November 30, 2013
Tweet
Share
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
エンジニアのためのSRE論文への招待 / Introduction to SRE Papers for Engineers
yuukit
1
5.7k
博士課程での研究まとめ 2023年1月版 / Summary of my research in the PhD course
yuukit
1
160
AI時代に向けたクラウドにおける信頼性エンジニアリングの未来構想 / DICOMO2022 6A-1
yuukit
7
2.6k
AIOps研究録―SREのための システム障害の自動原因診断 / SRE NEXT 2022
yuukit
9
11k
Interactive AIOps
yuukit
0
1.8k
Meltria: マイクロサービスにおける 異常検知・原因分析のための データセットの動的生成システム / Meltria in IOTS2021
yuukit
1
1.5k
AIOpsの研究動向と AIOps向けデータセットの動的生成の研究 / Introducing AIOps and A Dynamic Datasets Generating System
yuukit
1
650
分散アプリケーションの高信頼化のための 運用技術に関する研究 / A Study on Operation Technology for High Reliability of Distributed Applications
yuukit
1
710
ネットワークサービスの依存発見に向いた TCP/UDP通信の低負荷なトレース手法 / Low Overhead TCP-UDP Tracing in Kernel
yuukit
5
3.9k
Other Decks in Technology
See All in Technology
GraphQL 成熟度モデルの紹介と、プロダクトに当てはめた事例 / GraphQL maturity model
mh4gf
7
1.3k
MLOpsの「壁」を乗り越える、LINEヤフーの Data Quality as Code
lycorptech_jp
PRO
5
520
Java EE/Jakarta EEの現状と将来―クラウドネイティブ時代にJava EEは対応できるのか?―
takakiyo
1
160
LangSmith入門―トレース/評価/プロンプト管理などを担うLLMアプリ開発プラットフォーム
os1ma
3
160
障害対応をちょっとずつよくしていくための 演習の作りかた
heleeen
0
210
ServiceNow Knowledge 24の歩き方 EYストラテジー・アンド・コンサルティング
manarobot
0
200
Google Cloud Next '24でブログを10本書いた方法と勉強会を沸かせた方法
yasumuusan
0
300
Azureの基本的な権限管理の勉強会
yhana
0
440
現代CSSフレームワークの内部実装とその仕組み
poteboy
7
3.6k
AWSに詳しくない人でも始められるコスト最適化ガイド
yuhta28
1
230
TechFeed Experts Night#27 〜 フロントエンドフレームワーク最前線 (Svelte)
baseballyama
1
510
エンジニアのキャリアをちょっと楽しくする3本の軸/Three Pillars to Make an Engineer's Career More Enjoyable
kwappa
0
2.7k
Featured
See All Featured
Optimising Largest Contentful Paint
csswizardry
8
2.4k
Stop Working from a Prison Cell
hatefulcrawdad
266
19k
No one is an island. Learnings from fostering a developers community.
thoeni
16
2.1k
Music & Morning Musume
bryan
41
5.6k
A Modern Web Designer's Workflow
chriscoyier
689
190k
Creatively Recalculating Your Daily Design Routine
revolveconf
210
11k
Building an army of robots
kneath
300
41k
Atom: Resistance is Futile
akmur
259
25k
The Invisible Side of Design
smashingmag
294
49k
The Pragmatic Product Professional
lauravandoore
25
5.8k
The Language of Interfaces
destraynor
151
23k
Designing for Performance
lara
601
67k
Transcript
Sensu & Graphite Moden Monitoring Tool .POJUPSJOH$BTVBM5BML*O,ZPUP JEZ@VVLJ
id:y_uuki
2011 / 08 ͯͳΠϯλʔϯ
2012 / 09 ΞϧόΠτࢯ
2013 / 07
2013 / 09
2013 / 11
2013 / 12
None
In Kyoto
Monitoring
NFUSJDTDPMMFDUJPO Today NFUSJDTWJTVBMJTBUJPO health check alert notification
Monitoring Tool
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
Case 1
None
? Scalable & Robust - Munin 2.0 ? ✓ Pluggable
- munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
Case 2
Collectd + Cacti + RRDtool
✗ Scalable & Robust - because of RRDtool (cannot replicate)
✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
Case 3
Graduate from
(SBQIJUF Scalable Realtime Graphing
Graphite Data Flow Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics Graph JSON Store Get Graphite
3&45"1* - Graph rendering - JSON ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - Webapp
Frontend - Storage
Replication / Sharding Carbon Relay Whisper metrics Carbon Whisper Carbon
Whisper Carbon
Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP
metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
4FOTV A monitoring framework that aims! to be simple, malleable,
and scalable
.POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down
- Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server
Redis sensu- client run checks checks run handlers store notification checks check request
None
None
More Detail • https://speakerdeck.com/joemiller/introduction- to-sensu • http://www.slideshare.net/jeremy_carroll/ sensu-14485155 • https://speakerdeck.com/joemiller/practical-
examples-with-sensu-monitoring-framework
(SBQIJUF 4FOTV
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
✓ Scalable & Robust - Maybe ✓ Pluggable - sensu
plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
Graphite & RabbitMQ Integration
Sensu & Graphite Data Flow sensu- client sensu- client sensu-
client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
Stack Visualisation Storage Collector Collector Agent .VOJO $BDUJ $PMMFDUE (SBQIJUF
4FOTV 33%UPPM
Other Solution Storage
OpenTSDB Kairos InfluxDB
Other Solution Collector
fluentd?
Integration with other tools
log health Infrastructure Information metrics Dynamic Static Host, Service, Role,
Network, Location …
log health Integration Viewer metrics Dynamic Static Integration View Host,
Service, Role, Network, Location …
log health Host, Service, Role, Network, Location … Integration with
API metrics Dynamic Static Integration View JSON
Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓
Programmable ✓ Friendly to immutable infrastructure ✓ Simple
ҟৗͳྗ͕ඞཁͳπʔϧʹݻࣥͤͣʹ ےͷྑ͍πʔϧΛબΜͰ͍͖͍ͨ
Graduate from
Sensu & Graphite Moden Monitoring Tool Monitoring Casual Talk In
Kyoto id:y_uuki
Thanks