Monitoring Casual in Kyoto / Sensu + Graphite

Monitoring Casual in Kyoto / Sensu + Graphite

Monitoring Casual in Kyoto 11/30

A658ec7f1badf73819dfa501165016c1?s=128

Yuuki Tsubouchi (yuuk1)

November 30, 2013
Tweet

Transcript

  1. 9.
  2. 10.
  3. 14.

    Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓

    Programmable ✓ Friendly to immutable infrastructure ✓ Simple 
  4. 15.
  5. 16.
  6. 17.

    ? Scalable & Robust - Munin 2.0 ? ✓ Pluggable

    - munin-node plugin ✗ Programmable - API ͳ͠ ✗ Friendly to immutable infrastructure - ઃఆϑΝΠϧʹ؂ࢹϊʔυͷϦετ͕ඞཁ (serf ͰͳΜͱ͔ͳΔ) ✗ Simple - because of RRDtool
  7. 18.
  8. 20.

    ✗ Scalable & Robust - because of RRDtool (cannot replicate)

    ✓ Pluggable - collectd input / output plugin (like fluentd) ✗ Programmable - Cacti ͸ API ͳ͠ ✗ Friendly to immutable infrastructure - Must configure node list ✗ Simple - because of RRDtool
  9. 21.
  10. 27.

    Many Better Dashboards Graphite Webapp Carbon Whisper Collector TCP HTTP

    metrics JSON Store Get Graphite Dashboard Graphiti, Gdash, Pencil, Graphene…
  11. 29.

    .POJUPSJOH3PVUFS - Checks plugin: ex. Apache is up or down

    - Handlers plugin: ex. sending alert e-mails ! )JHI*OEFQFOEFODZ"SDIJUFDUVSF - RabbitMQ - Redis - JSON
  12. 30.

    Sensu Data Flow sensu- client sensu- client RabbitMQ sensu server

    Redis sensu- client run checks checks run handlers store notification checks check request
  13. 31.
  14. 32.
  15. 35.

    Sensu & Graphite Data Flow sensu- client sensu- client sensu-

    client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
  16. 36.

    ✓ Scalable & Robust - Maybe ✓ Pluggable - sensu

    plugin & sensu handler ✓ Programmable - Graphite: REST API & Carbon TCP API! - Sensu: Events API & Checks API … etc ✓ Friendly to Immutable Infrastructure - ؂ࢹϊʔυͷઃఆ͍Βͣ ✓ Simple - Sensu: Ruby, Redis, RabbitMQ, JSON! - Graphite: REST API
  17. 38.

    Sensu & Graphite Data Flow sensu- client sensu- client sensu-

    client RabbitMQ sensu server Redis Graphite Webapp Carbon Whisper
  18. 43.
  19. 47.

    log health Host, Service, Role, Network, Location … Integration with

    API metrics Dynamic Static Integration View JSON
  20. 48.

    Monitoring Tool Requirement ✓ Scalable & Robust ✓ Pluggable ✓

    Programmable ✓ Friendly to immutable infrastructure ✓ Simple 
  21. 52.