Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Microservices Monitoring at mercari

Seigo Uchida
November 30, 2017

Microservices Monitoring at mercari

A talk about how is mercari adopting microservices and trying to monitor it.

Monitoring Seminar in mercari
https://mackerelio.connpass.com/event/71256/

Seigo Uchida

November 30, 2017
Tweet

More Decks by Seigo Uchida

Other Decks in Technology

Transcript

  1. Datadog discovers monitoring configurations in Kubernetes manifest (annotations) annotations: service-discovery.datadoghq.com/apache.check_names:

    '["apache","http_check"]' service-discovery.datadoghq.com/apache.init_configs: '[{},{}]' service-discovery.datadoghq.com/apache.instances: '[{"apache_status_url": "http://%%host%%/server-status?auto"},{"name": "My service", "url": "http://%%host% %", timeout: 1}]'
  2. NG - Alert on CPU usage OK - Alert on

    server latency Alert on work metrics
  3. Frontend (CDN, Synthetic, Browser) Backend (Trace, Profile, Error) Infrastructure (LB,

    Server, DB…) Events (Deploy, Auto-Scale, SaaS/Iaas) Logs (Frontend ~ Infrastructure) Business metrics (KGI, KPI)
  4. SLO + Error Budget Failure Friday (On-Call training) Monitoring Guide

    (documentation) Processes monitoring (kubelet etc) Topology Map End-to-End error / log tracking Internal status page