Metrics Monitoring in Go

Transcript

1. Metrics monitoring Paris MAY 23 2018 Pierre Margueritte Datadog @mfpierre
2. What’s on the menu Intro to metrics monitoring Push vs Pull Go Tooling Visualization Questions
3. About Datadog Metrics monitoring in Go
4. Collecting data is cheap; not having it when you need it can be expensive
5. The 3 pillars of observability Metrics monitoring in Go Logs Traces Metrics
6. Anatomy of a metric Metrics monitoring in Go
7. It’s all about context Metrics monitoring in Go
8. The Internet Push doesn’t scale. Pull doesn’t scale.
9. The Push Model Metrics monitoring in Go monitoring client push Application
10. The Push Model Metrics monitoring in Go • Service discovery: know where to push • Retry policy: handle network interruption/delay • Backlog & backpressure: handle peaks & batches • Footprint bound to metric throughput
11. The Pull Model Metrics monitoring in Go monitoring exporter Application scrape
12. The Pull model Metrics monitoring in Go • Service discovery: know where to pull from • No events • Risk of losing outliers • Footprint bound to number of metrics
13. Go Tooling
14. Push: StatsD Metrics monitoring in Go
15. Push: StatsD Metrics monitoring in Go • Local daemon collecting/aggregating • Metric types ◦ Counter ◦ Gauges ◦ Timers ◦ Sets • Tag support: DogstatsD
16. Push: StatsD Metrics monitoring in Go
17. Pull: Go expvar Metrics monitoring in Go
18. Pull: Go expvar Metrics monitoring in Go • Part of the standard library • Metric types ◦ Int/Float ◦ String ◦ Map ◦ Func ◦ Custom types • Great for debugging at runtime
19. Pull: Go expvar Metrics monitoring in Go
20. Pull: Go expvar /debug/vars Metrics monitoring in Go
21. Pull: Prometheus Metrics monitoring in Go
22. Pull: Prometheus Metrics monitoring in Go • Becoming CNCF standard • Metric types ◦ Counter ◦ Gauge ◦ Histogram/Summary • Push gateway • Supported by OpenCensus
23. Pull: Prometheus Metrics monitoring in Go
24. Pull: Prometheus Metrics monitoring in Go
25. Pull: Prometheus Metrics monitoring in Go
26. Visualization
27. Examples with Datadog Metrics monitoring in Go
28. Happy monitoring!