NDC 2015 - The guide to measure what matters

Presented at NDC Oslo 2015

How do you monitor the key performance indicators of your application? Do you know if signups are decreasing versus last week? Have you adopted agile principles but also a hard time to monitor the improvements of your continuous deployments?

In this talk we will briefly discuss multiple measuring solutions before diving into the nitty-gritty details of measuring with the help of StatsD. We will implement a few counters and timers and graph these so we can start to make sense of the data. Then we will use powerful functions to analyse the data and spot trends before your users do.

After this talk you will be empowered to create your own data metrics with help of StatsD and have basic knowledge how to plot these metrics into meaningfull graphs. Be empowered!

Code examples will be in C# but technology demonstrated is not limited to this.

Transcript

1. THE GUIDE TO MEASURE WHAT MATTERS @markvanstraten
2. << PLAATJE DESIGN MUSEUM >>
3. << PLAATJE PHILIPS HUE >>
4. WE DEVELOP ONE- OFF SOLUTIONS
5. HOW DO WE MAKE MAINTENANCE CHEAP, FAST & FUN
6. THE CLOUD RESULTED IN LESS CONTROL
7. << PLAATJE DENHAAG.COM >>
8. Time until content update is visible? no# of views in correct translation? Actuality of our parking info?
9. WHY STATSD?
10. DO ONE THING AND DO IT WELL
11. MEASURE WHAT YOU WANT
12. SPEED OVER CONSISTENCY
13. whisper 7 StatsD Carbon Graphite Measurements Aggregator Backend Rendering UI Application
14. SIMPLE TO USE “key : value | type” $echo "deploy.succeeded:1|c" | nc -w 1 -u 127.0.0.1 8125
15. SENDING DATA FROM C# PM> Install-Package StatsdClient StatsdClient.Metrics.Configure(new MetricsConfig { StatsdServerName = "127.0.0.1", Prefix = "website" }); StatsdClient.Metrics.Counter("coffee.brewed"); using (StatsdClient.Metrics.StartTimer("document.saved")){ await db.Save(document); }
16. C# SCALA JAVA RUBY PYTHON ...
17. COUNTERS no# of views in correct language?
18. COUNTERS << GRAPH TONEN? >>
19. TIMERS Time until content update is visible? Duration of page request?
20. TIMERS
21. GAUGES no# events in database?
22. GAUGES
23. DOCKER https://github.com/kamon-io/docker-grafana-graphite VAGRANT https://github.com/crunchie84/ubuntu-statsd-server-installer HOSTED https://www.hostedgraphite.com
24. “There are only two hard things in CS: cache invalidation and naming things.” - Phil Karlton
25. KNOW WHAT YOU WANT TO MEASURE
26. ACTIONABLE METRICS = ❤
27. KEYS.CAN.CONTAIN .PATH.SEPARATORS
29. {APP.NAMESPACE.TARGET.ACTION} WEBSITE.REQUEST.RESPONSE.TIME WEBSITE.CONTENT.TRANSLATION.FOUND
30. KEEP DYNAMIC PARTS AS DEEP AS POSSIBLE
31. DATA BY ITSELF HAS NO VALUE TO ANYONE
32. whisper Graphite Grafana
33. << PLAATJE GRAFANA >>
36. TIMESHIFT
37. ANNOTATIONS $echo "deploy.succeeded:1|c" | nc -w 1 -u 127.0.0.1 8125
39. TAKE AWAYS
40. YOU KNOW WHAT TO MEASURE
41. DEVOPS IS REAL; INSTRUMENT YOUR CODE
42. STATSD WILL NEVER BREAK PRODUCTION
43. YOU CAN BE ENLIGHTENED IN 5 MINUTES
44. @markvanstraten using (Metrics.StartTimer("talk.questions")) { await audience.askQuestions(); }