Instrumenting The Rest Of The Company: Hunting For Metrics

Instrumenting The Rest Of The Company: Hunting For Metrics

Presented at Monitorama 2017, video at: https://youtu.be/wnjCNBfH3kg?t=3h3m35s

7067ff85573929e5257aa9e9c1069de9?s=128

Eric Sigler

May 23, 2017
Tweet

Transcript

  1. 1.

    @esigler Instrumenting The Rest Of The Company: Hunting For Useful

    Metrics Eric Sigler, Head of DevOps, PagerDuty
  2. 7.

    @esigler "What data did you use to understand $foo? And

    how will we know if $bar improved anything?”
  3. 10.
  4. 11.
  5. 12.
  6. 14.
  7. 15.

    @esigler "We have a problem with people not knowing what

    the chatbot does, so we're going to write better documentation."
  8. 16.
  9. 18.
  10. 19.

    @esigler “If only there was some way we could track

    events, and show them over time.”
  11. 20.
  12. 21.
  13. 22.
  14. 23.
  15. 24.
  16. 26.
  17. 27.
  18. 30.
  19. 31.
  20. 32.
  21. 33.
  22. 35.
  23. 37.
  24. 40.
  25. 42.
  26. 43.
  27. 46.
  28. 47.
  29. 48.
  30. 50.
  31. 51.
  32. 54.

    @esigler Potpourri: Data collection (chat, email, calendars) Cross-validation of metrics

    (“Sniff test”) Cognitive biases around metrics Plotting against organization events
  33. 55.

    @esigler Takeaways: Useful metrics are everywhere You aren’t alone in

    digging for metrics Existing tools can be repurposed Look to reverse engineer your way to a metric Look for proxy metrics (but choose wisely)