Getting Started with Data-Driven Coaching

1100c19690e8eb006da7a35a6b17be97?s=47 Julia Wester
October 04, 2019

Getting Started with Data-Driven Coaching

W. Edwards Deming said, “You can’t manage what you can’t measure.” But all too often, teams fall prey to misleading metrics, missing invaluable opportunities to grow and improve. Our job as coaches is to help shine the light down the ideal path. This session will show you how to visualise and use metrics in a team coaching practice. Come and learn how teams can see and balance a set of competing metrics and anticipate the impact of process changes.

1100c19690e8eb006da7a35a6b17be97?s=128

Julia Wester

October 04, 2019
Tweet

Transcript

  1. @everydaykanban | @55DegreesAB #agilecam Getting started with data-driven coaching Julia

    Wester - Coach, Consultant, and Trainer - 55 Degrees AB
  2. Meaning is in the eye of the beholder @everydaykanban |

    @55DegreesAB 2 #agilecam “What a slacker!” “Wow, I bet they’re working on other priorities right now.” “Makes sense. That person’s code was part of a deep exploratory testing session.”
  3. “Tell me how you’ll measure me and I’ll tell you

    how I’ll behave. –Eli Goldratt @everydaykanban | @55DegreesAB 3 #agilecam
  4. What do your metrics incentivize? @everydaykanban | @55DegreesAB 4 #agilecam

  5. What do your metrics incentivize? @everydaykanban | @55DegreesAB 5 #agilecam

    –W. Edwards Deming “If you give a manager a numerical target, he’ll make it, even if he has to destroy the organization in the process.”
  6. What if you were this developer? @everydaykanban | @55DegreesAB 6

    #agilecam
  7. “Tell me how you’ll measure me and I’ll tell you

    how I’ll behave. If you measure me in illogical ways, do not complain about illogical behavior.” –Eli Goldratt @everydaykanban | @55DegreesAB 7 #agilecam
  8. @everydaykanban | @55DegreesAB 8 What is Data-Driven Coaching? #agilecam Helping

    teams responsibly interpret data to identify areas of improvement Helping teams avoid over-emphasizing any one measurement 1 2
  9. Measure what really matters @everydaykanban | @55DegreesAB 9 #agilecam not

    what’s easy or convenient
  10. @everydaykanban | @55DegreesAB 10 #agilecam Decide on outcomes then determine

    your metrics Reduced time / cost for rework Are we finding defects early enough? # of Escaped Defects Should we increase time spent on testing? think of small, day-to-day decisions Larry Maccherone
  11. Escaped Defects @everydaykanban | @55DegreesAB 11 #agilecam defects found in

    production Question if the measure really provides expected insight!
  12. @everydaykanban | @55DegreesAB 12 #agilecam You might not get it

    right the first time Reduced time / cost for rework Are we finding defects early enough? Should we increase time spent on testing? # of Escaped Defects # of defects found in each environment
  13. @everydaykanban | @55DegreesAB 13 #agilecam Defects by Environment counts Keep

    questioning until you’re happy enough
  14. @everydaykanban | @55DegreesAB 14 #agilecam Inspect and adapt Reduced time

    / cost for rework Are we finding defects early enough? Should we increase time spent on testing? # of Escaped Defects # of defects found in each environment % of defects found in each environment
  15. @everydaykanban | @55DegreesAB 15 #agilecam Defects by Environment percentages

  16. @everydaykanban | @55DegreesAB 16 #agilecam If a metric can’t be

    mapped to an outcome, discard it!
  17. @everydaykanban | @55DegreesAB 17 #agilecam No longer need the insight?

    Discard the metric! Make these topics part of your retrospectives!
  18. Measure teams, not individuals @everydaykanban | @55DegreesAB 18 #agilecam if

    you want people to act like a team
  19. What you measure tells the story of what you value

    @everydaykanban | @55DegreesAB 19 #agilecam
  20. Value vs. Cost - A true story @everydaykanban | @55DegreesAB

    20 #agilecam
  21. The Superstar: A cautionary tale @everydaykanban | @55DegreesAB 21 #agilecam

  22. If you want stellar individuals, put more focus on individual

    outcomes If you want stellar teams, put more focus on team outcomes. @everydaykanban | @55DegreesAB 22 #agilecam
  23. Don’t use metrics to shame people @everydaykanban | @55DegreesAB 23

    #agilecam if you want the data to show reality
  24. “Fear invites wrong figures. Bearers of bad news fare badly.

    To keep his job, anyone may present to his boss only good news.” -W. Edwards Deming @everydaykanban | @55DegreesAB 24 #agilecam
  25. What if this picture is misleading? @everydaykanban | @55DegreesAB 25

    #agilecam What could these people be doing to stay behind the line?
  26. Use multiple, competing metrics @everydaykanban | @55DegreesAB 26 #agilecam to

    avoid unintended consequences https://john-lewis-artist.deviantart.com/
  27. What will happen if you measure this, but not this?

    @everydaykanban | @55DegreesAB 27 #agilecam
  28. @everydaykanban | @55DegreesAB 28 #agilecam

  29. @everydaykanban | @55DegreesAB 29 #agilecam

  30. @everydaykanban | @55DegreesAB 30 #agilecam A helpful template to guide

    you... Metric for current quadrant Metric for opposing quadrant Troy Magennis Focused Objective
  31. @everydaykanban | @55DegreesAB 31 #agilecam A helpful template to guide

    you... Troy Magennis Focused Objective
  32. @everydaykanban | @55DegreesAB 32 #agilecam Behavioral Polarity Worksheet Troy Magennis

    Focused Objective
  33. @everydaykanban | @55DegreesAB 33 #agilecam A helpful template to guide

    you... Troy Magennis Focused Objective
  34. @everydaykanban | @55DegreesAB 34 #agilecam Give a cheat sheet! •

    What is the chart • Intended behavior • How to game it • When overdriven, what moves? Download these tools: http://bit.ly/SimResources Troy Magennis Focused Objective
  35. @everydaykanban | @55DegreesAB 35 #agilecam Reflect and Discuss Are certain

    areas more important in your context?
  36. @everydaykanban | @55DegreesAB 36 #agilecam Sometimes trade-offs are ok, even

    necessary
  37. Highlight trends, not data points @everydaykanban | @55DegreesAB 37 #agilecam

    to avoid distraction from insignificant variation
  38. How to put a focus on trends @everydaykanban | @55DegreesAB

    38 #agilecam No Y-Axis Tiny #s When applicable, connect data points with lines Show Trend Line Project Trend
  39. Compare trends across teams to spot system-level opportunities @everydaykanban |

    @55DegreesAB 39 #agilecam Troy Magennis Focused Objective ^in a safe way
  40. Show me when to worry @everydaykanban | @55DegreesAB 40 #agilecam

    don’t make me guess or waste my time off
  41. Not all variation is cause for alarm @everydaykanban | @55DegreesAB

    41 #agilecam
  42. “First, do no harm.” “If anyone adjusts a stable process,

    the output that follows will be worse than if (s)he had left the process alone.” -W. Edwards Deming @everydaykanban | @55DegreesAB 42 #agilecam
  43. @everydaykanban | @55DegreesAB 43 Find Leading Indicators #agilecam

  44. @everydaykanban | @55DegreesAB 44 When we do our job well,

    we help teams: #agilecam responsibly interpret data to identify areas of improvement avoid over-emphasizing any one measure and create a healthy whole 1 2
  45. @everydaykanban | @55DegreesAB 45 #agilecam What’s your next step?

  46. @everydaykanban | @55DegreesAB 46 #agilecam julia@55degrees.se @everydaykanban & @55DegreesAB https://55degrees.se

    http://everydaykanban.com https://www.linkedin.com/in/juliawester/ I’d love to hear from you