Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Quality Radar Talk + Workshop (ATD2022)

Quality Radar Talk + Workshop (ATD2022)

30 min talk + 90 min workshop for Agile Testing Days 2022 in Potsdam, Germany.
Co-facilitated with Tom Guest

Avatar for Nicola Sedgwick

Nicola Sedgwick

November 10, 2023

Other Decks in Technology

Transcript

  1. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST AGENDA. Part 1 ▸ The Origin Story ▸ A Quality Radar for YOUR context Part 2 ▸ The Workshop Structure ▸ Moving from Visualisation to Action ▸ Real Life Impact Note: ▸ All resources will be shared (at the end) ▸ We will be taking a break
  2. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST PROBLEM. ▸ What does good look like? AND ▸ How do we know we’re achieving it? SOFTWARE Tested Duplicate free Feature rich? Edge cases covered? Ugly or Beautiful Well factored Slow or fast
  3. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST INSPIRATION. https://twitter.com/GeePawHill/status/1340682169673527300
  4. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST INSPIRATION. ESQ ISQ SOFTWARE Software quality attributes that A USER can SEE Software quality attributes that WE SEE while LOOKING AT CODE
  5. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST CREATION. ESQ ISQ Linters Code Review Mutants Features Speed UX Screens Pairing Security SOFTWARE Quality Habits Tooling Practices Processes Team
  6. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST CREATION. ESQ ISQ SOFTWARE Compromising ESQ can SPEED UP Time-to-Market Compromising ISQ will always SLOW DOWN productivity Linters Code Review Mutants Features Speed UX Screens Pairing Security
  7. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST EXTENSION. ESQ ISQ Brand Quality Trust Pilot NPS User Research
  8. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. ESQ ISQ Brand Quality Trust Pilot NPS User Research Linters Code Review Mutants Features Speed UX Screens Pairing Security
  9. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. Trust Pilot NPS User Research Linters Code Review Mutants Features Speed UX Screens Pairing Security
  10. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. SCRIPTED Unit Tests Contract Tests Compliance Checks Pen Tests Blue/ Green Deploys Trust Pilot NPS User Research Code Review Features UX Screens Pairing
  11. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. OBSERVABLE SCRIPTED Tracing Alerts Unit Tests Contract Tests Compliance Checks Pen Tests Blue/ Green Deploys Trust Pilot A/B Tests NPS CSAT User Research Code Review Features UX Pairing
  12. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. OBSERVABLE COLLABORATIVE SCRIPTED Tracing Alerts OKRs Story Mapping Pairing Unit Tests Contract Tests Compliance Checks Pen Tests Blue/ Green Deploys Trust Pilot A/B Tests NPS CSAT Event Storms Demo Survey User Research UX
  13. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST SEGMENTATION. OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Pen Tests Blue/ Green Deploys A/B Tests NPS CSAT Test Charter User Research Event Storms Demo Survey
  14. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST EXPERIMENTATION. OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY WHAT WOULD YOURS LOOK LIKE?
  15. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST EXERCISE 1 ▸ Fill in a blank radar template with quality practices, tools and techniques relevant to your context. ▸ 5 mins per quadrant: ▸ Scripted ▸ Observable ▸ Collaborative ▸ Exploratory
  16. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST EXERCISE 1 ▸ Take 5: Grab a drink and a snack, then come back and find a partner ▸ Spend at least 2 mins telling each other about your radar ▸ When we call you back to your tables, spend 5 mins sharing any thoughts from your discussions in pairs ▸ Any questions/thoughts?
  17. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST REPEATABLE WORKSHOP ▸ Preparation before a Quality Radar session ▸ Set-up a pre-filled radar ▸ Find a calendar slot and invite the whole team ▸ Agenda for the 1 hour session ▸ 10 min Introduction to the Quality Radar and the session structure ▸ 4 x 5 min time boxes to apply emojis to each segment of the Quality Radar ▸ 10-15 mins to handle clarifications ▸ 15 mins to identify next steps and wrap up the session ▸ Follow up after a session ▸ Use time boxes to follow up on actions
  18. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  19. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  20. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🤮 🤩 🤩 🚦 🚦 OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  21. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🚦 🤮 🤩 🤩 ❓ ❓ ❓ 🚦 🚦 🤩 🤩 🤩 OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  22. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🚦 🤮 🤩 🤩 ❓ ❓ ❓ ❓ 🚦 🚦 🚦 🤩 🤩 🤩 🤩 🤩 🤮 🤩 🤩 OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  23. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🤩 🚦 ❓ 🤮 🤩 🤩 🤩 🤩 ❓ ❓ ❓ ❓ 🚦 🚦 🚦 🚦 🤮 🤩 🤩 🤩 🤩 🤩 🤮 🤩 🤩 🤩 OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  24. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes System Tours Brand Insights Unit Tests Contract Tests Compliance Checks Blue / Green Deploys CSAT NPS Demo Survey Event Storms Test Charter User Research Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🤩 🚦 ❓ 🤮 🤩 🤩 🤩 🤩 ❓ ❓ ❓ ❓ 🚦 🚦 🚦 🚦 🤮 🤩 🤩 🤩 🤩 🤩 🤮 🤩 🤩 🤩 ➡ Outcome = Visualisation of quality practices OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY
  25. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. System Tours Blue / Green Deploys Demo Pen Tests A/B Tests TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🚦 🚦 🚦 🚦 🚦 🤮 Filter to see what the team wants to introduce OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY 🚦
  26. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Brand Insights CSAT NPS Demo Survey Test Charter TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY ❓ 🤩 ❓ ❓ ❓ ❓ 🚦 🤮 🤮 Or filter to see where team opinions differ, or are confused OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY ❓ ❓❓
  27. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST FACILITATION. Trust Pilot Tracing Alerts OKRs Story Mapping Pairing Spikes Unit Tests Contract Tests Compliance Checks Demo Event Storms Test Charter User Research TEMPLATE 🤩 We’re doing this 🚦 We should start doing this ❓ We have questions 🤮 We should stop doing this KEY 🤩 🤮 🤩 🤩 🤩 🤩 🚦 🤮 🤩 🤩 🤩 🤩 🤩 🤮 🤩 🤩 🤩 Or filter the view to see what the team say they are actually doing OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY 🤩 🤮
  28. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST EXERCISE 2 ▸ Each table has 2 pre-filled Quality Radars ▸ [10 mins] Discuss your observations and leave notes on the radars: ▸ What questions would you ask? ▸ What would you advise these teams? ▸ Nominate a table member to share your observations with the room.
  29. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST BALANCED OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Tracing System Tours Demo Test Charter Pen Tests Spikes User Research Brand Insights Surveys Pairing Story Mapping Event Storms OKRs A/B Tests Trust Pilot NPS Alerts Compliance Checks Unit Tests Contract Tests Canary Deploys
  30. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 1. ESQ HEAVY OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Tracing System Tours Demo Test Charter Brand Insights Story Mapping Event Storms A/B Tests Trust Pilot Alerts Unit Tests Contract Tests Canary Deploys
  31. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 2. BUSINESS ONLY OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Brand Insights Story Mapping OKRs Trust Pilot Compliance Checks
  32. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 3. EMPTY QUADRANT OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Compliance Checks Unit Tests Contract Tests Tracing Trust Pilot Alerts Pairing Story Mapping OKRs
  33. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 4. ISQ HEAVY OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Trust Pilot Alerts Compliance Checks Unit Tests Spikes Pairing Story Mapping OKRs
  34. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 5. GAPS OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY System Tours Spikes Brand Insights Pairing OKRs Trust Pilot Unit Tests
  35. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST 6. TECHNICAL ONLY OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Tracing Spikes Pairing Alerts Unit Tests Contract Tests
  36. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST TEAM A. Alerts Story Mapping Pairing Spikes Unit Tests Demo OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY Canary Deploys UAT ACTIONS: 1. Assess maturity level of each practice the team say they are using 2. Hire an exploratory focussed Quality Engineer
  37. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST TEAM B. OKRs Story Mapping System Tours Brand Insights Event Storms Test Charter User Research OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY ❓ ❓ ❓ ❓ ❓ ❓ ❓ ❓ ❓ ❓ ❓ ACTIONS: 1. Arrange separate session this month to clear up questions 2. QE & EM pair this quarter to improve team engagement with exploratory practices
  38. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST TEAM C. Tracing OKRs Pairing Spikes Unit Tests Demo User Research OBSERVABLE COLLABORATIVE SCRIPTED EXPLORATORY ACTIONS: 1. Team agrees to use these practices as minimum standard until new service MVP is completed
  39. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST PROBLEM. ▸ What does good look like? AND ▸ How do we know we’re achieving it? THE QUALITY RADAR IS A TOOL THAT ALLOWS EASY VISUALISATION OF QUALITY PRACTICES AND HELPS A TEAM FOCUS ON THEIR CONTINUOUS IMPROVEMENT.
  40. CREATION OF THE QUALITY RADAR - NICOLA SEDGWICK & TOM

    GUEST THANKS ▸ Any Questions? ▸ Join https://QualityRadar.slack.com to ▸ Access resources (Miro Template, PDF template, slides) ▸ Sharing stories - we’d love to hear yours! ▸ Find us on LinkedIn ▸ https://www.linkedin.com/in/nicolasedgwick/ ▸ https://www.linkedin.com/in/thomas-guest-55639917/