$30 off During Our Annual Pro Sale. View Details »

Is Quality The Bottleneck?

Jim Holmes
February 17, 2021

Is Quality The Bottleneck?

Webinar for Telerik by Progress.

This is *NOT* a technical or product talk; it's a general talk.

Discusses ways Quality/Testing is perceived (rightly or wrongly) as a bottleneck to shipping software. Walks through a number of ways to address helping individuals, teams, and organizations improve how quality efforts can reduce waste and increase value.

Jim Holmes

February 17, 2021
Tweet

More Decks by Jim Holmes

Other Decks in Technology

Transcript

  1. Is Quality The Bottleneck?
    The Role of Testing in the
    Modern Dev Cycle
    Presenter: Jim Holmes

    View Slide

  2. 2
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    I’m Jim
    I test
    I coach
    I fail (lots)
    I learn

    View Slide

  3. 3
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    “Easy”

    View Slide

  4. Takeaways for you

    View Slide

  5. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    What are one or two things you
    could look at differently in how
    your team/organization ships
    software?

    View Slide

  6. 6
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Survey 1:
    Challenges for Quality

    View Slide

  7. 7
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    What’s
    Changing in
    Quality?

    View Slide

  8. 8
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Economic Pressure
    Digital Experience (DX)
    Individual Value

    View Slide

  9. 9
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Quality Related Costs and Bottlenecks
    Economic Pressures
    High rework
    High support effort
    Loss of sales, reputation
    More collaboration
    Earlier collaboration
    Clearer risk/value

    View Slide

  10. 10
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    New Focus on Enabling Users
    Digital Experience (DX)
    LOTS of early work with users
    Journey mapping
    Interviews
    Workshops
    Earlier collaboration
    Far better user proxies
    Less confusion late in cycle!

    View Slide

  11. 11
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    New Areas to Help Team & Organization
    Individual Value
    Bias
    IoT (not just the buzzword)
    Big Data
    Understand modeling
    Dive into the
    domains/industries

    View Slide

  12. 12
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Survey 2:
    What Software Failures are
    You Seeing?

    View Slide

  13. 13
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    What’s
    The Same in
    Quality?

    View Slide

  14. 14
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Setting Expectations
    Stakeholder Engagement
    Building Skills and Roles

    View Slide

  15. 15
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Human Communication Is Hard
    Setting Expectations
    “Test Everything!”
    “Automate all test cases”
    “How long to test?”
    “What’s most important?”
    Better clarity for risk/value
    Avoid low-value edge cases

    View Slide

  16. 16
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Testers do NOT “Assure Quality”
    Engaging Stakeholders
    Releasing unknowns
    Quality viewed as a cost center
    Act as an “information
    broker”, not a gatekeeper
    Understand priorities
    Know “Why”

    View Slide

  17. 17
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    “What decisions do you need to make?
    What information do you need to make
    them?”

    View Slide

  18. 18
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Focus on Fundamentals First
    Skills and Roles
    Test Case Management pain
    Long regression cycles
    Testing late in sprint or N+1
    Collaboration
    Risk/value
    Stop writing test cases and
    do more testing

    View Slide

  19. 19
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Survey 3:
    Planning for Test
    Automation?

    View Slide

  20. 20
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Leveraging
    Automation

    View Slide

  21. Automation will not fix your bottlenecks
    Alone

    View Slide

  22. 22
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Automate the Right Things
    Automate Well
    Automate in the Sprint

    View Slide

  23. 23
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    (Focusing on UI
    Automation)

    View Slide

  24. 24
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Build Great Coverage
    Automate the Right Things
    Lots of low value tests
    Lots of duplication
    Slow tests
    Workflows versus features
    Know what devs test
    Build support frameworks

    View Slide

  25. 25
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Build Stable, High-Quality Tests
    Automate Well
    Scripts need maintenance
    Scripts are flakey
    Scripts don’t give good info
    Tests are production code
    Build together with devs
    Carefully choose scripts

    View Slide

  26. 26
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    “Done” Means Automated
    Automate in Sprint
    Feedback comes long after dev
    Fixing errors takes longer
    Get testing in Definition of
    Done
    Even MORE collaboration
    Scaffold scripts at start

    View Slide

  27. Testing and Quality
    should NOT be a
    bottleneck

    View Slide

  28. 28
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Focus on Value
    Focus on Risk
    Improve Value
    Improve Collaboration

    View Slide

  29. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Follow ups:
    0) Email with Recording
    1) Blogpost

    View Slide

  30. 30
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Thank
    You!

    View Slide

  31. View Slide