Is Quality The Bottleneck?

Webinar for Telerik by Progress.

This is *NOT* a technical or product talk; it's a general talk.

Discusses ways Quality/Testing is perceived (rightly or wrongly) as a bottleneck to shipping software. Walks through a number of ways to address helping individuals, teams, and organizations improve how quality efforts can reduce waste and increase value.

Transcript

1. Is Quality The Bottleneck?
   The Role of Testing in the
   Modern Dev Cycle
   Presenter: Jim Holmes
   

   View Slide

2. 2
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   I’m Jim
   I test
   I coach
   I fail (lots)
   I learn
   

   View Slide

3. 3
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   “Easy”
   

   View Slide

4. Takeaways for you
   

   View Slide

5. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   What are one or two things you
   could look at differently in how
   your team/organization ships
   software?
   

   View Slide

6. 6
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   Survey 1:
   Challenges for Quality
   

   View Slide

7. 7
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   What’s
   Changing in
   Quality?
   

   View Slide

8. 8
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   Economic Pressure
   Digital Experience (DX)
   Individual Value
   

   View Slide

9. 9
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
   Quality Related Costs and Bottlenecks
   Economic Pressures
   High rework
   High support effort
   Loss of sales, reputation
   More collaboration
   Earlier collaboration
   Clearer risk/value
   

   View Slide

10. 10
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    New Focus on Enabling Users
    Digital Experience (DX)
    LOTS of early work with users
    Journey mapping
    Interviews
    Workshops
    Earlier collaboration
    Far better user proxies
    Less confusion late in cycle!
    

    View Slide

11. 11
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    New Areas to Help Team & Organization
    Individual Value
    Bias
    IoT (not just the buzzword)
    Big Data
    Understand modeling
    Dive into the
    domains/industries
    

    View Slide

12. 12
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Survey 2:
    What Software Failures are
    You Seeing?
    

    View Slide

13. 13
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    What’s
    The Same in
    Quality?
    

    View Slide

14. 14
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Setting Expectations
    Stakeholder Engagement
    Building Skills and Roles
    

    View Slide

15. 15
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Human Communication Is Hard
    Setting Expectations
    “Test Everything!”
    “Automate all test cases”
    “How long to test?”
    “What’s most important?”
    Better clarity for risk/value
    Avoid low-value edge cases
    

    View Slide

16. 16
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Testers do NOT “Assure Quality”
    Engaging Stakeholders
    Releasing unknowns
    Quality viewed as a cost center
    Act as an “information
    broker”, not a gatekeeper
    Understand priorities
    Know “Why”
    

    View Slide

17. 17
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    “What decisions do you need to make?
    What information do you need to make
    them?”
    

    View Slide

18. 18
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Focus on Fundamentals First
    Skills and Roles
    Test Case Management pain
    Long regression cycles
    Testing late in sprint or N+1
    Collaboration
    Risk/value
    Stop writing test cases and
    do more testing
    

    View Slide

19. 19
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Survey 3:
    Planning for Test
    Automation?
    

    View Slide

20. 20
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Leveraging
    Automation
    

    View Slide

21. Automation will not fix your bottlenecks
    Alone
    

    View Slide

22. 22
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Automate the Right Things
    Automate Well
    Automate in the Sprint
    

    View Slide

23. 23
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    (Focusing on UI
    Automation)
    

    View Slide

24. 24
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Build Great Coverage
    Automate the Right Things
    Lots of low value tests
    Lots of duplication
    Slow tests
    Workflows versus features
    Know what devs test
    Build support frameworks
    

    View Slide

25. 25
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Build Stable, High-Quality Tests
    Automate Well
    Scripts need maintenance
    Scripts are flakey
    Scripts don’t give good info
    Tests are production code
    Build together with devs
    Carefully choose scripts
    

    View Slide

26. 26
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    “Done” Means Automated
    Automate in Sprint
    Feedback comes long after dev
    Fixing errors takes longer
    Get testing in Definition of
    Done
    Even MORE collaboration
    Scaffold scripts at start
    

    View Slide

27. Testing and Quality
    should NOT be a
    bottleneck
    

    View Slide

28. 28
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Focus on Value
    Focus on Risk
    Improve Value
    Improve Collaboration
    

    View Slide

29. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Follow ups:
    0) Email with Recording
    1) Blogpost
    

    View Slide

30. 30
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
    Thank
    You!
    

    View Slide

31. View Slide