Is Quality The Bottleneck?

Webinar for Telerik by Progress.

This is *NOT* a technical or product talk; it's a general talk.

Discusses ways Quality/Testing is perceived (rightly or wrongly) as a bottleneck to shipping software. Walks through a number of ways to address helping individuals, teams, and organizations improve how quality efforts can reduce waste and increase value.

Transcript

1. Is Quality The Bottleneck? The Role of Testing in the Modern Dev Cycle Presenter: Jim Holmes
2. 2 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. I’m Jim I test I coach I fail (lots) I learn
3. 3 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Easy”
4. Takeaways for you
5. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What are one or two things you could look at differently in how your team/organization ships software?
6. 6 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 1: Challenges for Quality
7. 7 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s Changing in Quality?
8. 8 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Economic Pressure Digital Experience (DX) Individual Value
9. 9 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Quality Related Costs and Bottlenecks Economic Pressures High rework High support effort Loss of sales, reputation More collaboration Earlier collaboration Clearer risk/value
10. 10 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Focus on Enabling Users Digital Experience (DX) LOTS of early work with users Journey mapping Interviews Workshops Earlier collaboration Far better user proxies Less confusion late in cycle!
11. 11 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Areas to Help Team & Organization Individual Value Bias IoT (not just the buzzword) Big Data Understand modeling Dive into the domains/industries
12. 12 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 2: What Software Failures are You Seeing?
13. 13 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s The Same in Quality?
14. 14 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Setting Expectations Stakeholder Engagement Building Skills and Roles
15. 15 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Human Communication Is Hard Setting Expectations “Test Everything!” “Automate all test cases” “How long to test?” “What’s most important?” Better clarity for risk/value Avoid low-value edge cases
16. 16 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Testers do NOT “Assure Quality” Engaging Stakeholders Releasing unknowns Quality viewed as a cost center Act as an “information broker”, not a gatekeeper Understand priorities Know “Why”
17. 17 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “What decisions do you need to make? What information do you need to make them?”
18. 18 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Fundamentals First Skills and Roles Test Case Management pain Long regression cycles Testing late in sprint or N+1 Collaboration Risk/value Stop writing test cases and do more testing
19. 19 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 3: Planning for Test Automation?
20. 20 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Leveraging Automation
21. Automation will not fix your bottlenecks Alone
22. 22 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Automate the Right Things Automate Well Automate in the Sprint
23. 23 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. (Focusing on UI Automation)
24. 24 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Great Coverage Automate the Right Things Lots of low value tests Lots of duplication Slow tests Workflows versus features Know what devs test Build support frameworks
25. 25 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Stable, High-Quality Tests Automate Well Scripts need maintenance Scripts are flakey Scripts don’t give good info Tests are production code Build together with devs Carefully choose scripts
26. 26 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Done” Means Automated Automate in Sprint Feedback comes long after dev Fixing errors takes longer Get testing in Definition of Done Even MORE collaboration Scaffold scripts at start
27. Testing and Quality should NOT be a bottleneck
28. 28 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Value Focus on Risk Improve Value Improve Collaboration
29. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Follow ups: 0) Email with Recording 1) Blogpost
30. 30 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Thank You!