Is Quality The Bottleneck? The Role of Testing in the Modern Dev Cycle Presenter: Jim Holmes 

2 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. I’m Jim I test I coach I fail (lots) I learn 

3 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Easy” 

Takeaways for you 

© 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What are one or two things you could look at differently in how your team/organization ships software? 

6 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 1: Challenges for Quality 

7 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s Changing in Quality? 

8 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Economic Pressure Digital Experience (DX) Individual Value 

9 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Quality Related Costs and Bottlenecks Economic Pressures High rework High support effort Loss of sales, reputation More collaboration Earlier collaboration Clearer risk/value 

10 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Focus on Enabling Users Digital Experience (DX) LOTS of early work with users Journey mapping Interviews Workshops Earlier collaboration Far better user proxies Less confusion late in cycle! 

11 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Areas to Help Team & Organization Individual Value Bias IoT (not just the buzzword) Big Data Understand modeling Dive into the domains/industries 

12 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 2: What Software Failures are You Seeing? 

13 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s The Same in Quality? 

14 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Setting Expectations Stakeholder Engagement Building Skills and Roles 

15 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Human Communication Is Hard Setting Expectations “Test Everything!” “Automate all test cases” “How long to test?” “What’s most important?” Better clarity for risk/value Avoid low-value edge cases 

16 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Testers do NOT “Assure Quality” Engaging Stakeholders Releasing unknowns Quality viewed as a cost center Act as an “information broker”, not a gatekeeper Understand priorities Know “Why” 

17 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “What decisions do you need to make? What information do you need to make them?” 

18 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Fundamentals First Skills and Roles Test Case Management pain Long regression cycles Testing late in sprint or N+1 Collaboration Risk/value Stop writing test cases and do more testing 

19 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 3: Planning for Test Automation? 

20 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Leveraging Automation 

Automation will not fix your bottlenecks Alone 

22 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Automate the Right Things Automate Well Automate in the Sprint 

23 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. (Focusing on UI Automation) 

24 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Great Coverage Automate the Right Things Lots of low value tests Lots of duplication Slow tests Workflows versus features Know what devs test Build support frameworks 

25 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Stable, High-Quality Tests Automate Well Scripts need maintenance Scripts are flakey Scripts don’t give good info Tests are production code Build together with devs Carefully choose scripts 

26 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Done” Means Automated Automate in Sprint Feedback comes long after dev Fixing errors takes longer Get testing in Definition of Done Even MORE collaboration Scaffold scripts at start 

Testing and Quality should NOT be a bottleneck 

28 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Value Focus on Risk Improve Value Improve Collaboration 

© 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Follow ups: 0) Email with Recording 1) Blogpost 

30 © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Thank You! 

No content