Slide 1

Slide 1 text

© 2024 CGI Inc. 1 Customer as anchor The Stopping Challenge of Testing Maaret Pyhäjärvi October 2024

Slide 2

Slide 2 text

© 2024 CGI Inc. 2 2 Testing Find (some of) what other’s have missed! Photo by Kelly Sikkema on Unsplash

Slide 3

Slide 3 text

© 2024 CGI Inc. 3 3

Slide 4

Slide 4 text

© 2024 CGI Inc. 4 Testing works with invisible ink 4 REQUIREMENTS RISKS (of problems) CODE ENVIRONMENTS …to tell if there’s more and how well we know. We target these… …to find these... Coverage Test Ideas / Experiments Information of Relevance BUSINESS TIME USER WHAT WHEN WHO HOW WHY

Slide 5

Slide 5 text

© 2024 CGI Inc. 5 How good is your idea of risk coverage? 5 …394 line items in bug taxonomy …32 pages

Slide 6

Slide 6 text

© 2024 CGI Inc. 6 Challenges of Testing 6

Slide 7

Slide 7 text

© 2024 CGI Inc. 7 Modern Testing Principles 7 Principle 5. We believe that the customer is the only one capable to judge and evaluate the quality of our product

Slide 8

Slide 8 text

© 2024 CGI Inc. 8 Reframe Make Canvas Smaller 8

Slide 9

Slide 9 text

© 2024 CGI Inc. 9 Nothing changes if you change nothing 9 System version running in production Testing done by development partner Testing done by the system owner System version running in production Regression testing?

Slide 10

Slide 10 text

© 2024 CGI Inc. 10 If you change something… 10 System version running in production Testing done by development partner Testing done by the system owner System version running in production Regression testing? Regression testing?

Slide 11

Slide 11 text

© 2024 CGI Inc. 11 Prepare to Shift: Left and Down 11 Shift Left Shift down Quality engineering over quality assurance Whole team approach Clarifying core examples Single-commit delivery Test-driven development Exploratory unit testing “77% of production bugs could have been found with a unit test” We’re still half-way into the automation transformation that AI supports.

Slide 12

Slide 12 text

© 2024 CGI Inc. 12 Contemporary Exploratory Testing Programmatic tests as output. Feedback with agency. 12

Slide 13

Slide 13 text

© 2024 CGI Inc. 13 Reframe Designing location of testing 13

Slide 14

Slide 14 text

© 2024 CGI Inc. 14 Organizational boundaries, responsibility topologies Development partner testing Follow change. Programmatic safety net Testing services Bridging to information. Fixing phase of acceptance. Acceptance testing Domain knowledge. Realism. Short feedback cycle. Granularity. Risk coverage. Tech knowledge. Business knowledge. Demonstration.

Slide 15

Slide 15 text

© 2024 CGI Inc. 15 "QA is a revenue assurance unit." - Abimbola Adegbite 15 User experiences software Support is form of failure demand with customer facing upside Customer is the organization collating all revenue and expenses Testing optimizes lifecycle costs with information

Slide 16

Slide 16 text

© 2024 CGI Inc. 16 The Three Contemporary Testing Profiles (Contemporary) Exploratory Tester Start with information, document with automation. Finish with testing done. (Contemporary) Test Automation Engineer Start with automation, design for information. Finish with testing done. Programmer Start with intent, document with automation. Finish with testing done. Great collaboration skills compensate for lack in other skills. See the bigger picture for customer benefit.

Slide 17

Slide 17 text

© 2024 CGI Inc. 17 In conclusion 17

Slide 18

Slide 18 text

© 2024 CGI Inc. 18 Programming is like writing. Getting started is easy and it takes a lifetime to get good at. 18

Slide 19

Slide 19 text

© 2024 CGI Inc. 19 19 Everyone can test

Slide 20

Slide 20 text

© 2024 CGI Inc. 20 Customer as anchor 20 Anchor to a baseline in production. Human-size steps. Frequent to continuous delivery Reassignment of organizational testing responsibilities Left and down. Structural trust through automation. Same test is not same test by acceptance and system tester unless we collaborate on hands-on work and examples. Learning to agree scope and address risk. Decompose end to end automation to understanding in end to end.

Slide 21

Slide 21 text

© 2024 CGI Inc. 21 Testing provides visibility. Quality tells you how far to go. Quality engineering bridges the two. 21

Slide 22

Slide 22 text

© 2024 CGI Inc. 22 Insights you can act on Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-based to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com