TO DO BETTER Exploratory tester with AI: 73 100% Exploratory tester: 45 62% AI with human: 40 55 % Traditional testers (n=57): 13.5 18% Playwright agents: 12 16% Future talent ’26 (n=9): 11.5 16% AI without human: 4 5 % Invis ible ink: proble ms are there ev en if no one re ported them. https://github.paeuinsource.ent.cgi.com/AI-Exchange/result-benchmark-playwright-agents-todo
experienced it CONTEMPORARY EXPLORATORY TESTING Information intake shapes what we fail to see, and we can move beyond the failure. Test cases are primarily captured programmatically as test automation, as output of exploring. Working agreements with team and exploring on unit level. Architecture-aware. Testing does not end with report and retesting but expands to debugging and repairs. There are no manual test cases with steps but lists of ideas to explore. 1 2 3 4 5 AI raises the bar of what is possible as external imagination. 6 Resu ltful tes ting. In the mom ent, in pipelines doing work when we ’re gone .
TESTING Access to code + web UI List of 32 functional problems Automate tests that fail for those problems Generate fixes for those problems and run test automation to show change Generate basic flows test automation as documentation Audit for accessibility and security Gene rating unit and webU I tests to lock existing applica tions fo r chang e Demo availab le
IN SENSE OF UNCERTAINTY – EPISTEMIC COVER: HOW WE KNOW WHAT WE KNOW Spec Exploratory pull (internal) AI in testing pull (external) If correctness is defined externally, tester job is comparison. Generate the expected. Responsible for the standard. Imagination is now a job requirement. Accountability shift from document to judgement. What the world could be. Uncertainty to spec. Imagination is no longer a private resource. Task expansion to product and developer. Imaginary anchor Tester Responsible for information on what is true, not just agreed.
coding INSIGHTS WITH ARYADEVI NEELAKANTABHATTATHIRI Spec lives in your head and AI guesses it The date format specified was no more complete than asking for a date picker. Silence turns to assumptions. Code looks right even when its wrong Clean, linted, running code with tests. Reading with tests for intended behavior at boundaries becomes a necessity. You cannot verify what you cannot see Illusion of past “full visibility”. Black-boxes through AI in the architecture and cognitive distance from writing code. Debugging is a focus. Validation had a finish line – now it never ends Moving target, particularly with AI in the architecture. Shift from phase to habit. You are simultaneously too close, too far Other techniques (personas, delay, AI assistance, adversial thinking) to objectivity when roles no longer suffice. 1 2 3 4 5
task expansion in talent AI-ENHANCED APPLICATION TESTING 01 Tasks of Testing From logistics of test targets to information, test cases and issue reports Docu ment tes ts with t est auto mation Repo rt bugs with a f ix for revie w Secon d pair of eyes for qual ity pers pective through reviews Find issues f irst, te st cases follo w Start earlier Continue further Build your ag entic to olkit to level up quality results in talen t
Show up in Scale MY AI STRATEGY AI-Enhanced Testing Measure and assess to baseline productivity and good practices Experiment together with clients to deliver promise of value in point, application and system solutions Capture in pipelines and methodology of sociotechnical guardrails Habitually apply and reflect to instill culture of learning Teach for co-creation, share and learn to avoid regional divide Scale with IP on improved service and licensed solutions Human-centric Enhancing Incremental Impactful at Scale
Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-focused to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com
in testing -workshopping https://qe-at-cgi-fi.github.io/atm/ Requirement: Daily withdrawal limit is 300€. How would you test it? https://qe-at-cgi-fi.github.io/potion-shop/ Assignment: Find problems. Report by fixing. Test cases will be an output, not input. https://qe-at-cgi-fi.github.io/todo/ Use AI to help you find some of the 73. Adapted from: James Osborn Adapted from: Christine Pinto
maaretp
jdejongh
sstephenson
addyosmani
raygrieselhuber
bkeepers
rasagy
badams
3n
katarinadahlin
reverentgeek
garrettdimon
eileencodes
