Habit of AI in Quality Engineering

Slide 1

Slide 1 text

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

© 2025 CGI Inc. 5 Hello, I am an AI practitioner 👋 IVVES (2019) ITEA3 (EU) research project on AI in testing / testing AI GitHub Copilot (2021) Pair programming job interview with this lead to ‘Let’s Do a Thing and Call it Foo’ ChatGPT (2022) GenAI pair testing CodiumAI Qodo Merge Pro Code reviews to mostly ignore Microsoft Copilot Corporate constraints Models Integrations Integrations LLMs Contracts RAG CGI NAVI Generating artifacts TestZeus Hercules Gherkin to test results Open Source LLMs Open Source Agents

Slide 6

Slide 6 text

© 2025 CGI Inc. 6 “The secret of getting ahead is getting started. The secret of getting started is is breaking your complex overwhelming tasks into small manageable tasks, and starting the first one”. – Mark Twain 6 Photo by Aron Visuals on Unsplash

Slide 7

Slide 7 text

© 2025 CGI Inc. 7 Quality strategy for how quality is created, maintained and lost QUALITY ENGINEERING Test ideas Test assumptions DEV OPS D eploy D iscover Specify with examples Test changes Test system Test in production Test process Test through telemetry

Slide 8

Slide 8 text

© 2025 CGI Inc. 8 The tools are combinations of building blocks Generate › Summarize: more into less › Elaborate: less into more › Transform: format change › Large Language Models Remember › Memory: save keywords over time › Templates: output instructions › Domain: prompting reuse › Retrieval Augmented Generation See › Vision: classifying pictures › Classification Models Moderate › Input and output filters › Filters Orchestrate › High level to steps breakdown › Hyperautomation tools › Agents Integrate › Available where the work gets done

Slide 9

Slide 9 text

© 2025 CGI Inc. 9 No ‘one best tool’ – protect time while encouraging growing AI habit 9 Generate MODELS Hosted open- source models Filter GUARDRAILS Org memory CONTEXT Act AGENTS Decide AUTOMATION Cloud APIs to models AUTOMATE TestZeus Hercules DOCUMENT CGI NAVI CODE GitHub Copilot DOCUMENT Edge Copilot DOCUMENT ChatGPT CODE Cursor DOCUMENT CODE UIPath CODE OpenAI APIs DOCUMENT Ollama+ DOCUMENT CODE Chrome AI assistant Growth in AI habit

Slide 10

Slide 10 text

© 2025 CGI Inc. 10 Selected stories Manual agent orchestration Ask Claude. Ask ChatGPT. Ask Edge Copilot. Ask GitHub Copilot. Control their context. Build conceptual vocabulary New concepts in meetings. Ask genAI. Be curious about truth. Digital twinning Control your hidden input. Give samples of your content and style. Break rules and reflect Your team building problem solving by AI. Your training quiz by AI. Baselining homework GenAI from image above newbie median on a simple app of testing. Bug reports to bug fixes. Feature at time with GitHub Copilot Protect time with partner of choice. Features get copied. Pair work with genAI Routine of bringing tasks to habits. Notetaking Discipline to organize your texts into personal pipelines. Model from demos There’s so many tools, and so much smoke screen.

Slide 11

Slide 11 text

© 2025 CGI Inc. 11 Practice-level guardrails Expected values Pay attention to the old testing wisdom of oracles and how do we know. Our critical thinking, built on our learning through curiosity of the world is essential. 01 Anti-toolist worldwiew Realize that features in tools can be copied. Looking for the one best tool makes little sense. We need to protect our time to a partner of choice. 02 Taskwide learning Not lifelong learning or life wide learning, but it's task wide learning. Everything we do is learning activity. 03

Slide 12

Slide 12 text

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Slide 15

Slide 15 text

© 2025 CGI Inc. 15 Shared Direction and Results that Show up in Scale AI-Driven Testing Measure and assess to baseline productivity and good practices Experiment together with customers to deliver promise of value in point, application and system solutions Capture in pipelines and methodology of sociotechnical guardrails Habitually apply and reflect to instill culture of learning Teach for co-creation, share and learn to avoid regional divide Scale with IP on improved service and licensed solutions Human-centric Enhancing Incremental Impactful at Scale

Slide 16

Slide 16 text

© 2025 CGI Inc. 16 Insights you can act on Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-based to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com