Bugs'a'loud: Manual Testing with Github Copilot

Version of the talk from Vilnius in November.

Transcript

1. © 2025 CGI Inc. 1 Testing with GitHub Copilot Maaret Pyhäjärvi November 2025
2. © 2025 CGI Inc. 2 1988 style of skilled multidisciplinary testing common in Silicon Valley* Spotted live in Finland 1973 (Kela, the Social Insurance Institution in Finland)
3. © 2025 CGI Inc. 3 Exploratory Testing TEST DESIGN TEST EXECUTION LEARNING, AGENCY IMPACTFUL RESULTS * power to decide with knowledge and attitude that goes with power
4. © 2025 CGI Inc. 4 Contemporary Exploratory Testing MANUAL AUTOMATED LEARNING, AGENCY IMPACTFUL RESULTS * power to decide with knowledge and attitude that goes with power
5. © 2025 CGI Inc. 5 Everyone can test
6. © 2025 CGI Inc. 6 Even a broken clock is right twice a day.
7. © 2025 CGI Inc. 7 Catch 59 issues 7
8. © 2025 CGI Inc. 8 How Would You Test This? by Alan Richardson https://exploratorytestingacademy.com/app/ 8 https://github.com/QE-at-CGI-FI/pft-eprimer-agentic-github- copilot-demo
9. © 2025 CGI Inc. 9 9
10. © 2025 CGI Inc. 10 GitHub Copilot on text that is not code. Text Editor (VS Code) + genAI orchestrator (GitHub Copilot) + your tasks 10
11. © 2025 CGI Inc. 11 Learning timeline Launch Oct 29 ‘21 to start of use Dec 10 ’21 An early access user getting started 2021 2025 Favored notetaking tool for exploratory testing Both without and with automation as documentation.
12. © 2025 CGI Inc. 12 Demo Plan Visual Studio Code + GitHub Copilot Text completion Ask mode Agent mode Playwright Planner agent Scoring 6/59 + essential insights Browser awareness Resultful testing Explore, take notes, generate notes, documentation as output
13. © 2025 CGI Inc. 13 GitHub Copilot 13
14. © 2025 CGI Inc. 14 Playwright Agents: Planner 14
15. © 2025 CGI Inc. 15 15 4 issues identified 2 issues would be found from executing 30 tests
16. © 2025 CGI Inc. 16 16 https://github.com/QE-at-CGI-FI/pft-eprimer-agentic-github-copilot-demo
17. © 2025 CGI Inc. 17 Key takeaways GenAI Orchestrator Bring together the editor, a chat interface, task-specific instructions, your previous work, your prompt. Practice over tools Learning in layers takes time. Practice capturing your task- based testing wisdom. Share on internal and external marketplaces. Completing the gap Time to uplift your ability to produce results with continuously available external imagination. “AI will not replace humans, but those who use AI will replace those who don’t.” – Ginni Rometty, former CEO of IBM
18. © 2025 CGI Inc. 18 Insights you can act on Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-focused to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com