The presentation "Testing Challenges in the Age of AI" discusses the evolving landscape of software engineering with the rise of AI.
It highlights the challenges of testing AI-generated code, including non-deterministic responses and slow LLMs.
The talk introduces Mokksy, a tool for fast and deterministic mocking of LLM calls.
It also covers prompt testing with promptfoo and end-to-end testing with Langfuse.
he presentation concludes with challenges in security and preventing abuse in AI-infused systems.