Agentic AI Without a Big Tech or a Startup Budget

Transcript

1. ctober 2026 London Agentic AI Meet-Up Agentic AI Without a Big Tech or a Startup Budget Oussama Ha erssas ff ff Sta ML/AI Engineer at
2. ctober 2026 Agentic AI’s Budget Big Tech Startup ff Oussama Ha
3. ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of Billions 10s of Millions ff Oussama Ha
4. ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of Billions ff 10s of Millions Most Companies Oussama Ha
5. ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of Billions How to optimise? ff 10s of Millions Most Companies Oussama Ha
6. ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of Billions How to optimise? 10s of Millions ff Oussama Ha
7. ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of Billions How to optimise? 10s of Millions ff Oussama Ha
8. ctober 2026 Agentic AI’s Budget Big Tech Startup How to optimise? ff All Companies Oussama Ha
9. ctober 2026 Agentic AI without Big Tech or Startup Budget How to optimise? ff Oussama Ha
10. ctober 2026 Optimising the Cost of Agentic AI How to optimise? ff Oussama Ha
11. How to optimise? How to optimise? How to optimise? How to optimise? Optimising the Cost of Agentic AI ctober 2026 How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? ff How to optimise? How to optimise? Oussama Ha
12. How to optimise? How to optimise? How to optimise? How to optimise? Optimising the Cost of Agentic AI ctober 2026 How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? ff How to optimise? How to optimise? Oussama Ha
13. October 2026 Optimising the Cost of Agentic AI ff Oussama Ha
14. Optimising the Cost of Agentic AI ctober 2026 LLM ff Oussama Ha
15. ctober 2026 Optimising the Cost of Agentic AI System Prompt LLM ff Oussama Ha
16. ctober 2026 Optimising the Cost of Agentic AI System Prompt LLM Harness ff Oussama Ha
17. ctober 2026 Optimising the Cost of Agentic AI System Prompt LLM Harness Tools / Skills ff Oussama Ha
18. ctober 2026 Optimising the Cost of Agentic AI System Prompt LLM Harness Tools / Skills RAG ff Oussama Ha
19. ctober 2026 Optimising the Cost of Agentic AI System Prompt LLM Harness Tools / Skills RAG Agent quality is bellow expectations… ff Oussama Ha
20. ctober 2026 Optimising the Cost of Agentic AI System Prompt Bigger LLM Harness Tools / Skills RAG ff Oussama Ha
21. ctober 2026 Optimising the Cost of Agentic AI System Prompt Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha
22. ctober 2026 Optimising the Cost of Agentic AI System Prompt Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha
23. ctober 2026 Optimising the Cost of Agentic AI The cost is so high! System Prompt Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha
24. ctober 2026 Optimising the Cost of Agentic AI The cost is so high! System Prompt Bigger LLM Harness Tools / Skills RAG Problem -almost- solved… ff Oussama Ha
25. ctober 2026 Optimising the Cost of Agentic AI System Prompt Bigger LLM Harness Tools / Skills RAG Problem -almost- solved… ff Oussama Ha
26. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha
27. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha
28. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha
29. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -is not- solved… ff ff Oussama Ha
30. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -is not- solved… ff ff Oussama Ha
31. ctober 2026 Optimising the Cost of Agentic AI System Prompt Di erent LLM Provider Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha
32. ctober 2026 Optimising the Cost of Agentic AI X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha
33. ctober 2026 Optimising the Cost of Agentic AI X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha
34. ctober 2026 Optimising the Cost of Agentic AI X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem solved… ff ff Oussama Ha
35. ctober 2026 Optimising the Cost of Agentic AI The cost is so high! X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem solved… ff ff Oussama Ha
36. ctober 2026 Optimising the Cost of Agentic AI X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha
37. ctober 2026 Optimising the Cost of Agentic AI Cost X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha
38. ctober 2026 Optimising the Cost of Agentic AI Individual Agent Cost X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha
39. ctober 2026 Optimising the Cost of Agentic AI Cost at Scale Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha
40. ctober 2026 Optimising the Cost of Agentic AI Cost of maintenance Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha
41. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha
42. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha
43. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG ff Oussama Ha
44. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations ff Oussama Ha
45. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations ff Oussama Ha
46. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA* Optimiser ff GEnetic-PAreto Oussama Ha
47. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset ff Oussama Ha
48. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset ff Oussama Ha
49. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset ff Oussama Ha
50. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent (Or part of it) ff Oussama Ha
51. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) ff Oussama Ha
52. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome ff fl Oussama Ha
53. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent ff fl Oussama Ha
54. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent ff fl Oussama Ha
55. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
56. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
57. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
58. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
59. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
60. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
61. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
62. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
63. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
64. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
65. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha
66. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? GEPA Optimiser System Prompt LLM Databricks Claude Opus 4.1 gpt-oss-120b 90x cheaper ff https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization Harness Tools / Skills RAG Evaluations +3% evals Oussama Ha
67. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? GEPA Optimiser System Prompt LLM Dropbox Open AI o3 gpt-oss-120b 10x-100x cheaper ff https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy Harness Tools / Skills -97% JSON errors RAG Evaluations +45% correctness Oussama Ha
68. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha
69. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha
70. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha
71. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? How to implement a GEPA Optimiser? ff Oussama Ha
72. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK Standalone https://github.com/gepa-ai/gepa ff Oussama Ha
73. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ ff Oussama Ha
74. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ In-house Custom Pipeline Coding Assistants ff Oussama Ha
75. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ In-house Custom Pipeline Coding Assistants ff Oussama Ha
76. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? In-house Voice AI Custom Pipeline Coding Assistants ff Oussama Ha
77. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Harness On ElevenLabs ff Oussama Ha
78. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Authentication Coding Assistants Harness On ElevenLabs ff Oussama Ha
79. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Authentication Authentication Evals Coding Assistants Harness On ElevenLabs ff Oussama Ha
80. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness On ElevenLabs ff Oussama Ha
81. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness On ElevenLabs ff Oussama Ha
82. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness GEPA Ralph Loop On ElevenLabs ff Oussama Ha
83. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? GEPA ff Oussama Ha
84. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA Bigger E ort ff ff Oussama Ha
85. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA Bigger E ort ff ff Oussama Ha
86. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA Lower E ort Bigger E ort ff ff ff Oussama Ha
87. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings Lower E ort GEPA Bigger E ort ff ff ff Oussama Ha
88. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings Lower E ort GEPA Bigger E ort ff ff ff Oussama Ha
89. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha
90. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha
91. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha
92. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? KV Cache ff Oussama Ha
93. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Hello, I’m your meme cat AI assistant. How can I help you today? ff Oussama Ha
94. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? System prompt Inference ff Oussama Ha
95. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! System prompt Inference ff Oussama Ha
96. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please!
97. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 ff System prompt (tokens) Teach me everything about cat memes please! Oussama Ha
98. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Oussama Ha
99. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Oussama Ha
100. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha
101. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 X X Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha
102. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Sure, where you’d like to start meawte? Turn #2 X X Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha
103. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) ff Oussama Ha
104. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 I’m not your mate! ff Oussama Ha
105. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 X X X Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference System prompt (tokens) ff Oussama Ha
106. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 X X X Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference System prompt (tokens) ff Oussama Ha
107. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 Reuse same compute result X I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference ff Oussama Ha
108. Optimising the Cost of Agentic AI ctober 2026 How to Optimise Cost? KV Cache ~80% token cache hit / inference ff Oussama Ha
109. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha
110. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings Classi cation GEPA models KV Cache Lower E ort Bigger E ort Batch Inference Trim Tool Output ff ff ff fi Oussama Ha
111. ctober 2026 Optimising the Cost of Agentic AI How to Optimise Cost? Better cost savings Model Routing KV Cache Lower E ort Bigger E ort Batch Inference Trim Tool Output Classi cation GEPA models Model Distillation / Finetuning ff ff ff fi Oussama Ha
112. Optimising the Cost of Agentic AI ctober 2026 Takeaway Evals are your best friend a must! ff Oussama Ha
113. ctober 2026 Optimising the Cost of Agentic AI Takeaway Evals are your best friend a must! There are many opportunities to optimise the cost of your agentic AI systems. ff Oussama Ha
114. ctober 2026 Optimising the Cost of Agentic AI Takeaway Evals are your best friend a must! There are many opportunities to optimise the cost of your agentic AI systems. Make sure to explore what works best for you! ff Oussama Ha
115. Optimising the Cost of Agentic AI ctober 2026 Thank you! Meow, we are hiring! ff Oussama Ha