Share
Embed
Agentic AI Without a Big Tech or a Startup Budget
Oussama Hafferssas
October 15, 2026
Transcript
115 slides
-
ctober 2026 London Agentic AI Meet-Up Agentic AI Without a
Big Tech or a Startup Budget Oussama Ha erssas ff ff Sta ML/AI Engineer at -
ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of
Billions 10s of Millions ff Oussama Ha -
ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of
Billions ff 10s of Millions Most Companies Oussama Ha -
ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of
Billions How to optimise? ff 10s of Millions Most Companies Oussama Ha -
ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of
Billions How to optimise? 10s of Millions ff Oussama Ha -
ctober 2026 Agentic AI’s Budget Big Tech Startup 100s of
Billions How to optimise? 10s of Millions ff Oussama Ha -
ctober 2026 Agentic AI’s Budget Big Tech Startup How to
optimise? ff All Companies Oussama Ha -
ctober 2026 Agentic AI without Big Tech or Startup Budget
How to optimise? ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
optimise? ff Oussama Ha -
How to optimise? How to optimise? How to optimise? How
to optimise? Optimising the Cost of Agentic AI ctober 2026 How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? ff How to optimise? How to optimise? Oussama Ha -
How to optimise? How to optimise? How to optimise? How
to optimise? Optimising the Cost of Agentic AI ctober 2026 How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? How to optimise? ff How to optimise? How to optimise? Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
LLM ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
LLM Harness ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
LLM Harness Tools / Skills ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
LLM Harness Tools / Skills RAG ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
LLM Harness Tools / Skills RAG Agent quality is bellow expectations… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Bigger LLM Harness Tools / Skills RAG ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI The cost
is so high! System Prompt Bigger LLM Harness Tools / Skills RAG Problem solved… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI The cost
is so high! System Prompt Bigger LLM Harness Tools / Skills RAG Problem -almost- solved… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Bigger LLM Harness Tools / Skills RAG Problem -almost- solved… ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -is not- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -is not- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI System Prompt
Di erent LLM Provider Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI X System
Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI X System
Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -is NOT- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI X System
Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI The cost
is so high! X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI X System
Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG Problem -almost- solved… ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Cost X
System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Individual Agent
Cost X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Cost at
Scale Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Cost of
maintenance Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Agent 1 X System Prompt Di erent LLM Provider Agent 2 Thinking Harness Tools / Skills RAG Agent 3 X System Prompt Di erent LLM Provider X Thinking Harness Tools / Skills RAG System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? X System Prompt Di erent LLM Provider Thinking Harness Tools / Skills RAG ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA* Optimiser ff GEnetic-PAreto Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent (Or part of it) ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt LLM Harness Tools / Skills RAG Evaluations GEPA Optimiser • User Query • Agent Response • Expected Eval Result • Why? Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? System Prompt Harness LLM Tools / Skills RAG Evaluations GEPA Optimiser Golden Evaluation dataset Use Agent Run Evals (Or part of it) Re ect on each eval outcome Mutate Agent Repeat! ff fl Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? GEPA Optimiser System Prompt LLM Databricks Claude Opus 4.1 gpt-oss-120b 90x cheaper ff https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization Harness Tools / Skills RAG Evaluations +3% evals Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? GEPA Optimiser System Prompt LLM Dropbox Open AI o3 gpt-oss-120b 10x-100x cheaper ff https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy Harness Tools / Skills -97% JSON errors RAG Evaluations +45% correctness Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? GEPA Optimiser • https://www.databricks.com/blog/building-state-art-enterprise-agents-90x-cheaper-automated-prompt-optimization • https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy • https://dev.to/chen115y/self-evolving-agents-a-developers-guide-40e7 • https://dspy.ai/current/community/use-cases/ • https://arxiv.org/pdf/2507.19457 ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? How to implement a GEPA Optimiser? ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK Standalone https://github.com/gepa-ai/gepa ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ In-house Custom Pipeline Coding Assistants ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? GEPA SDK DSPy GEPA Optimiser Standalone Works better with DSPy harness but has adapters to LangGraph https://github.com/gepa-ai/gepa https://dspy.ai/current/getting-started/gepa-optimization/ In-house Custom Pipeline Coding Assistants ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? In-house Voice AI Custom Pipeline Coding Assistants ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Harness On ElevenLabs ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Authentication Coding Assistants Harness On ElevenLabs ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Authentication Authentication Evals Coding Assistants Harness On ElevenLabs ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness On ElevenLabs ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness On ElevenLabs ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? How to implement a GEPA Optimiser? Voice AI In-house Custom Pipeline Coding Assistants Authentication Authentication Evals Harness GEPA Ralph Loop On ElevenLabs ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? GEPA ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA Bigger E ort ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA Bigger E ort ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA Lower E ort Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings Lower E ort GEPA Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings Lower E ort GEPA Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? KV Cache ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Hello, I’m your meme cat AI assistant. How can I help you today? ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? System prompt Inference ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! System prompt Inference ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 ff System prompt (tokens) Teach me everything about cat memes please! Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Turn #2 X X Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes please! Sure, where you’d like to start meawte? Turn #2 X X Hello, I’m your meme cat AI assistant. How can I help you today? ff System prompt (tokens) Teach me everything about cat memes please! Inference Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 I’m not your mate! ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 X X X Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference System prompt (tokens) ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 X X X Hello, I’m your meme cat AI assistant. How can I help you today? Teach me everything about cat memes I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference System prompt (tokens) ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? KV Cache Turn #1 Hello, I’m your meme cat AI assistant. How can I help you today? Turn #2 Teach me everything about cat memes please! X X Hello, I’m your meme cat AI assistant. How can I help you today? Sure, where you’d like to start meawte? Teach me everything about cat memes Inference System prompt (tokens) Turn #3 Reuse same compute result X I’m not your mate! X Sure, where you’d like to start meawte? Meow relax! Why so serious!? I’m not your mate! Inference ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 How to
Optimise Cost? KV Cache ~80% token cache hit / inference ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings GEPA KV Cache Lower E ort Bigger E ort ff ff ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings Classi cation GEPA models KV Cache Lower E ort Bigger E ort Batch Inference Trim Tool Output ff ff ff fi Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI How to
Optimise Cost? Better cost savings Model Routing KV Cache Lower E ort Bigger E ort Batch Inference Trim Tool Output Classi cation GEPA models Model Distillation / Finetuning ff ff ff fi Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 Takeaway Evals
are your best friend a must! ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Takeaway Evals
are your best friend a must! There are many opportunities to optimise the cost of your agentic AI systems. ff Oussama Ha -
ctober 2026 Optimising the Cost of Agentic AI Takeaway Evals
are your best friend a must! There are many opportunities to optimise the cost of your agentic AI systems. Make sure to explore what works best for you! ff Oussama Ha -
Optimising the Cost of Agentic AI ctober 2026 Thank you!
Meow, we are hiring! ff Oussama Ha