Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Wenn die Vibes nicht reichen: Observability für...
Search
Torsten Bøgh Köster
October 20, 2026
Technology
28
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Wenn die Vibes nicht reichen: Observability für GenAI Anwendungen
Torsten Bøgh Köster
October 20, 2026
Transcript
37 slides
Wenn die Vibes nicht reichen Observability für GenAI-Anwendungen Torsten Bøgh
Köster (@tboeghk)
@tboeghk Freelancer, Author Search & Observabilitiy
Recap: observability Observability for GenAI apps Tracing GenAI apps Acceptance
testing Red team testing Integrating observability into the frontier engineering lifecycle
Can you understand what's happening inside your systems, just by
asking questions from the outside? Can you answer new questions without shipping new code?
None
None
Observability for GenAi applications
None
➡ Prompt injection
➡ Non-determinstic
➡ Dedicated OWASP top 10 Motication: OWASP Top 10
➡ External infrastructure
➡ Function calling accuracy
How do we tackle this?
💡 LLM provider metrics 💡 LLM application metrics 🤷 LLM
interactions
🪧 Demo time
Wieviel Milch sollte ein 9 Tage alter Säugling pro Mahlzeit
trinken und wieviele Mahlzeiten benötigt er in 24h? RAG cycle
None
None
🪧 MidMind demo
🪧 Langfuse Demo 🪧 MidMind demo
💡How to trace application insights?
None
easy OTEL integration
Example: RAG retrieval
🪧 Langfuse demo
🙏 Explainability
Acceptance testing a RAG application
✅ Acceptance testing ✅ ✅ ✅ ✅
None
None
red team testing
red team testing
🪧 Promptfoo demo
Frontier engineering lifecycle
Frontier engineering lifecycle
Conclusion
More Decks by Torsten Bøgh Köster
See All by Torsten Bøgh Köster
LLMs im Griff: Observability, Tracing und Security
tboeghk
0
100
LLMs im Griff: Observability, Tracing und Security
tboeghk
1
74
Oder mache ich es lieber selbst? Wie sich Kosten und Geopolitik auf Cloud-Betrieb auswirken
tboeghk
0
150
Taking an abandoned Solr search from zero to GenAI hero
tboeghk
0
96
Oder mache ich es lieber selbst? Wie sich Kosten und Geopolitik auf Cloud-Betrieb auswirken
tboeghk
0
70
🔪 How we cut our AWS costs in half
tboeghk
0
490
Shared Nothing Logging Infrastructure
tboeghk
0
140
Beyond Cloud: A road trip into AWS and back to bare metal
tboeghk
1
130
Shared Nothing Logging Infrastructure
tboeghk
0
1.5k
Other Decks in Technology
See All in Technology
みん強Lightning! データ基盤ひとりでできるかな
endonanana
0
190
Go でトランザクション、どう書いてますか?
knwoop
1
590
Welcome JXL!
dynamis
0
120
IVRy における AI 時代のデータプロダクトと事業開発
ivry_presentationmaterials
0
100
Platform Engineering をベースとした Agentic Software Factory の実践
110y
3
970
20261119_AgentCore
takuyay0ne
2
270
AWS Well-Arhitected Frameworkセキュリティの柱 について
miu_crescent
PRO
2
260
目を覚ませ!僕らの認証情報が何者かに侵略されてるぞ
tkito
2
490
From vibe coding to reliable (agentic) development
jcabot
0
240
パスワードのない鍵で、 データを手元に置く
ginjihayashi
0
400
認知の質も文化醸成も。数年取り組んで見えてきた技術広報のKPI設計 / Tech PR KPIs: Lessons on Awareness Quality and Culture After Several Years
bitkey
PRO
0
210
ポケモンバトルのAIエージェント
koji_kawamura
0
220
Featured
See All Featured
Collaborative Software Design: How to facilitate domain modelling decisions
baasie
1
390
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
141
35k
Heart Work Chapter 1 - Part 1
lfama
PRO
11
37k
Fireside Chat
paigeccino
43
4.1k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
uxyall
2
540
The Power of CSS Pseudo Elements
geoffreycrofte
82
6.7k
Learning to Love Humans: Emotional Interface Design
aarron
275
41k
Agile that works and the tools we love
rasmusluckow
331
22k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
livdayseo
1
250
Game over? The fight for quality and originality in the time of robots
wayneb77
1
340
The Limits of Empathy - UXLibs8
cassininazir
2
800
Visualization
eitanlees
153
17k