Model Mondays S2E12: Models & Observability

Observability is about instrumenting AI apps to collect signals that provide insight into model behavior & performance across the GenAIOps lifecycle. Join us as we talk to Han Che about evaluations, red-teaming & end-to-end observability in Azure AI Foundry – for trustworthy AI!

Customer Stories: Saifr
In this ongoing segment, we continue talking to customers about real world usage of Azure AI technologies and solutions. In this episode we're joined by David Johnston, CTO and Co-founder at Saifr, and Brett Trainor, Head of Partnerships at Saifr who share how Saifr's AI solutions help financial service developers create compliant apps, services and agents!.

Register:
Livestreamed: Sep 08 / https://developer.microsoft.com/en-us/reactor/events/26131/
Discord AMA: Sep 12 / https://discord.com/invite/azureaifoundry?event=1382864811649536120

Catch-up After:
Livestream Recording: https://aka.ms/model-mondays/playlist
AMA Schedule: https://aka.ms/model-mondays/forum

About Model Mondays:
GitHub: https://aka.ms/model-mondays/
Livestream: https://aka.ms/model-mondays/rsvp
Discord: https://aka.ms/model-mondays/discord

Transcript

1. Han Che Senior PM, Core AI / Microsoft Models & Observability MODEL MONDAYS S2:E12 Tools Hosted By: April Gittens SEP 08, 2025 · 1:30-2:00 PM ET
2. Livestream (Mon) · AMA (Fri) https://aka.ms/model-Mondays/rsvp Model Mondays JUN 2025 – SEP 2025
3. Sharmila Chockalingam Senior PMM, Azure AI Weekly Highlights WHAT’S NEW IN AZURE |AI FOUNDRY THIS WEEK?
4. ❶ · Try · gpt-realtime gpt-realtime gpt-realtime represents a significant leap forward in our commitment to providing advanced and reliable speech- to-speech solutions. Join: https://aka.ms/model-mondays/discord View: https://aka.ms/model-mondays/forum
5. ❷ · Try · Translator API Azure AI Translator API Azure AI Translator API which provides you with flexibility to choose general neural machine translation (NMT), or a list of generative AI large language models (LLMs) at a request level. to produce tone translation, gender translation, and adaptive custom translation. Join: https://aka.ms/model-mondays/discord View: https://aka.ms/model-mondays/forum
6. ❸ · Try · Foundry Agents Azure AI Foundry Agents Foundry provides tools and templates for building advanced agents that can achieve goals, adapt to change, and integrate with other systems, supporting use cases like operations, security, and personalized training Join: https://aka.ms/model-mondays/discord View: https://aka.ms/model-mondays/forum
7. ❹ · Try · CalcLM Foundry Labs - CalcLM Simple, open experiment that illustrates how agent workflows might live in a grid- like surface. Join: https://aka.ms/model-mondays/discord View: https://aka.ms/model-mondays/forum
8. ❺ · Read · Observability Best Practices Agent Factory Observability is essential for delivering AI that is not only effective, but also transparent, safe, and aligned with organizational values. Join: https://aka.ms/model-mondays/discord View: https://aka.ms/model-mondays/forum
9. April Gittens Principal AI Advocate, Microsoft Weekly Spotlight HOSTED BY
10. Han Che Senior PM, Core AI / Microsoft Models & Observability MODEL MONDAYS S2:E12 Tools Hosted By: April Gittens SEP 08, 2025 · 1:30-2:00 PM ET
11. ❶ · Explore · Red Teaming Agent AI Red Teaming Agent Proactively find safety risks associated with generative AI systems. Action: aka.ms/AIRedTeaming View: https://aka.ms/model-mondays/forum
12. ❷ · Install · Extension AI Agent Evaluation Run offline evaluation of Azure AI Agents in Visual Studio Code Action: AI Agent Evaluation View: https://aka.ms/model-mondays/forum
13. ❸ · Explore · Azure Monitor Azure Monitor Monitor and get alerts for your Azure AI Foundry agents Action: Service Monitoring View: https://aka.ms/model-mondays/forum
14. ❹ · Register · AI Tour 2026 Microsoft AI Tour Registration Open Free 1-day events. Learn from experts, connect with peers, build on AI Action: Find Events Near You View: https://aitour.microsoft.com
15. Register · #MSIgnite 2025 Microsoft Ignite Registration Open Explore cutting-edge technologies. Meet the experts. Pre-day labs, workshops & breakouts Action: Register Now View: https://ignite.microsoft.com
16. CTO & Co-founder, Saifr (Fidelity Labs) MODEL MONDAYS S2:E12 David Johnston Head of Partnerships, Saifr (Fidelity Labs) Brett Trainor Customer Stories: Saifr Industry With: April Gittens Visit: https://saifr.ai/
17. ❶ · Learn · Compliance AI Saifr builds technology to help developers in regulated industries, like financial services make their apps and models compliant. Action: https://aka.ms/model-mondays/customer-stories View: https://saifr.ai
18. Jeff Boudier VP of Product / Hugging Face Open-Source Models MODEL MONDAYS S2:E13 Models Hosted By: Nitya Narasimhan SEP 15, 2025 · 1:30-2:00 PM ET
19. Models Foundry Friday AMA AZURE AI FOUNDRY DISCORD MODELS & OBSERVABILITY SEP 12, 2025 · 1:30-2:00 PM ET Han Che Senior PM, Core AI / Microsoft
20. Fri 1:30pm ET Join The Discord https://aka.ms/model-mondays/Discord Links To Resources Summary of AMA https://aka.ms/model-mondays/Forum #ModelMondays WATCH LIVE ON MONDAY FIND RECAPS ON FORUM JOIN AMA ON FRIDAY Mon 1:30pm ET Register Here https://aka.ms/model-mondays/RSVP