Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

[mercari GEARS 2025] Evals for LLMApps/Agents

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for mercari mercari PRO
November 14, 2025
Technology
140
0

[mercari GEARS 2025] Evals for LLMApps/Agents

Avatar for mercari

mercari PRO

November 14, 2025

More Decks by mercari

See All by mercari
[DevDojo] Getting Started with BI: Looker Essentials - 2025
Avatar for mercari mercari
PRO
0
180
[DevDojo] Introduction to LLMs & AI Agents - 2025
Avatar for mercari mercari
PRO
0
340
[mercari GEARS 2025] Techniques for Reliable Code Generation Using AI Agents
Avatar for mercari mercari
PRO
0
320
[mercari GEARS 2025] Foundations of AI - The Invisible Forces Driving Product Innovation
Avatar for mercari mercari
PRO
0
320
[mercari GEARS 2025] Building Foundation for Mercari’s Global Expansion
Avatar for mercari mercari
PRO
1
520
[mercari GEARS 2025] The Past, Present, and Future of Anti-Phishing Measures at Mercari
Avatar for mercari mercari
PRO
0
180
[mercari GEARS 2025] Backend Standardization with MCP
Avatar for mercari mercari
PRO
0
260
[mercari GEARS 2025] Transforming customer engagement with Google Customer Engagement Suite
Avatar for mercari mercari
PRO
0
440
[mercari GEARS 2025] PJ Aurora’s Vision and Automated UI Quality Evaluation Agents
Avatar for mercari mercari
PRO
0
410

Other Decks in Technology

See All in Technology
手を動かして実感する、Kiro が変える開発体験
Avatar for Riku INADA inariku
0
390
2026-09-26 Platform Engineering Kaigi 2026 インフラとアプリの境界線と委譲の設計 / Drawing the Infra and App Line
Avatar for SUZUKI Masashi masasuzu
0
140
AWS App Runnerから Cloudflare Workersへ移行した話
Avatar for ryota-09 ryota09
0
110
AI Agent入門〜今更聞けないAgentの話〜
Avatar for Magy hiromimaganuma
0
120
AgentCore Runtime上にAgentic Coding基盤を構築・展開する際の設計ポイントと限界点 / Design considerations and limitations when building an agentic coding platform on AgentCore Runtime
Avatar for Har1101 har1101
7
780
AI coding 整合正規方法
Avatar for philipz philipz
0
550
Apache Iceberg が拓く AI 時代のオープンレイクハウス
Avatar for Tomohiro Tanaka tomtanaka
0
110
AIに会社の文脈を理解させる技術～上流工程・非エンジニアにも広げるハーネスエンジニアリング実践～
Avatar for Ochtum ochtum
0
130
猫でもわかるKiro Web
Avatar for Hiroo Katoh kentapapa
1
120
What the customer really needed
Avatar for Yasunobu Kawaguchi kawaguti
PRO
3
230
EventBridge に「合流」はない ― サーバーレスのワークフローを育てるということ / No Join in EventBridge
Avatar for Yusuke Shimizu yusukeshimizu
2
580
Hermes Agentで、AIが調べて記事を書くブログを作った話
Avatar for ayane blueb
0
110

Featured

See All Featured
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1.4k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
1k
Leo the Paperboy
Avatar for Maya Tellez mayatellez
10
2.3k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
109
250k
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
4
1.2k
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
3.1k
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
500
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
76
5.4k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1.6k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
250
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.5k

Transcript

  1. Evals for LLMApps/Agents
 Jehandad Kamal
 Mercari / Engineer @ AI/LLM

    Team


  2. Mercari AI Listing Support https://about.mercari.com/en/press/news/articles/20240910_aisupport/

  3. Agents


  4. Agent Development Loop


  5. First SDLC for Agents
 ai.mercari.com

  6. Types of Evals ( by technique )
 ai.mercari.com

  7. Types of Evals (by perspective )


  8. Improved SDLC for Agents


  9. Thank You!