Upgrade to Pro — share decks privately, control downloads, hide ads and more …

[mercari GEARS 2025] Evals for LLMApps/Agents

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for mercari mercari PRO
November 14, 2025
Technology
120
0

[mercari GEARS 2025] Evals for LLMApps/Agents

Avatar for mercari

mercari PRO

November 14, 2025

More Decks by mercari

See All by mercari
[DevDojo] Getting Started with BI: Looker Essentials - 2025
Avatar for mercari mercari
PRO
0
130
[DevDojo] Introduction to LLMs & AI Agents - 2025
Avatar for mercari mercari
PRO
0
160
[mercari GEARS 2025] Techniques for Reliable Code Generation Using AI Agents
Avatar for mercari mercari
PRO
0
280
[mercari GEARS 2025] Foundations of AI - The Invisible Forces Driving Product Innovation
Avatar for mercari mercari
PRO
0
260
[mercari GEARS 2025] Building Foundation for Mercari’s Global Expansion
Avatar for mercari mercari
PRO
1
440
[mercari GEARS 2025] The Past, Present, and Future of Anti-Phishing Measures at Mercari
Avatar for mercari mercari
PRO
0
140
[mercari GEARS 2025] Backend Standardization with MCP
Avatar for mercari mercari
PRO
0
210
[mercari GEARS 2025] Transforming customer engagement with Google Customer Engagement Suite
Avatar for mercari mercari
PRO
0
370
[mercari GEARS 2025] PJ Aurora’s Vision and Automated UI Quality Evaluation Agents
Avatar for mercari mercari
PRO
0
350

Other Decks in Technology

See All in Technology
5分でわかるDuckDB Quack
Avatar for chanyou0311 chanyou0311
4
310
最近評価が難しくなった
Avatar for Mitsui maroon8021
0
200
なぜ人は自分のプロジェクトを 「なんちゃってアジャイル」と 自嘲するのか
Avatar for Kozo Taira kozotaira
0
240
型は壁、Rustでもバグを直すな、表現できなくせよ
Avatar for nwiizo nwiizo
3
240
なぜ私たちのSREプラクティスはなかなか機能しないのか 〜システムより先に組織を見る〜 / Why our SRE practices aren't really working
Avatar for VTRyo vtryo
0
160
プロンプト_きのこカンファレンス2026_LT
Avatar for ゆるふわヒーラー yurufuwahealer
0
130
「軸足」は 固定しなくていい - 熱量と強みで描く、しなやかなキャリアの形
Avatar for KAKEHASHI kakehashi
PRO
1
330
RAGの精度向上とエージェント活用
Avatar for KintoTech_Dev kintotechdev
2
120
MySQL & MySQL HeatWave Report - June 2026
Avatar for Olivier DASINI freshdaz
0
300
攻撃者がいなくてもAIエージェントはインシデントを起こす
Avatar for Nomizo Nomizo nomizone
0
190
From Prompt Engineering to Loop Engineering
Avatar for shibuiwilliam shibuiwilliam
1
330
AIに障害切り分けを全部やってもらった。 。 。 。
Avatar for estie | エスティ estie
0
340

Featured

See All Featured
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
150k
Docker and Python
Avatar for Tania Allard trallard
47
3.9k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.8k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.5k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
510
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
22k
Exploring the relationship between traditional SERPs and Gen AI search
Avatar for Ray Grieselhuber raygrieselhuber
PRO
2
4.1k
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.3k
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
3
1.1k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
1.4k
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
840
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k

Transcript

  1. Evals for LLMApps/Agents
 Jehandad Kamal
 Mercari / Engineer @ AI/LLM

    Team


  2. Mercari AI Listing Support https://about.mercari.com/en/press/news/articles/20240910_aisupport/

  3. Agents


  4. Agent Development Loop


  5. First SDLC for Agents
 ai.mercari.com

  6. Types of Evals ( by technique )
 ai.mercari.com

  7. Types of Evals (by perspective )


  8. Improved SDLC for Agents


  9. Thank You!