Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

[mercari GEARS 2025] Evals for LLMApps/Agents

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for mercari mercari PRO
November 14, 2025
Technology
150
0

[mercari GEARS 2025] Evals for LLMApps/Agents

Avatar for mercari

mercari PRO

November 14, 2025

More Decks by mercari

See All by mercari
[DevDojo] Getting Started with BI: Looker Essentials - 2025
Avatar for mercari mercari
PRO
0
220
[DevDojo] Introduction to LLMs & AI Agents - 2025
Avatar for mercari mercari
PRO
0
390
[mercari GEARS 2025] Techniques for Reliable Code Generation Using AI Agents
Avatar for mercari mercari
PRO
0
350
[mercari GEARS 2025] Foundations of AI - The Invisible Forces Driving Product Innovation
Avatar for mercari mercari
PRO
0
370
[mercari GEARS 2025] Building Foundation for Mercari’s Global Expansion
Avatar for mercari mercari
PRO
1
550
[mercari GEARS 2025] The Past, Present, and Future of Anti-Phishing Measures at Mercari
Avatar for mercari mercari
PRO
0
200
[mercari GEARS 2025] Backend Standardization with MCP
Avatar for mercari mercari
PRO
0
280
[mercari GEARS 2025] Transforming customer engagement with Google Customer Engagement Suite
Avatar for mercari mercari
PRO
0
480
[mercari GEARS 2025] PJ Aurora’s Vision and Automated UI Quality Evaluation Agents
Avatar for mercari mercari
PRO
0
460

Other Decks in Technology

See All in Technology
AWSを利用する上で知っておきたい名前解決の話 2026
Avatar for nagisa_53 nagisa53
4
2.9k
渡米前の準備を制す！re:Invent 2026徹底準備術 / The Ultimate Preparation Guide for re:Invent 2026
Avatar for Yuji Oshima yuj1osm
1
550
慶應義塾大学 AI実践05 論文執筆の仕組み化
Avatar for Semantic Machine Intelligence Lab., Keio Univ. keio_smilab
PRO
6
3.7k
Active Directory と Entra ID のむむむな関係
Avatar for Murachi Akira murachiakira
PRO
3
1.6k
リアクションエンジニア ― 小さなリアクションから、話しかけやすい組織をつくる ―
Avatar for ryuguyana ryuguyana
1
130
Software Engineering in an AI-Driven World
Avatar for Erik Jhordan Rey erikjhordan_rey
0
120
`go get`したらELFが降ってきた件
Avatar for 鹿 taiyow
0
180
AX時代の自治体支援リソース再配分と役割分担の再構成：戦略とロードマップ（概要）
Avatar for Sayaka Isizuka sishi2026
0
200
eBPF 簡介 2026 版
Avatar for shunghsiyu shunghsiyu
0
190
kintoneで在庫管理システムを作るときの要件定義・設計ポイント
Avatar for Matsumura Minoru kai0707
0
230
IBC 2026 動画技術関連レポート / IBC 2026 Report
Avatar for CyberAgent cyberagentdevelopers
PRO
2
440
AI時代の組織作り：チーム開発から「個人×AI」への移行と、持続可能な「開発資本」の築き方
Avatar for ham ham0215
1
190

Featured

See All Featured
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
570
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
15k
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
610
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
31
6.3k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
330
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
350
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
18k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
70
68k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
35
2.9k
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
1.7k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.7k

Transcript

  1. Evals for LLMApps/Agents
 Jehandad Kamal
 Mercari / Engineer @ AI/LLM

    Team


  2. Mercari AI Listing Support https://about.mercari.com/en/press/news/articles/20240910_aisupport/

  3. Agents


  4. Agent Development Loop


  5. First SDLC for Agents
 ai.mercari.com

  6. Types of Evals ( by technique )
 ai.mercari.com

  7. Types of Evals (by perspective )


  8. Improved SDLC for Agents


  9. Thank You!