Upgrade to Pro — share decks privately, control downloads, hide ads and more …

[mercari GEARS 2025] Evals for LLMApps/Agents

Avatar for mercari mercari PRO
November 14, 2025
Technology
130
0

[mercari GEARS 2025] Evals for LLMApps/Agents

Avatar for mercari

mercari PRO

November 14, 2025

More Decks by mercari

See All by mercari
[DevDojo] Getting Started with BI: Looker Essentials - 2025
Avatar for mercari mercari
PRO
0
150
[DevDojo] Introduction to LLMs & AI Agents - 2025
Avatar for mercari mercari
PRO
0
180
[mercari GEARS 2025] Techniques for Reliable Code Generation Using AI Agents
Avatar for mercari mercari
PRO
0
300
[mercari GEARS 2025] Foundations of AI - The Invisible Forces Driving Product Innovation
Avatar for mercari mercari
PRO
0
290
[mercari GEARS 2025] Building Foundation for Mercari’s Global Expansion
Avatar for mercari mercari
PRO
1
490
[mercari GEARS 2025] The Past, Present, and Future of Anti-Phishing Measures at Mercari
Avatar for mercari mercari
PRO
0
150
[mercari GEARS 2025] Backend Standardization with MCP
Avatar for mercari mercari
PRO
0
230
[mercari GEARS 2025] Transforming customer engagement with Google Customer Engagement Suite
Avatar for mercari mercari
PRO
0
410
[mercari GEARS 2025] PJ Aurora’s Vision and Automated UI Quality Evaluation Agents
Avatar for mercari mercari
PRO
0
380

Other Decks in Technology

See All in Technology
会社紹介資料 / Sansan Company Profile
Avatar for Sansan, Inc. sansan33
PRO
24
430k
少人数チームで実現する、大規模AWSサーバーレス基盤における"揺らがない"信頼性運用
Avatar for maimyyym maimyyym
1
110
SmartHR Engineering Team Deck
Avatar for SmartHR, Inc. smarthr
1
2.8k
JavaScript 研修 (2026)
Avatar for Recruit recruitengineers
PRO
2
630
Eight Engineering Unit 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
3
8.2k
コーチングの奥義 何もしないテクニック
Avatar for Watanabe Jin jinwatanabe
0
110
【CEDEC2026】Creative Approaches to Localizing the Dialects and Unique Speech of Umamusume: Pretty Derby Characters in English
Avatar for Cygames, Inc. cygames
PRO
3
25k
FDEの心得
Avatar for Noriaki Oji noriakioji
5
6.3k
My broken English still works: speaking at global OSS events
Avatar for Naruhiko Ogasawara naruoga
0
110
事業価値と Engineering 2026年度版
Avatar for Recruit recruitengineers
PRO
51
25k
FPGAが実現する遠方宇宙の高空間分解能天体撮影 -大型地上望遠鏡の視力を補正する「補償光学」とは？-
Avatar for 高橋光明 / Mitsuaki Takahashi komei_mt
0
490
Master Dataグループ紹介資料
Avatar for Sansan, Inc. sansan33
PRO
1
4.8k

Featured

See All Featured
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
1
460
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
55
8.3k
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
470
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
350
Navigating Weather and Climate Data
Avatar for Ryan Abernathey rabernat
0
480
エンジニアに許された特別な時間の終わり
Avatar for watany watany
108
250k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.6k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
210
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
6.1k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
76
5.3k
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
470

Transcript

  1. Evals for LLMApps/Agents
 Jehandad Kamal
 Mercari / Engineer @ AI/LLM

    Team


  2. Mercari AI Listing Support https://about.mercari.com/en/press/news/articles/20240910_aisupport/

  3. Agents


  4. Agent Development Loop


  5. First SDLC for Agents
 ai.mercari.com

  6. Types of Evals ( by technique )
 ai.mercari.com

  7. Types of Evals (by perspective )


  8. Improved SDLC for Agents


  9. Thank You!