【輪講資料】How much can language models memorize?

August 19, 2026

0

【輪講資料】How much can language models memorize?

WIP

Yano

August 19, 2026

More Decks by Yano

See All by Yano

【輪講資料】Decoding Dense Embeddings: Sparse Autoencoders for Interpreting and Discretizing Dense Retrieval

0

150

【輪講資料】Length-Induced Embedding Collapse in PLM-based Models

0

180

【輪講資料】How Do Large Language Models Acquire Factual Knowledge During Pretraining?

0

340

NLP2025参加報告

0

730

【輪講資料】ReAct: Synergizing Reasoning and Acting in Language Models / Tree of Thoughts: Deliberate Problem Solving with Large Language Models

0

290

【輪講資料】SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval

2

410

【輪講資料】From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers

0

160

【輪講資料】Zero-shot Cross-lingual Semantic Parsing

0

190

Featured

See All Featured

Primal Persuasion: How to Engage the Brain for Learning That Lasts

0

420

A brief & incomplete history of  UX Design for the World Wide Web: 1989–2019

2

470

Practical Orchestrator

191

12k

What the history of the web can teach us about the future of AI

PRO

1

660

PRO

2

53k

I Don’t Have Time: Getting Over the Fear to Launch Your Podcast

34

2.8k

How To Speak Unicorn (iThemes Webinar)

1

530

Mobile First: as difficult as doing things right

225

10k

HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy

PRO

0

650

ラッコキーワードサービス紹介資料

1

4.4M

Why Our Code Smells

PRO

340

58k

Groundhog Day: Seeking Process in Gaming for Health

0

280

Transcript

How much can language models memorize? John Xavier Morris, Chawin
Sitawarin, Chuan Guo, Narine Kokhlikyan, G. Edward Suh, Alexander M Rush, Kamalika Chaudhuri, Saeed Mahloujifar 笹野研究室 D2 矢野千紘