Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Symmetry in language statistics shapes the geom...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Sho Yokoi Sho Yokoi PRO
August 13, 2026
Research
4
0

Symmetry in language statistics shapes the geometry of model representations

第18回最先端NLP勉強会
https://sites.google.com/view/snlp-jp/home/2026

Avatar for Sho Yokoi

Sho Yokoi PRO

August 13, 2026

More Decks by Sho Yokoi

See All by Sho Yokoi
言語モデルから言語について語る際に押さえておきたいこと
Avatar for Sho Yokoi eumesy
PRO
7
2.5k
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
540
言語モデルの内部機序：解析と解釈
Avatar for Sho Yokoi eumesy
PRO
94
32k
コーパスを丸呑みしたモデルから言語の何がわかるか
Avatar for Sho Yokoi eumesy
PRO
12
4.9k
Zipf 白色化：タイプとトークンの区別がもたらす良質な埋め込み空間と損失関数
Avatar for Sho Yokoi eumesy
PRO
10
2.6k
Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve
Avatar for Sho Yokoi eumesy
PRO
7
2.1k
「確率的なオウム」にできること、またそれがなぜできるのかについて
Avatar for Sho Yokoi eumesy
PRO
8
4.7k
A Theory of Emergent In-Context Learning as Implicit Structure Induction
Avatar for Sho Yokoi eumesy
PRO
5
1.8k
ChatGPT と自然言語処理 / 言語の意味の計算と最適輸送
Avatar for Sho Yokoi eumesy
PRO
24
19k

Other Decks in Research

See All in Research
NLP colloquium: AI Safety Survey
Avatar for Masahiro Kaneko kanekomasahiro
0
930
HackSick vol.7 LT資料【LLMアーキテクチャ入門・事前学習時の躓き所解説】 スパースなAttention・状態空間モデル
Avatar for Rikka Botan rikkabotan7
0
140
[CV勉強会＠関東 CVPR2026] PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow / kantocv 67th CVPR 2026
Avatar for Shunsuke KITADA shunk031
0
230
The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
Avatar for Shunsuke KITADA shunk031
4
1.2k
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
640
AY 2026 Guide to Academic Writing Using Generative AI - Workshop
Avatar for Kenji Saito ks91
PRO
0
150
CVPR2026論文紹介_VLMにとって​良いvision encoderとは何か？​Rethinking Model Selection in VLM Through the Lens of Gromov-Wasserstein Distance​
Avatar for 小林優斗 kobayashi31
1
190
Visual SLAM未来予測 / Future Prediction in Visual SLAM
Avatar for koide3 koide3
1
860
Dual Quadric表現を用いた動的物体追跡とRGB-D・IMU制約の密結合によるオドメトリ推定
Avatar for Toyozo Shimada nanoshimarobot
0
490
[BlackHatAsia2026] Hidden Telemetry: Uncovering TraceLogging ETW Providers You're Not Using (Yet)
Avatar for Asuka Nakajima asuna_jp
1
640
全国町字単位空き家率推定データver1.0データ仕様
Avatar for microbase microbaseinc
0
180
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
190

Featured

See All Featured
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.2k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
10k
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
59
6.9k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2.1k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
250
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
270
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
220
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
220k
Amusing Abliteration
Avatar for ianozsvald ianozsvald
1
240
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k

Transcript

  1. Symmetry in language statistics shapes the geometry of model representations

    Dhruva Karkada, Daniel J. Korchinski, Andres Nava, Matthieu Wyart, Yasaman Bahri (UC Berkeley, EPFL, Johns Hopkins, Google DeepMind) ICML 2026, Spotlight https://arxiv.org/abs/2602.15029 読む⼈︓横井 祥 国語研・統数研・理研・JST創発・ . 2026-**-**, 第18回最先端NLP勉強会 ※ とくに注釈がない限り，図や数式は， 論⽂に掲載されているものを紹介者が適宜加筆・修正したものです