Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
190
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427 Ehime DS Seminar: MBR-CBDT Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
88
20260624 NLP colloquium: 単一のhubテキストがCLIPを壊す：hubnessによる埋め込みの脆弱性特定
Avatar for Hiroyuki Deguchi de9uch1
2
320
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
870
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
400
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
190
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
220
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
360
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
310

Other Decks in Research

See All in Research
Karkada さんの論文 × 2 の紹介: (1) Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models, (2) Symmetry in language statistics shapes the geometry of model representations
Avatar for Sho Yokoi eumesy
PRO
1
960
Prithvi-EO-2.0
Avatar for SatAI.challenge satai
3
110
Bilan travail en élevage : première restitution des enquêtes 2025-2026
Avatar for Idele institutdelelevage
PRO
0
160
Top 4セキュリティ会議に一通り論文が採択されるまでの道のりと展望 / Top 4 Security Grand Slam
Avatar for Takao Murakami takaomurakami
0
1.1k
Local Development Companies Network - National Conference 2026
Avatar for Local Development Companies Network ldcn
0
160
[CV勉強会＠関東 CVPR2026] PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow / kantocv 67th CVPR 2026
Avatar for Shunsuke KITADA shunk031
0
400
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Avatar for SatAI.challenge satai
3
350
ros2-perf-multihost: 分散システムにおける客観的なアーキテクチャ評価フレームワーク
Avatar for takasehideki takasehideki
0
330
[最先端NLP勉強会2026] Checklists Are Better Than Reward Models For Aligning Language Models
Avatar for Kento Nozawa nzw0301
1
350
超効率化への挑戦：1bit LLMの現状と展望
Avatar for Yuma Ichikawa yumaichikawa
0
970
最先端NLP勉強会2026 論文紹介：Reasoning with Sampling: Your Base Model is Smarter Than You Think (ICLR 2026 paper)
Avatar for Kogoro kogoro
4
960
J-STAGEの現況と全文XML登載必須化について
Avatar for XSPA xspa2012
0
380

Featured

See All Featured
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.2k
How to audit for AI Accessibility on your Front & Back End
Avatar for davetheseo davetheseo
0
630
Claude Code のすすめ
Avatar for schroneko schroneko
67
230k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.4k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
74
43k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.4k
Fireside Chat
Avatar for paigeccino paigeccino
43
4.1k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
520
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
460
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
35
2.9k
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
2
970

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫