Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
570
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
280
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
140
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
160
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
250

Other Decks in Research

See All in Research
[CV勉強会@関東 CVPR2025] VLM自動運転model S4-Driver
Avatar for Shin-kyoto shinkyoto
2
520
[論文紹介] Intuitive Fine-Tuning
Avatar for Ryokan RI ryou0634
0
120
生成的推薦の人気バイアスの分析：暗記の観点から / JSAI2025
Avatar for Shotaro Ishihara upura
0
280
[輪講] SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
Avatar for Naoki Kato nk35jk
2
1.2k
投資戦略202508
Avatar for Pragmaworks pw
0
560
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
390
Stealing LUKS Keys via TPM and UUID Spoofing in 10 Minutes - BSides 2025
Avatar for AnyKeyShik anykeyshik
0
140
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
640
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
Avatar for monochromegane monochromegane
0
3.6k
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
25
19k
Mechanistic Interpretability：解釈可能性研究の新たな潮流
Avatar for Koshiro Aoki koshiro_aoki
1
440
【輪講資料】Moshi: a speech-text foundation model
for real-time dialogue
Avatar for Hayato Tsukagoshi hpprc
3
740

Featured

See All Featured
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
30
2.9k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
4
680
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.4k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
64
7.9k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
79
6k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
180
9.9k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
13k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.7k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫