Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
590
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
290
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
140
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
160
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
260
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
260

Other Decks in Research

See All in Research
まずはここから：Overleaf共同執筆・CopilotでAIコーディング入門・Codespacesで独立環境
Avatar for Yusuke Matsui matsui_528
2
670
Stealing LUKS Keys via TPM and UUID Spoofing in 10 Minutes - BSides 2025
Avatar for AnyKeyShik anykeyshik
0
150
Learning to (Learn at Test Time): RNNs with Expressive Hidden States
Avatar for Hiroto Kurita kurita
1
280
能動適応的実験計画
Avatar for MasaKat0 masakat0
2
900
長期・短期メモリを活用したエージェントの個別最適化
Avatar for AITC - DENTSU SOKEN isidaitc
0
220
CVPR2025論文紹介：Unboxed
Avatar for 村川卓也 murakawatakuya
0
180
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
960
Combinatorial Search with Generators
Avatar for Keisuke Okumura | 奥村圭祐 kei18
0
1.1k
機械学習と数理最適化の融合 (MOAI) による革新
Avatar for MIKIO KUBO mickey_kubo
1
400
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
Avatar for monochromegane monochromegane
0
4.3k
単施設でできる臨床研究の考え方
Avatar for Shuntaro Sato shuntaros
0
3.1k
CoRL2025速報
Avatar for robotpaper.challenge rpc
1
2.6k

Featured

See All Featured
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
2.8k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
249
1.3M
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
24
3.7k
Navigating Team Friction
Avatar for Lara Hogan lara
190
15k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
791
250k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
3.1k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
186
22k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.5k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫