Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Searching for Needles in a Haystack: On the Rol...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
180
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427 Ehime DS Seminar: MBR-CBDT Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
38
20260624 NLP colloquium: 単一のhubテキストがCLIPを壊す：hubnessによる埋め込みの脆弱性特定
Avatar for Hiroyuki Deguchi de9uch1
2
280
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
840
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
380
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
180
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
210
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300

Other Decks in Research

See All in Research
人間中心の意思決定支援AI
Avatar for Yukino Baba yukinobaba
PRO
7
4.1k
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
220
JPA2026_NetworkTutorial_JunKashihara
Avatar for JunKashihara junkashihara
0
180
医療LLMの現在地〜最新研究から社会実装までを考える〜
Avatar for kento sugimoto kento1109
1
1.8k
全国町字単位空き家率推定データver1.0データ仕様
Avatar for microbase microbaseinc
0
260
VRID: View-Invariant Representation through Dual-Axis Transformation for Cross-iew Pose Estimation
Avatar for SatAI.challenge satai
3
110
高性能計算機クラスタを用いた大規模点群処理による森林の単木抽出と構造解析
Avatar for Kenta Itakura kentaitakura
1
130
SAKURAONE: An Open Ethernet-based AI HPC System And Its Observed Workload Dynamics in a Single-Tenant LLM Development Environment
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
610
横浜市長（山中氏）の言動にかかる第三者による調査報告書
Avatar for Sayaka Ishizuka y150saya
0
390
データサイエンティストの就労意識～2015 → 2026 一般(個人)会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
890
プレイス・ワークショップ秋葉原
Avatar for 日本大学 都市計画研究室（泉山ゼミ） izumiyama_lab
1
110
シングルチャネルマルチトーカー音声認識の進展
Avatar for Ryo Masumura ryomasumura
0
320

Featured

See All Featured
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
2.2k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
41k
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
1k
It's Worth the Effort
Avatar for 3n 3n
188
29k
Fireside Chat
Avatar for paigeccino paigeccino
43
4k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
528
40k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
85
9.6k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.4k
Ten Tips & Tricks for a 🌱 transition
Avatar for Manu Carrasco Molina stuffmc
1
240
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
1
1.6k
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
500

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫