Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
180
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427-EhimeDSCSeminar-MBR-CBDT-Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
12
260624_NLP-colloquium: Hubness
Avatar for Hiroyuki Deguchi de9uch1
2
210
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
830
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
370
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
180
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
210
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300

Other Decks in Research

See All in Research
GLIM とMegaParticles：正規分布近似の限界とタイトカップリング＆パーティクルフィルタの進展 / GLIM and MegaParticles : Progress of the distribution representation in SLAM
Avatar for koide3 koide3
0
770
MM-OVSeg: Multimodal Optical–SAR Fusion for Open-Vocabulary Segmentation in Remote Sensing
Avatar for SatAI.challenge satai
3
120
論文読み会 SNLP2026 Tau2-Bench: Evaluating Conversational Agents in a Dual-Control Environment
Avatar for S s_mizuki_nlp
0
210
JICA QUEST 共創×革新プログラム Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
500
RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
Avatar for SatAI.challenge satai
3
520
Language and AI
Avatar for Ayana Niwa ayaniwa
0
220
東京大学工学部計数工学科、計数工学特別講義の説明資料
Avatar for KIKUCHI Shunsuke kikuzo
0
640
SOTAのさらに先へ：厳しい推論制約下での高性能モデルのPost-Training
Avatar for Hiroshi Y (RabotniKuma) analokmaus
0
1.5k
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
200
SLAMはどこまで解決されたのか？
Avatar for tomonom tomonom
0
1.3k
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
360
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Avatar for SatAI.challenge satai
3
240

Featured

See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.6k
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
1.1k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
23k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
1
1.1k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.3k
Exploring the relationship between traditional SERPs and Gen AI search
Avatar for Ray Grieselhuber raygrieselhuber
PRO
2
4.3k
Side Projects
Avatar for Sacha Greif sachag
455
43k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
287
14k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.7k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
570
Tell your own story through comics
Avatar for letsgokoyo letsgokoyo
1
1.1k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
640

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫