Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
180
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427-EhimeDSCSeminar-MBR-CBDT-Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
12
260624_NLP-colloquium: Hubness
Avatar for Hiroyuki Deguchi de9uch1
2
210
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
830
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
370
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
180
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
210
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300

Other Decks in Research

See All in Research
【Zozo Research 技術共有会】三次元領域の現在と展望
Avatar for 小島瑞貴 mickey_0226
3
600
PGDM: Physically Guided Diffusion Model for L Downscaling
Avatar for SatAI.challenge satai
3
450
医療LLMの現在地〜最新研究から社会実装までを考える〜
Avatar for kento sugimoto kento1109
1
1.7k
Language and AI
Avatar for Ayana Niwa ayaniwa
0
220
PHTalks Bengaluru - SSRF When All Else Fails
Avatar for Debangshu Kundu dk999
0
1.1k
シングルチャネルマルチトーカー音声認識の進展
Avatar for Ryo Masumura ryomasumura
0
240
2026年 オープンキャンパス 研究室紹介
Avatar for Jun Kurihara junkurihara
0
160
HAKARI-Bench - 実運用視点での情報検索モデル評価ベンチマーク
Avatar for Yuichi Tateno hotchpotch
1
710
進学校の生徒にはア行の苗字が多いのか
Avatar for Takashi Ozeki ozekinote
0
560
Harness Engineering and Al Agent
Avatar for Kazuki Inamura kzinmr
3
1.9k
LINEヤフー データサイエンス Meetup「三井物産コモディティ予測チャレンジ」の舞台裏-AlpacaTechパート
Avatar for tomo gamella
1
650
計算情報学研究室 （数理情報学第７研究室）2026
Avatar for Tomohiro tomohirokoana
0
810

Featured

See All Featured
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
1
390
Fireside Chat
Avatar for paigeccino paigeccino
42
4k
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
450
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
150k
Applied NLP in the Age of Generative AI
Avatar for Ines Montani inesmontani
PRO
4
2.4k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.9k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.8k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
990
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
6.1k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.9k
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
7.2k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫