Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
520
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
270
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
130
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
150
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
250

Other Decks in Research

See All in Research
生成的推薦の人気バイアスの分析：暗記の観点から / JSAI2025
Avatar for Shotaro Ishihara upura
0
240
「どう育てるか」より「どう働きたいか」〜スクラムマスターの最初の一歩〜
Avatar for hirakawa hirakawa51
0
740
20250502_ABEJA_論文読み会_スライド
Avatar for Tomoki Fujihara flatton
0
190
集合間Bregmanダイバージェンスと置換不変NNによるその学習
Avatar for Takahiro Kawashima wasyro
0
130
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
24
18k
Ad-DS Paper Circle #1
Avatar for Yusuke Kaneko ykaneko1992
0
5.8k
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
Avatar for SatAI.challenge satai
3
240
データサイエンティストの就労意識～2015→2024 一般（個人）会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
910
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
0
130
研究テーマのデザインと研究遂行の方法論
Avatar for Hisashi Ishihara hisashiishihara
5
1.5k
引力・斥力を制御可能なランダム部分集合の確率分布
Avatar for Takahiro Kawashima wasyro
0
220
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
180

Featured

See All Featured
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
96
6.2k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.4k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.4k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
25
1.8k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
73
5k
Building Adaptive Systems
Avatar for Chris Keathley keathley
43
2.7k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
53
2.9k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3.1k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
18
1.1k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫