Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
120

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
480
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
260
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
110
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
150
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
170
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
280
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
240

Other Decks in Research

See All in Research
LLM-as-a-Judge: 文章をLLMで評価する@教育機関DXシンポ
Avatar for Kouta Nakayama k141303
3
810
ｳｯﾄﾞｽﾀｯｸﾁｬﾝ：木材を用いた小型エージェントロボットの開発と印象評価 / ec75-sato
Avatar for yumulab yumulab
1
410
GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization
Avatar for SatAI.challenge satai
3
240
Weekly AI Agents News!
Avatar for masatoto masatoto
33
68k
研究テーマのデザインと研究遂行の方法論
Avatar for Hisashi Ishihara hisashiishihara
5
1.4k
NLP2025SharedTask翻訳部門
Avatar for MORIOKA Taku moriokataku
0
300
心理言語学の視点から再考する言語モデルの学習過程
Avatar for Masato Mita chemical_tree
2
340
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
24
14k
Ad-DS Paper Circle #1
Avatar for Yusuke Kaneko ykaneko1992
0
5.5k
Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagery
Avatar for SatAI.challenge satai
3
480
CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations
Avatar for SatAI.challenge satai
3
210
EOGS: Gaussian Splatting for Efficient Satellite Image Photogrammetry
Avatar for SatAI.challenge satai
4
250

Featured

See All Featured
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
667
120k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.3k
Fireside Chat
Avatar for paigeccino paigeccino
37
3.5k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
51
8.5k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
367
19k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
107
19k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
69
4.7k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
48
5.4k
Building an army of robots
Avatar for Kyle Neath kneath
306
45k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.3k
The Language of Interfaces
Avatar for Des Traynor destraynor
158
25k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫