Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
120

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
500
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
260
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
130
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
150
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
170
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
290
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
240

Other Decks in Research

See All in Research
データサイエンティストの採用に関するアンケート
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
1.1k
【輪講資料】Moshi: a speech-text foundation model
for real-time dialogue
Avatar for Hayato Tsukagoshi hpprc
3
520
Ad-DS Paper Circle #1
Avatar for Yusuke Kaneko ykaneko1992
0
5.7k
Minimax and Bayes Optimal Best-arm Identification: Adaptive Experimental Design for Treatment Choice
Avatar for MasaKat0 masakat0
0
150
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshechka Y analokmaus
2
640
とあるSREの博士「過程」 / A Certain SRE’s Ph.D. Journey
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
6
3.5k
利用シーンを意識した推薦システム 〜SpotifyとAmazonの事例から〜
Avatar for kuri8ive kuri8ive
1
220
電力システム最適化入門
Avatar for MIKIO KUBO mickey_kubo
1
750
Streamlit 総合解説 ~ PythonistaのためのWebアプリ開発 ~
Avatar for MIKIO KUBO mickey_kubo
1
1.2k
2025年度 生成AIの使い方/接し方
Avatar for taichi_murayama hkefka385
1
730
IMC の細かすぎる話 2025
Avatar for @smly smly
2
280
Looking for Escorts in Sydney?
Avatar for sophia lunsophia
1
120

Featured

See All Featured
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
337
57k
Code Review Best Practice
Avatar for Trisha Gee trishagee
69
19k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
301
21k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
138
34k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
524
40k
Faster Mobile Websites
Avatar for Dean Hume deanohume
308
31k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
367
19k
Fireside Chat
Avatar for paigeccino paigeccino
37
3.5k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.9k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
90
590k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.4k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫