Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
160
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
260624_NLP-colloquium: Hubness
Avatar for Hiroyuki Deguchi de9uch1
0
120
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
800
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
360
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
170
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
200
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
230
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
340
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
310

Other Decks in Research

See All in Research
Overview of AGRODEP Activities and Current Status: Dr. Seraphin Niyonsenga
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
120
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
160
シングルチャネルマルチトーカー音声認識の進展
Avatar for Ryo Masumura ryomasumura
0
200
進学校の生徒にはア行の苗字が多いのか
Avatar for Takashi Ozeki ozekinote
0
480
[BlackHatAsia2026] Hidden Telemetry: Uncovering TraceLogging ETW Providers You're Not Using (Yet)
Avatar for Asuka Nakajima asuna_jp
1
590
LLM の Attention 機構まとめ — 数式・計算量・メモリ
Avatar for プワー puwaer
8
2.3k
Spatial Active Noise Control Based on Sound Field Interpolation Incorporating Physical Constraints
Avatar for NII S. Koyama's Lab skoyamalab
0
130
敵対生成プロンプト同時探索による内省型プロンプト最適化
Avatar for Kotaro Inoue kinoue_smarthr
0
320
Model Discovery and Graph Simulation: A Lightweight Gateway to Chaos Engineering
Avatar for Anatoly A. Krasnovsky anatolykr
0
230
SoftMatcha 2: 1兆語規模コーパスの超高速かつ柔らかい検索
Avatar for Masataka YONEDA e869120_sub
7
3.6k
セマンティック通信勉強会 6Gに向けたデバイス間効率的な通信の技術紹介・課題・今後展望
Avatar for SatAI.challenge satai
3
230
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
630

Featured

See All Featured
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
770
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.9k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
340
KATA
Avatar for Megan Lloyd mclloyd
PRO
35
15k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
410
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.2k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
230k
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
1
620
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
620
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
240

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫