サブセット探索を用いた高速なkNNニューラル機械翻訳

第8回AAMTセミナー
AAMT若手翻訳研究会
最優秀賞

Transcript

1. 𝒌
2. ◼ ⚫ ⚫ ◼ ⚫ (Zhang+, NAACL2018; Gu+, AAAI2018; Khandelwal+, ICLR2021) ▶ (Nagao, 1984) ▶ ⚫ 𝑘 (Khandelwal+, ICLR2021) ▶ ▶ ▶ Guiding Neural Machine Translation with Retrieved Translation Pieces (Zhang+, NAACL2018) Search Engine Guided Neural Machine Translation (Gu+, AAAI2018) Nearest Neighbor Machine Translation (Khandelwal+, ICLR2021) A framework for a mechanical translation between Japanese and English by analogy principle (Nagao, 1984)
3. ◼ ◼ ⚫ ⚫
4. 𝒌 (Khandelwal+, ICLR2021) ◼ ⚫ ⚫ ⚫ ◼ ⚫ ▶ ⚫ ▶ ≈ Nearest Neighbor Machine Translation (Khandelwal+, ICLR2021) 𝒙 𝒚
5. 𝒌 (Khandelwal+, ICLR2021) 𝒌𝑖 ∈ ℝ𝐷 𝑓 𝒙, 𝒚<𝑡 ∈ ℝ𝐷 Nearest Neighbor Machine Translation (Khandelwal+, ICLR2021) ◼ 𝑘 ◼ ⚫ ⚫ 𝑝𝑘NN 𝑦𝑡 𝒙, 𝒚<𝑡 ∝ ෍ 𝑖=1 𝑘 𝟙𝑦𝑡=𝑣𝑖 exp − 𝒌𝑖 − 𝑓 𝒙, 𝒚<𝑡 2 2 𝜏 ◼ 𝑘
6. 𝒌 ◼ (Martins+, EMNLP2022) ◼ (Meng+, ACLFindings2022) ⚫ 𝑘 𝑘 𝜆 = 0.5 𝑘 = 16 Chunk-based Nearest Neighbor Machine Translation (Martins+, EMNLP2022) Fast Nearest Neighbor Machine Translation (Meng+, ACL Findings2022)
7. 𝒌 ◼ 𝑘 ◼ ⚫ 𝑘 (Matsui+, ACMMM2018) ⚫ 𝑘 𝑘 𝑘 Reconfigurable Inverted Index (Matsui+, ACMMM2018) 𝒌
8. ◼ ⚫ 𝑘 ⚫ 𝑘 ◼ ◼ 𝑘
9. 𝑛 𝑘 1 1 1 1 1 1 1 1 1
10. 𝑛 𝑘 1 1 1 1 1 1 1 1 1
11. 𝑛 𝑘 1 1 1 1 1 1 1 1 1
12. ⚫ ⚫ ⚫ ⚫ ⚫ 𝑘 𝜆 = 0.5 𝑘 = 16 𝑛 = 56
13. 𝑘 𝑘 ◼ 𝑘 ⚫ ▶ ⚫ ▶
14. ◼ 𝑘 𝒌 𝒌
15. ◼ ⚫ 𝑘
16. 𝒌 𝒌 ◼ ⚫ ⚫ ◼ 𝑘 ⚫ ⚫ ◼ ⚫
17. ⚫ ⚫ ▶ ⚫ ▶