Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
An Effective Approach to Unsupervised Machine Translationの紹介
Search
Ryusuke_Tanaka
November 21, 2019
Technology
0
96
An Effective Approach to Unsupervised Machine Translationの紹介
An Effective Approach to Unsupervised Machine Translationの紹介です。
教師なし翻訳に関するお話です。
Ryusuke_Tanaka
November 21, 2019
Tweet
Share
More Decks by Ryusuke_Tanaka
See All by Ryusuke_Tanaka
医師向けQAサイトのための推薦システム開発
ryusuketa
1
1.5k
Universal Decompositional Semantics on Universal Dependencies
ryusuketa
0
58
Learning Dual Retrieval Module for Semi-supervised Relation Extractionの紹介
ryusuketa
0
39
動画視聴を整数倍(最大値)で_効率化するchrome extension作った
ryusuketa
0
62
双曲空間への単語埋め込みと QAサービスでの自然言語処理を 用いた推薦システムについて
ryusuketa
0
350
Other Decks in Technology
See All in Technology
なぜ NOT A HOTEL が Web3 に取り組むのか - NOT A HOTEL TECH TALK
ynunokawa
0
160
アプリがつくるNOT A HOTELブランド
hokuts
1
450
Garoon 開発チーム / Garoon development team
cybozuinsideout
PRO
2
2.9k
Apple Vision Pro trial session
akkeylab
0
120
Data and AI Governance: Existing Challenges and Emerging Trends
scotthsieh825
0
150
OpenTelemetry を使ったトレースエグザンプラーの活用 / otel-trace-exemplar
k6s4i53rx
2
630
DevOpsメトリクスとアウトカムの接続にトライ!開発プロセスを通して計測できるメトリクスの活用方法
ham0215
1
190
Next'24 事例セッションの紹介とクラウド資格を活用したキャリア形成について語りMuscle
yasumuusan
1
320
ここが嬉しいABAC ここが辛いよABAC #再解説+補足編
masahirokawahara
0
210
シン・Kafka / shin-kafka
oracle4engineer
PRO
7
2.7k
自動生成を活用した、運用保守コストを抑える Error/Alert/Runbook の一元集約管理 / Centralized management of Error/Alert/Runbook to minimize operational costs using automated code generation
biwashi
9
2.1k
**強い**エンジニアのなり方 - フィードバックサイクルを勝ち取る / grow one day each day
soudai
61
17k
Featured
See All Featured
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
1
1.3k
Designing Experiences People Love
moore
136
23k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
321
20k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
9
8.3k
Music & Morning Musume
bryan
41
5.6k
KATA
mclloyd
14
12k
Typedesign – Prime Four
hannesfritz
36
2.1k
Learning to Love Humans: Emotional Interface Design
aarron
266
39k
The Power of CSS Pseudo Elements
geoffreycrofte
59
5k
RailsConf 2023
tenderlove
2
530
The Invisible Customer
myddelton
114
12k
Testing 201, or: Great Expectations
jmmastey
27
6.3k
Transcript
An Effective Approach to Unsupervised Machine Translation
None
?/= 8E 45": 3'209 40G0AIoT< :+;F<%$6 B@-(,F.
!)#7*&>12FM2 D1 CD!)#7ML
Unsupervised Machine Translation • 87=@16Statistical Machine Translation (SMT) Neural Machine
Translation (NMT))(95/&%$ ◦ .@.0:2?>! • -B"*< .@;3,A=@4+ ◦ Word translation without parallel data.[Alexis 2017], ◦ Learning bilingual word embeddings with (almost) no bilingual data [Artetxe 2017] • !#'5/ 87=@ NMT>!4+ ◦ UNSUPERVISED MACHINE TRANSLATION USING MONOLINGUAL CORPORA ONLY [Lample2018] ◦ Unsupervised statistical machine translation [Artetxe 2018]
Supervised Machine Translation NMT Back-translation !
#"BLEU http://deeplearning.hatenablog.com/entry/back_translation#f-726c04a7
!! • D8?8B;=/@[Alexis 2017] ◦ /@*;="%$#1: ◦ ;=B/@)3& A404 6
- 5.+=A'9C9 7> ◦ +=A( , +=2<EF
SMT https://www.nhk.or.jp/strl/publica/rd/rd168/pdf/P14-25.pdf
' 1. % $ 2. &! 3. SMT$
" 4. " refinement 5. NMT(#
&9 3+ • bi-gram embedding+A8: #6>$<[Artetxe 2018] • :
100=0/ softmax &952"* (e,f8: 4 :, τ1( ?.',%!7 ) ;- …@@
2<0K,A • 3N*6 5/2<0KPO • ex. “Sunday Telegraph”
→ “The Times of London” • =H. %'#& $"&MQ4 R(8-C WaveNet:1D+@9> IF !) 2<G@7JB; LS 7JE?/ T
Unsupervised SMT • Back-translation.CE/;> ◦ DF%"&*8L @3 DFB<+4DF%"&.C •
9H7Cycle GAN !#K65= ◦ -:02I ?HA M 1 : DF'! : ,G(#'$)'! : DF7J'!
+% • '$ SMT+% .0 .0 (), +% • SMT+%
.0!/1-*&# ()2"
NMT$ • "SMT$ %# NMT$ • % NMT#
: SMT%! : NMT%!
WMT2014 seq2seq
…