Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Understanding_Back-Translation_at_scale.pdf
Search
MARUYAMA
January 02, 2019
0
170
Understanding_Back-Translation_at_scale.pdf
MARUYAMA
January 02, 2019
Tweet
Share
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
180
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
190
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
170
20191028_literature-review.pdf
tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
170
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
160
Featured
See All Featured
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
15k
Why Our Code Smells
bkeepers
PRO
339
57k
jQuery: Nuts, Bolts and Bling
dougneiner
64
7.9k
Build The Right Thing And Hit Your Dates
maggiecrowley
37
2.9k
Being A Developer After 40
akosma
91
590k
Intergalactic Javascript Robots from Outer Space
tanoku
273
27k
The Art of Programming - Codeland 2020
erikaheidi
56
14k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
132
19k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.2k
Balancing Empowerment & Direction
lara
4
680
Transcript
-JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB
֓ཁ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣ٯ༁ͷࡍʹɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU
⾣ػց༁ͷੑೳɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍߹ɺͲ͏͖͔͢ ⾣େنͳ୯ݴޠίʔύεΛٯ༁ͯ͠ɺσʔλΛ֦ு ͡Ίʹ
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB
(FOFSBUJPO
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM
5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE
NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU
'PSXBSE NPEFM
༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :
ٖࣅσʔλͷੜํ๏ ⾣CFBNTFBSDIHSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗͷ࠷େࣄޙ֬ ."1 ʹͨ͠ख๏ ⾣."1ਪఆΛٯ༁ʹ༻͍Δͱɺਅͷσʔλͱҟͳͬͨ ଟ༷ੑͷ͍ٖࣅσʔλʹͭͳ͕Δ
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ্֬Ґ୯ޠΛબɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ ֬Ͱɺग़ྗ୯ޠΛআ
֬Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ Ұ༷ʹैͬͯɺ୯ޠΛೖΕସ͑Δ
σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU . ٖࣅσʔλ ɾCFBN HSFFEZΑΓ TBNQMJOH CFBN
OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU . ٖࣅσʔλ . ˠCJUFYUVQTBNQMFSBUJP
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾHSFFEZ CFBNٖࣅσʔλͷൺʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTFଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺͷӨڹ͕গͳ͍
·ͱΊ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣CFBN HSFFEZΑΓɺTBNQMJOHOPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU