Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Understanding_Back-Translation_at_scale.pdf
Search
MARUYAMA
January 02, 2019
0
170
Understanding_Back-Translation_at_scale.pdf
MARUYAMA
January 02, 2019
Tweet
Share
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
170
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
180
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
170
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
160
20191028_literature-review.pdf
tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
130
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
160
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
150
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
150
Featured
See All Featured
Building Applications with DynamoDB
mza
95
6.5k
Six Lessons from altMBA
skipperchong
28
3.9k
It's Worth the Effort
3n
185
28k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.1k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Side Projects
sachag
455
42k
For a Future-Friendly Web
brad_frost
179
9.8k
Large-scale JavaScript Application Architecture
addyosmani
512
110k
BBQ
matthewcrist
89
9.7k
Transcript
-JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB
֓ཁ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣ٯ༁ͷࡍʹɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU
⾣ػց༁ͷੑೳɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍߹ɺͲ͏͖͔͢ ⾣େنͳ୯ݴޠίʔύεΛٯ༁ͯ͠ɺσʔλΛ֦ு ͡Ίʹ
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB
(FOFSBUJPO
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM
5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE
NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU
'PSXBSE NPEFM
༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :
ٖࣅσʔλͷੜํ๏ ⾣CFBNTFBSDIHSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗͷ࠷େࣄޙ֬ ."1 ʹͨ͠ख๏ ⾣."1ਪఆΛٯ༁ʹ༻͍Δͱɺਅͷσʔλͱҟͳͬͨ ଟ༷ੑͷ͍ٖࣅσʔλʹͭͳ͕Δ
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ্֬Ґ୯ޠΛબɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ ֬Ͱɺग़ྗ୯ޠΛআ
֬Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ Ұ༷ʹैͬͯɺ୯ޠΛೖΕସ͑Δ
σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU . ٖࣅσʔλ ɾCFBN HSFFEZΑΓ TBNQMJOH CFBN
OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU . ٖࣅσʔλ . ˠCJUFYUVQTBNQMFSBUJP
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾHSFFEZ CFBNٖࣅσʔλͷൺʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTFଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺͷӨڹ͕গͳ͍
·ͱΊ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣CFBN HSFFEZΑΓɺTBNQMJOHOPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU