Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Understanding_Back-Translation_at_scale.pdf
Search
MARUYAMA
January 02, 2019
0
170
Understanding_Back-Translation_at_scale.pdf
MARUYAMA
January 02, 2019
Tweet
Share
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
180
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
190
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
170
20191028_literature-review.pdf
tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
170
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
160
Featured
See All Featured
Rebuilding a faster, lazier Slack
samanthasiow
84
9.2k
Thoughts on Productivity
jonyablonski
70
4.9k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
Building Flexible Design Systems
yeseniaperezcruz
329
39k
Designing for humans not robots
tammielis
254
26k
Leading Effective Engineering Teams in the AI Era
addyosmani
3
340
Building Applications with DynamoDB
mza
96
6.7k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
970
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Faster Mobile Websites
deanohume
310
31k
Fantastic passwords and where to find them - at NoRuKo
philnash
52
3.4k
Transcript
-JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB
֓ཁ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣ٯ༁ͷࡍʹɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU
⾣ػց༁ͷੑೳɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍߹ɺͲ͏͖͔͢ ⾣େنͳ୯ݴޠίʔύεΛٯ༁ͯ͠ɺσʔλΛ֦ு ͡Ίʹ
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB
(FOFSBUJPO
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM
5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE
NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU
'PSXBSE NPEFM
༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :
ٖࣅσʔλͷੜํ๏ ⾣CFBNTFBSDIHSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗͷ࠷େࣄޙ֬ ."1 ʹͨ͠ख๏ ⾣."1ਪఆΛٯ༁ʹ༻͍Δͱɺਅͷσʔλͱҟͳͬͨ ଟ༷ੑͷ͍ٖࣅσʔλʹͭͳ͕Δ
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ্֬Ґ୯ޠΛબɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ ֬Ͱɺग़ྗ୯ޠΛআ
֬Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ Ұ༷ʹैͬͯɺ୯ޠΛೖΕସ͑Δ
σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU . ٖࣅσʔλ ɾCFBN HSFFEZΑΓ TBNQMJOH CFBN
OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU . ٖࣅσʔλ . ˠCJUFYUVQTBNQMFSBUJP
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾHSFFEZ CFBNٖࣅσʔλͷൺʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTFଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺͷӨڹ͕গͳ͍
·ͱΊ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣CFBN HSFFEZΑΓɺTBNQMJOHOPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU