Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Understanding_Back-Translation_at_scale.pdf
Search
MARUYAMA
January 02, 2019
0
170
Understanding_Back-Translation_at_scale.pdf
MARUYAMA
January 02, 2019
Tweet
Share
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
170
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
180
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
170
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
160
20191028_literature-review.pdf
tmaru0204
0
140
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
130
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
160
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
150
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
150
Featured
See All Featured
Git: the NoSQL Database
bkeepers
PRO
430
65k
How to Think Like a Performance Engineer
csswizardry
24
1.7k
StorybookのUI Testing Handbookを読んだ
zakiyama
30
5.8k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Balancing Empowerment & Direction
lara
1
370
Typedesign – Prime Four
hannesfritz
42
2.7k
GitHub's CSS Performance
jonrohan
1031
460k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Testing 201, or: Great Expectations
jmmastey
42
7.5k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
331
22k
Stop Working from a Prison Cell
hatefulcrawdad
270
20k
Transcript
-JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB
֓ཁ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣ٯ༁ͷࡍʹɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU
⾣ػց༁ͷੑೳɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍߹ɺͲ͏͖͔͢ ⾣େنͳ୯ݴޠίʔύεΛٯ༁ͯ͠ɺσʔλΛ֦ு ͡Ίʹ
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB
(FOFSBUJPO
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM
5SBJOJOH
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE
NPEFM
ٯ༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU
'PSXBSE NPEFM
༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :
ٖࣅσʔλͷੜํ๏ ⾣CFBNTFBSDIHSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗͷ࠷େࣄޙ֬ ."1 ʹͨ͠ख๏ ⾣."1ਪఆΛٯ༁ʹ༻͍Δͱɺਅͷσʔλͱҟͳͬͨ ଟ༷ੑͷ͍ٖࣅσʔλʹͭͳ͕Δ
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ্֬Ґ୯ޠΛબɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά
ٖࣅσʔλͷੜํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ ֬Ͱɺग़ྗ୯ޠΛআ
֬Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ Ұ༷ʹैͬͯɺ୯ޠΛೖΕସ͑Δ
σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU . ٖࣅσʔλ ɾCFBN HSFFEZΑΓ TBNQMJOH CFBN
OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ
࣮ݧ݁Ռ ⾣ٯ༁ʹΑΔσʔλ֦ுͷޮՌ
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ͞Εͨ σʔλTBNQMJOH OPJTFΑΓ؆୯
࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU . ٖࣅσʔλ . ˠCJUFYUVQTBNQMFSBUJP
࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ ɾHSFFEZ CFBNٖࣅσʔλͷൺʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTFଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺͷӨڹ͕গͳ͍
·ͱΊ ⾣ٯ༁ΛͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ ⾣CFBN HSFFEZΑΓɺTBNQMJOHOPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ #-&6QU