Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA MARUYAMA
January 02, 2019
0
170

 Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA

MARUYAMA

January 02, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
180
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
190
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
160
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
160
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
150
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150

Featured

See All Featured
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
23
1.4k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.8k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
358
30k
Code Review Best Practice
Avatar for Trisha Gee trishagee
70
19k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
33
2.4k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.1k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k

Transcript

  1. -JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr
 /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣ٯ຋༁ͷࡍʹ͸ɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU

  3. ⾣ػց຋༁ͷੑೳ͸ɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍৔߹ɺͲ͏͢΂͖͔ ⾣େن໛ͳ୯ݴޠίʔύεΛٯ຋༁ͯ͠ɺσʔλΛ֦ு ͸͡Ίʹ

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  9. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  10. ຋༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :

  11. ٖࣅσʔλͷੜ੒ํ๏ ⾣CFBNTFBSDI΍HSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗ෼෍ͷ࠷େࣄޙ֬཰ ."1 ʹ஫໨ͨ͠ख๏ ⾣."1ਪఆΛٯ຋༁ʹ༻͍Δͱɺਅͷσʔλ෼෍ͱ͸ҟͳͬͨ ଟ༷ੑͷ௿͍ٖࣅσʔλʹͭͳ͕Δ

  12. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗ෼෍ʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ֬཰্Ґ୯ޠΛબ୒ɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά

  13. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ   ֬཰Ͱɺग़ྗ୯ޠΛ࡟আ  

    ֬཰Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ׵   Ұ༷෼෍ʹैͬͯɺ୯ޠΛೖΕସ͑Δ

  14. σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU

  15. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU .  ٖࣅσʔλ ɾCFBN HSFFEZΑΓ΋ TBNQMJOH CFBN

    OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ

  16. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ

  17. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  18. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  19. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ

  20. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU .  ٖࣅσʔλ .  ˠCJUFYUVQTBNQMFSBUJP

  21. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾHSFFEZ CFBN͸ٖࣅσʔλͷൺ཰ʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTF͸ଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺ཰ͷӨڹ͕গͳ͍

  22. ·ͱΊ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣CFBN HSFFEZΑΓ΋ɺTBNQMJOH΍OPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU