Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA MARUYAMA
January 02, 2019
0
170

 Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA

MARUYAMA

January 02, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
190
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
190
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180

Featured

See All Featured
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
0
48k
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.9k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
70
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
64
53k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
470
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
270
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
KATA
Avatar for Megan Lloyd mclloyd
PRO
35
15k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
2.4k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.4k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
1.9k
How to Grow Your eCommerce with AI & Automation
Avatar for Katarina Dahlin katarinadahlin
PRO
1
140

Transcript

  1. -JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr
 /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣ٯ຋༁ͷࡍʹ͸ɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU

  3. ⾣ػց຋༁ͷੑೳ͸ɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍৔߹ɺͲ͏͢΂͖͔ ⾣େن໛ͳ୯ݴޠίʔύεΛٯ຋༁ͯ͠ɺσʔλΛ֦ு ͸͡Ίʹ

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  9. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  10. ຋༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :

  11. ٖࣅσʔλͷੜ੒ํ๏ ⾣CFBNTFBSDI΍HSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗ෼෍ͷ࠷େࣄޙ֬཰ ."1 ʹ஫໨ͨ͠ख๏ ⾣."1ਪఆΛٯ຋༁ʹ༻͍Δͱɺਅͷσʔλ෼෍ͱ͸ҟͳͬͨ ଟ༷ੑͷ௿͍ٖࣅσʔλʹͭͳ͕Δ

  12. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗ෼෍ʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ֬཰্Ґ୯ޠΛબ୒ɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά

  13. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ   ֬཰Ͱɺग़ྗ୯ޠΛ࡟আ  

    ֬཰Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ׵   Ұ༷෼෍ʹैͬͯɺ୯ޠΛೖΕସ͑Δ

  14. σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU

  15. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU .  ٖࣅσʔλ ɾCFBN HSFFEZΑΓ΋ TBNQMJOH CFBN

    OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ

  16. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ

  17. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  18. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  19. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ

  20. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU .  ٖࣅσʔλ .  ˠCJUFYUVQTBNQMFSBUJP

  21. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾHSFFEZ CFBN͸ٖࣅσʔλͷൺ཰ʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTF͸ଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺ཰ͷӨڹ͕গͳ͍

  22. ·ͱΊ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣CFBN HSFFEZΑΓ΋ɺTBNQMJOH΍OPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU