Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA MARUYAMA
January 02, 2019
0
170

 Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA

MARUYAMA

January 02, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
170
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
180
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
170
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
160
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
130
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
160
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
150
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150

Featured

See All Featured
Building Applications with DynamoDB
Avatar for Matt Wood mza
95
6.5k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
28
3.9k
It's Worth the Effort
Avatar for 3n 3n
185
28k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
30
2.1k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
53
2.9k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
26k
Side Projects
Avatar for Sacha Greif sachag
455
42k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
179
9.8k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
BBQ
Avatar for Matthew Crist matthewcrist
89
9.7k

Transcript

  1. -JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr
 /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣ٯ຋༁ͷࡍʹ͸ɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU

  3. ⾣ػց຋༁ͷੑೳ͸ɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍৔߹ɺͲ͏͢΂͖͔ ⾣େن໛ͳ୯ݴޠίʔύεΛٯ຋༁ͯ͠ɺσʔλΛ֦ு ͸͡Ίʹ

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  9. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  10. ຋༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :

  11. ٖࣅσʔλͷੜ੒ํ๏ ⾣CFBNTFBSDI΍HSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗ෼෍ͷ࠷େࣄޙ֬཰ ."1 ʹ஫໨ͨ͠ख๏ ⾣."1ਪఆΛٯ຋༁ʹ༻͍Δͱɺਅͷσʔλ෼෍ͱ͸ҟͳͬͨ ଟ༷ੑͷ௿͍ٖࣅσʔλʹͭͳ͕Δ

  12. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗ෼෍ʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ֬཰্Ґ୯ޠΛબ୒ɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά

  13. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ   ֬཰Ͱɺग़ྗ୯ޠΛ࡟আ  

    ֬཰Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ׵   Ұ༷෼෍ʹैͬͯɺ୯ޠΛೖΕସ͑Δ

  14. σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU

  15. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU .  ٖࣅσʔλ ɾCFBN HSFFEZΑΓ΋ TBNQMJOH CFBN

    OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ

  16. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ

  17. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  18. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  19. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ

  20. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU .  ٖࣅσʔλ .  ˠCJUFYUVQTBNQMFSBUJP

  21. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾHSFFEZ CFBN͸ٖࣅσʔλͷൺ཰ʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTF͸ଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺ཰ͷӨڹ͕গͳ͍

  22. ·ͱΊ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣CFBN HSFFEZΑΓ΋ɺTBNQMJOH΍OPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU