Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA MARUYAMA
January 02, 2019
170
0

 Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA

MARUYAMA

January 02, 2019

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
200
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180

Featured

See All Featured
Believing is Seeing
Avatar for Spiro Bolos oripsolob
1
150
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
870
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1033
470k
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
3
1.1k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
570
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
3
430
Kristin Tynski - Automating Marketing Tasks With AI
Avatar for Tech SEO Connect techseoconnect
PRO
0
280
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
350
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
23k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
210
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.1k

Transcript

  1. -JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr
 /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣ٯ຋༁ͷࡍʹ͸ɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU

  3. ⾣ػց຋༁ͷੑೳ͸ɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍৔߹ɺͲ͏͢΂͖͔ ⾣େن໛ͳ୯ݴޠίʔύεΛٯ຋༁ͯ͠ɺσʔλΛ֦ு ͸͡Ίʹ

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  9. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  10. ຋༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :

  11. ٖࣅσʔλͷੜ੒ํ๏ ⾣CFBNTFBSDI΍HSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗ෼෍ͷ࠷େࣄޙ֬཰ ."1 ʹ஫໨ͨ͠ख๏ ⾣."1ਪఆΛٯ຋༁ʹ༻͍Δͱɺਅͷσʔλ෼෍ͱ͸ҟͳͬͨ ଟ༷ੑͷ௿͍ٖࣅσʔλʹͭͳ͕Δ

  12. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗ෼෍ʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ֬཰্Ґ୯ޠΛબ୒ɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά

  13. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ   ֬཰Ͱɺग़ྗ୯ޠΛ࡟আ  

    ֬཰Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ׵   Ұ༷෼෍ʹैͬͯɺ୯ޠΛೖΕସ͑Δ

  14. σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU

  15. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU .  ٖࣅσʔλ ɾCFBN HSFFEZΑΓ΋ TBNQMJOH CFBN

    OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ

  16. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ

  17. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  18. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  19. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ

  20. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU .  ٖࣅσʔλ .  ˠCJUFYUVQTBNQMFSBUJP

  21. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾHSFFEZ CFBN͸ٖࣅσʔλͷൺ཰ʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTF͸ଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺ཰ͷӨڹ͕গͳ͍

  22. ·ͱΊ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣CFBN HSFFEZΑΓ΋ɺTBNQMJOH΍OPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU