Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA MARUYAMA
January 02, 2019
170
0

 Understanding_Back-Translation_at_scale.pdf

Avatar for MARUYAMA

MARUYAMA

January 02, 2019

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
200
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
170
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180

Featured

See All Featured
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
430
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.9k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
650
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
410
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
A Soul's Torment
Avatar for Nat Ma seathinner
6
3.4k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
22k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k

Transcript

  1. -JUFSBUVSFSFWJFX 6OEFSTUBOEJOH#BDL5SBOTMBUJPOBU4DBMF 4FSHFZ&EVOPW .ZMF0UU .JDIBFM"VMJ %BWJE(SBOHJFS &./-1 QBHFTr
 /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣ٯ຋༁ͷࡍʹ͸ɺग़ྗଆʹଟ༷ੑΛ࣋ͨͤΔ͜ͱ͕ॏཁ ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU

  3. ⾣ػց຋༁ͷੑೳ͸ɺσʔλαΠζʹେ͖͘Өڹ͞ΕΔ ⾣ύϥϨϧίʔύε͕গͳ͍৔߹ɺͲ͏͢΂͖͔ ⾣େن໛ͳ୯ݴޠίʔύεΛٯ຋༁ͯ͠ɺσʔλΛ֦ு ͸͡Ίʹ

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  9. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  10. ຋༁Ϟσϧ ⾣5SBOTGPSNFSΛར༻ &ODPEFS %FDPEFS %FDPEFS %FDPEFS 4PVSDFTFOUFODF #04 : :

  11. ٖࣅσʔλͷੜ੒ํ๏ ⾣CFBNTFBSDI΍HSFFEZTFBSDIΛར༻͞Ε͍ͯͨ ⾣Ϟσϧͷग़ྗ෼෍ͷ࠷େࣄޙ֬཰ ."1 ʹ஫໨ͨ͠ख๏ ⾣."1ਪఆΛٯ຋༁ʹ༻͍Δͱɺਅͷσʔλ෼෍ͱ͸ҟͳͬͨ ଟ༷ੑͷ௿͍ٖࣅσʔλʹͭͳ͕Δ

  12. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ TBNQMJOH Ϟσϧͷग़ྗ෼෍ʹैͬͯɺαϯϓϦϯά UPQ ग़ྗ֬཰্Ґ୯ޠΛબ୒ɾ࠶ਖ਼نԽ͠ɺαϯϓϦϯά

  13. ٖࣅσʔλͷੜ੒ํ๏ ⾣ٖࣅσʔλʹଟ༷ੑΛ࣋ͨͤΔͨΊʹɺ࣍ͷख๏ΛఏҊ #FBN OPJTF CFBNTFBSDIʹՃ͑ɺ࣍ͷछྨͷϊΠζΛՃ͑Δ   ֬཰Ͱɺग़ྗ୯ޠΛ࡟আ  

    ֬཰Ͱɺग़ྗ୯ޠΛ#-"/,ʹஔ׵   Ұ༷෼෍ʹैͬͯɺ୯ޠΛೖΕସ͑Δ

  14. σʔληοτ ⾣1BSB$SBXMDPSQVT &O%F .TFOUFODFQBJST ⾣OFXTDSBXMEBUB %F .TFOUFODFT ⾣OFXTUFTU

  15. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ ɾCJUFYU .  ٖࣅσʔλ ɾCFBN HSFFEZΑΓ΋ TBNQMJOH CFBN

    OPJTFͷํ͕ ޮՌతͳٖࣅσʔλͰ͋Δ

  16. ࣮ݧ݁Ռ ⾣ٯ຋༁ʹΑΔσʔλ֦ுͷޮՌ

  17. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  18. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ ɾHSFFEZ CFBNͷσʔλ͸ τϨʔχϯάʹద͍ͯ͠ͳ͍ ɾHSFFEZ CFBNʹΑͬͯੜ੒͞Εͨ σʔλ͸TBNQMJOH OPJTFΑΓ΋؆୯

  19. ࣮ݧ݁Ռ ⾣ͳͥϊΠζΛՃ͑ͨํ͕ޮՌతͳͷ͔ʁ

  20. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾCJUFYU.TFOUFODFQBJST ɾCJUFYU .  ٖࣅσʔλ .  ˠCJUFYUVQTBNQMFSBUJP

  21. ࣮ݧ݁Ռ ⾣CJUFYUͱٖࣅσʔλͷൺ཰ ɾHSFFEZ CFBN͸ٖࣅσʔλͷൺ཰ʹ Өڹ͞ΕΔ ˠσʔλͷྔͰଟ༷ੑΛΧόʔ ɾTBNQMJOH OPJTF͸ଟ༷ੑ͕͋ΔͨΊ ٖࣅσʔλൺ཰ͷӨڹ͕গͳ͍

  22. ·ͱΊ ⾣ٯ຋༁Λ࢖ͬͯɺٖࣅతͳύϥϨϧίʔύεΛੜ੒ ⾣CFBN HSFFEZΑΓ΋ɺTBNQMJOH΍OPJTFͷΑ͏ʹ σʔλʹଟ༷ੑΛٖ࣋ͨͤͨࣅσʔλͷํ͕ޮՌత ⾣8.5Ͱ4UBUFPGUIFBSUΛୡ੒ #-&6QU