Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Back-Translation_Sampling_by_Targeting_Difficul...

Avatar for MARUYAMA MARUYAMA
February 27, 2019
160
0

 Back-Translation_Sampling_by_Targeting_Difficult_Words_in_Neural_Machine_Translation.pdf

Avatar for MARUYAMA

MARUYAMA

February 27, 2019

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
200
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180

Featured

See All Featured
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.8k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
0
310
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
210
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.3k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
1.2k
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
2
210
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.7k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.6k
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2.2k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k

Transcript

  1. #BDL5SBOTMBUJPO4BNQMJOHCZ5BSHFUJOH%J⒏DVMU 8PSETJO/FVSBM.BDIJOF5SBOTMBUJPO .BS[JFI'BEBFFBOE$ISJTUPG.PO[ &./-1 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣຋༁ͷ࣭ͷ޲্ʹޮՌతͳٯ຋༁ͷαϯϓϦϯάख๏ͱ͸ʁ ⾣8.5OFXTUSBOTMBUJPOUBTLͰϥϯμϜαϯϓϦϯάͷ ٯ຋༁ʹൺ΂ɺ#-&6͕ %F&O  &O%F ޲্ ⾣໨తݴޠଆͰ༧ଌ͢Δͷ͕೉͍͠୯ޠΛத৺ʹɺ ٖࣅσʔλΛੜ੒͢Δख๏ΛఏҊ

  3. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO

  6. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH

  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM

  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM

  9. ͸͡Ίʹ ⾣Ұൠతʹɺʮٯ຋༁ʹΑΔσʔλ֦ு͸ɺPWFSpUUJOH΍ ྲྀெੑͷ໰୊Λܰݮ͢ΔʯͱݴΘΕ͍ͯΔ ⾣ϙΠϯτ͸ɺʮͲͷΑ͏ͳσʔλΛ༻͍֦ͯுΛߦ͏͔ʯ

  10. ⾣ςετσʔλͱυϝΠϯ͕ྨࣅ͢ΔσʔλΛબ୒ͭͭ͠ ϞσϧΛֶशͤ͞Δ͜ͱͰੑೳΛվળ ؔ࿈ݚڀ ⾣ٯ຋༁ʹ͓͚ΔɺυϝΠϯʹج͍ͮͨσʔλબ୒͸ɺ ϥϯμϜαϯϓϦϯάͱൺ΂ͯେࠩͳ͠ WBOEFS8FFTFUBM 1IBNFUBM

  11. ⾣ٖࣅσʔλ௥Ճલޙʹ͓͚Δɺ༧ଌଛࣦͷมԽΛௐࠪ ٯ຋༁ͱτʔΫϯ༧ଌ "UUFOUJPOCBTFEFODPEFSEFDPEFSNPEFM ϥϯμϜαϯϓϦϯάʹΑΔٯ຋༁Ͱٙࣅσʔλੜ੒

  12. ٯ຋༁ͱτʔΫϯ༧ଌ ٖࣅσʔλ௥ՃʹΑΔ ༧ଌଛࣦͷ૿ݮ ໨తݴޠଆͷ୯ޠස౓ ର਺

  13. ٯ຋༁ͱτʔΫϯ༧ଌ ٖࣅσʔλ௥ՃʹΑΔ ༧ଌଛࣦͷݮগ͸ CBTFMJOFQSFEJDUJPOMPTT ͕ߴ͍୯ޠͰൃੜ͢Δ ʮ༧ଌ͕ࠔ೉ʯͳ΋ͷΛ ٙࣅσʔλʹՃ͑ͨํ͕ ޮՌతʁ

  14. ༧ଌࠔ೉ͳτʔΫϯʹجͮ͘αϯϓϦϯά ⾣ʮ༧ଌ͕ࠔ೉ʯͳ΋ͷΛͲͷΑ͏ʹαϯϓϦϯά͢Δ͔ʁ ස౓ͷᮢ஋ ༧ଌଛࣦͷฏۉͷᮢ஋ ༧ଌଛࣦͷඪ४ภࠩͷᮢ஋ 1SFEJDUJPOMPTTͷൺ཰ʹ߹ΘͤͯαϯϓϦϯά

  15. ༧ଌࠔ೉ͳτʔΫϯʹجͮ͘αϯϓϦϯά

  16. จ຺ʹجͮ͘αϯϓϦϯά ⾣ಉ͡τʔΫϯͰ΋ʮ༧ଌͷࠔ೉͞ʯ͸จ຺ʹΑͬͯҟͳΔ ⾣ྨࣅͨ͠จ຺Λ΋ͭ৔߹͸ɺͦͷτʔΫϯͷ༧ଌͷࠔ೉͞ ʹ͍ͭͯ΋ྨࣅ͍ͯ͠ΔͱԾఆ ⾣ʮ༧ଌͷࠔ೉͞ʯ ʮจ຺ͷྨࣅੑʯͰαϯϓϦϯά

  17. จ຺ʹجͮ͘αϯϓϦϯά ⾣lจ຺zͷఆٛ /FJHICPSJOHUPLFOT 50,&/4 /FJHICPSJOHTVCXPSEVOJUT 4803%4 

  18. จ຺ʹجͮ͘αϯϓϦϯά ⾣lྨࣅ౓zͷܭࢉํ๏ .BUDIJOHUIFMPDBMDPOUFYU ."5$) 8PSESFQSFTFOUBUJPOT &.#  7 ɾ จ຺಺ͷ֤τʔΫϯͷ୯ޠϕΫτϧͷฏۉ

  19. จ຺ʹجͮ͘αϯϓϦϯά

  20. ·ͱΊ ⾣຋༁ͷ࣭ͷ޲্ʹޮՌతͳٯ຋༁ͷαϯϓϦϯάख๏ͱ͸ʁ ⾣໨తݴޠଆͰ༧ଌ͢Δͷ͕೉͍͠୯ޠΛத৺ʹɺ ٖࣅσʔλΛੜ੒͢Δख๏ΛఏҊ ⾣8.5OFXTUSBOTMBUJPOUBTLͰϥϯμϜαϯϓϦϯάͷ ٯ຋༁ʹൺ΂ɺ#-&6͕ %F&O  &O%F ޲্

  21. ࢀߟจݙ <>/HPD2VBO1IBN +BO/JFIVFT 5IBOI-F)B &VOBI$IP .BUUIJBT4QFSCFS BOE "MFYBOEFS8BJCFM5IFLBSMTSVIFJOTUJUVUFPGUFDIOPMPHZTZTUFNTGPSUIFOFXT USBOTMBUJPOUBTLJOXNU*O1SPDFFEJOHTPGUIF4FDPOE$POGFSFODFPO.BDIJOF 5SBOTMBUJPO

    QBHFTr <>.BSMJFTWBOEFS8FFT "SJBOOB#JTB[[B BOE$ISJTUPG.PO[%ZOBNJDEBUB TFMFDUJPOGPSOFVSBMNBDIJOFUSBOTMBUJPO*O1SPDFFEJOHTPGUIF$POGFSFODFPO &NQJSJDBM.FUIPETJO/BUVSBM-BOHVBHF1SPDFTTJOH QBHFTr $PQFOIBHFO  %FONBSL"TTPDJBUJPOGPS$PNQVUBUJPOBM-JOHVJTUJDT