Back-Translation_Sampling_by_Targeting_Difficult_Words_in_Neural_Machine_Translation.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
February 27, 2019
62

 Back-Translation_Sampling_by_Targeting_Difficult_Words_in_Neural_Machine_Translation.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

February 27, 2019
Tweet

Transcript

  1. #BDL5SBOTMBUJPO4BNQMJOHCZ5BSHFUJOH%J⒏DVMU 8PSETJO/FVSBM.BDIJOF5SBOTMBUJPO .BS[JFI'BEBFFBOE$ISJTUPG.PO[ &./-1 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. ֓ཁ ⾣຋༁ͷ࣭ͷ޲্ʹޮՌతͳٯ຋༁ͷαϯϓϦϯάख๏ͱ͸ʁ ⾣8.5OFXTUSBOTMBUJPOUBTLͰϥϯμϜαϯϓϦϯάͷ ٯ຋༁ʹൺ΂ɺ#-&6͕ %F&O  &O%F ޲্ ⾣໨తݴޠଆͰ༧ଌ͢Δͷ͕೉͍͠୯ޠΛத৺ʹɺ ٖࣅσʔλΛੜ੒͢Δख๏ΛఏҊ

  3. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 5SBJOJOH

  4. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM

  5. ٯ຋༁ʹΑΔσʔλ֦ு 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT #BDLXBSE NPEFM 4ZOUIFUJDEBUB

    (FOFSBUJPO
  6. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE NPEFM

    5SBJOJOH
  7. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 'PSXBSE

    NPEFM
  8. ٯ຋༁ʹΑΔσʔλ֦ு 4ZOUIFUJDEBUB 5FTUEBUB 4PVSDFTJEF 5BSHFUTJEF 1BSBMMFMDPSQVT 1BSBMMFMDPSQVT .POPMJOHVBM $PSQVT 3FTVMU

    'PSXBSE NPEFM
  9. ͸͡Ίʹ ⾣Ұൠతʹɺʮٯ຋༁ʹΑΔσʔλ֦ு͸ɺPWFSpUUJOH΍ ྲྀெੑͷ໰୊Λܰݮ͢ΔʯͱݴΘΕ͍ͯΔ ⾣ϙΠϯτ͸ɺʮͲͷΑ͏ͳσʔλΛ༻͍֦ͯுΛߦ͏͔ʯ

  10. ⾣ςετσʔλͱυϝΠϯ͕ྨࣅ͢ΔσʔλΛબ୒ͭͭ͠ ϞσϧΛֶशͤ͞Δ͜ͱͰੑೳΛվળ ؔ࿈ݚڀ ⾣ٯ຋༁ʹ͓͚ΔɺυϝΠϯʹج͍ͮͨσʔλબ୒͸ɺ ϥϯμϜαϯϓϦϯάͱൺ΂ͯେࠩͳ͠ WBOEFS8FFTFUBM 1IBNFUBM

  11. ⾣ٖࣅσʔλ௥Ճલޙʹ͓͚Δɺ༧ଌଛࣦͷมԽΛௐࠪ ٯ຋༁ͱτʔΫϯ༧ଌ "UUFOUJPOCBTFEFODPEFSEFDPEFSNPEFM ϥϯμϜαϯϓϦϯάʹΑΔٯ຋༁Ͱٙࣅσʔλੜ੒

  12. ٯ຋༁ͱτʔΫϯ༧ଌ ٖࣅσʔλ௥ՃʹΑΔ ༧ଌଛࣦͷ૿ݮ ໨తݴޠଆͷ୯ޠස౓ ର਺

  13. ٯ຋༁ͱτʔΫϯ༧ଌ ٖࣅσʔλ௥ՃʹΑΔ ༧ଌଛࣦͷݮগ͸ CBTFMJOFQSFEJDUJPOMPTT ͕ߴ͍୯ޠͰൃੜ͢Δ ʮ༧ଌ͕ࠔ೉ʯͳ΋ͷΛ ٙࣅσʔλʹՃ͑ͨํ͕ ޮՌతʁ

  14. ༧ଌࠔ೉ͳτʔΫϯʹجͮ͘αϯϓϦϯά ⾣ʮ༧ଌ͕ࠔ೉ʯͳ΋ͷΛͲͷΑ͏ʹαϯϓϦϯά͢Δ͔ʁ ස౓ͷᮢ஋ ༧ଌଛࣦͷฏۉͷᮢ஋ ༧ଌଛࣦͷඪ४ภࠩͷᮢ஋ 1SFEJDUJPOMPTTͷൺ཰ʹ߹ΘͤͯαϯϓϦϯά

  15. ༧ଌࠔ೉ͳτʔΫϯʹجͮ͘αϯϓϦϯά

  16. จ຺ʹجͮ͘αϯϓϦϯά ⾣ಉ͡τʔΫϯͰ΋ʮ༧ଌͷࠔ೉͞ʯ͸จ຺ʹΑͬͯҟͳΔ ⾣ྨࣅͨ͠จ຺Λ΋ͭ৔߹͸ɺͦͷτʔΫϯͷ༧ଌͷࠔ೉͞ ʹ͍ͭͯ΋ྨࣅ͍ͯ͠ΔͱԾఆ ⾣ʮ༧ଌͷࠔ೉͞ʯ ʮจ຺ͷྨࣅੑʯͰαϯϓϦϯά

  17. จ຺ʹجͮ͘αϯϓϦϯά ⾣lจ຺zͷఆٛ /FJHICPSJOHUPLFOT 50,&/4 /FJHICPSJOHTVCXPSEVOJUT 4803%4 

  18. จ຺ʹجͮ͘αϯϓϦϯά ⾣lྨࣅ౓zͷܭࢉํ๏ .BUDIJOHUIFMPDBMDPOUFYU ."5$) 8PSESFQSFTFOUBUJPOT &.#  7 ɾ จ຺಺ͷ֤τʔΫϯͷ୯ޠϕΫτϧͷฏۉ

  19. จ຺ʹجͮ͘αϯϓϦϯά

  20. ·ͱΊ ⾣຋༁ͷ࣭ͷ޲্ʹޮՌతͳٯ຋༁ͷαϯϓϦϯάख๏ͱ͸ʁ ⾣໨తݴޠଆͰ༧ଌ͢Δͷ͕೉͍͠୯ޠΛத৺ʹɺ ٖࣅσʔλΛੜ੒͢Δख๏ΛఏҊ ⾣8.5OFXTUSBOTMBUJPOUBTLͰϥϯμϜαϯϓϦϯάͷ ٯ຋༁ʹൺ΂ɺ#-&6͕ %F&O  &O%F ޲্

  21. ࢀߟจݙ <>/HPD2VBO1IBN +BO/JFIVFT 5IBOI-F)B &VOBI$IP .BUUIJBT4QFSCFS BOE "MFYBOEFS8BJCFM5IFLBSMTSVIFJOTUJUVUFPGUFDIOPMPHZTZTUFNTGPSUIFOFXT USBOTMBUJPOUBTLJOXNU*O1SPDFFEJOHTPGUIF4FDPOE$POGFSFODFPO.BDIJOF 5SBOTMBUJPO

    QBHFTr <>.BSMJFTWBOEFS8FFT "SJBOOB#JTB[[B BOE$ISJTUPG.PO[%ZOBNJDEBUB TFMFDUJPOGPSOFVSBMNBDIJOFUSBOTMBUJPO*O1SPDFFEJOHTPGUIF$POGFSFODFPO &NQJSJDBM.FUIPETJO/BUVSBM-BOHVBHF1SPDFTTJOH QBHFTr $PQFOIBHFO  %FONBSL"TTPDJBUJPOGPS$PNQVUBUJPOBM-JOHVJTUJDT