Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
September 22, 2019
36

 Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

September 22, 2019
Tweet

Transcript

  1. )JOU#BTFE5SBJOJOHGPS/PO"VUPSFHSFTTJWF .BDIJOF5SBOTMBUJPO -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. 1BQFS ɾ&./-1*+$/-1 ɾIUUQTBSYJWPSHBCT

  3. "CTUSBDU ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ"VUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO "35 ʹൺ΂ͯʜ ਪ࿦࣌ͷܭࢉ࣌ؒˣ

    ຋༁ͷ඼࣭ˣ
  4. *OUSPEVDUJPO ⾣"35WT/"35 ɾ"VUPSFHSFTTJWFUSBOTMBUJPO "35 ɾ/POBVUPSFHSFTTJWFUSBOTMBUJPO /"35 "35 /"35 ݪݴޠଆจͱ໨తݴޠଆจͷฏۉจ௕ࠩ ෳ਺ͷग़ྗީิΛಘΔͨΊͷ෯

    ͜͜Ͱ͸ʜ
  5. *OUSPEVDUJPO ⾣"35ͱ/"35ͷҧ͍Λௐࠪ ɾ/"35͕ࢧ཭໓྾ͳग़ྗΛ͍ͯ͠ΔҐஔͰ͸ɺӅΕঢ়ଶͷྨࣅ౓͕ ඇৗʹߴ͘ͳΔ ɾ/"35ͷ஫ऍ෼෍͸ɺ"35ΑΓ΋ᐆດੑΛؚΉ ⾣্هͷௐࠪ݁ՌΛ΋ͱʹ/"35NPEFMΛվળ

  6. 0CTFSWBUJPO ⾣$PTJOFTJNJMBSJUJFTCFUXFFOEFDPEFSIJEEFOTUBUFT /"35Ͱ͸ɺӅΕঢ়ଶͷ ྨࣅ౓͕ඇৗʹߴ͘ɺ ಉ͡τʔΫϯΛ ग़ྗ͢Δ܏޲ʹ͋Δ

  7. 0CTFSWBUJPO ⾣"UUFOUJPOEJTUSJCVUJPO "35Ͱ͸ɺશମΛΧόʔ Ͱ͖͍ͯΔͷʹର͠ɺ /"35Ͱ͸ɺzGBSNz౳ ܽམ͍ͯ͠Δ

  8. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ"35 UFBDIFS Λར༻ͭͭ͠ɺ/"35 TUVEFOU Λֶश ɾ/"35ͱ"35ͷӅΕঢ়ଶ ஫ऍ෼෍ͷࠩ෼Λଛࣦؔ਺ʹ௥Ճ )JOUTGSPNXPSEBMJHONFOU

    )JOUTGSPNIJEEFOTUBUFT /FHBUJWFMPHMJLFMJIPPE
  9. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNIJEEFOTUBUFT EFDPEFSͷl૚ t൪໨ͷӅΕঢ়ଶ  USUFBDIFS TUTUVEFOU U൪໨ͱU ൪໨ͷӅΕঢ়ଶ

    ͷྨࣅ౓͕ɺ ɹɾUFBDIFSଆͰ௿͘  ɹɾTUVEFOUଆͰߴ͍ ৔߹ʹϖφϧςΟΛ༩͑Δ
  10. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNXPSEBMJHONFOU l૚ hϔου, t൪໨ͷ஫ऍ෼෍  USUFBDIFS TUTUVEFOU UFBDIFSͱTUVEFOUؒͷ

    ஫ऍ෼෍ͷࠩ ,-EJWFSHFODF
  11. &YQFSJNFOUT

  12. &YQFSJNFOUT ⾣"CMBUJPOTUVEJFT

  13. $PODMVTJPO ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ໨ඪ຋༁ͷ඼࣭Λҡ࣋ͭͭ͠ɺਪ࿦࣌ͷܭࢉ࣌ؒΛߴ଎Խ

  14. None
  15. None