Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hint-Based_Training_for_Non-Autoregressive_Mach...

MARUYAMA
September 22, 2019
0
120

 Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf

MARUYAMA

September 22, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
tmaru0204
0
150
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
170
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
160
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
140
20191028_literature-review.pdf
tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
150
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
130
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
130
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
tmaru0204
0
180

Featured

See All Featured
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
129
19k
Into the Great Unknown - MozCon
thekraken
35
1.6k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
29k
Producing Creativity
orderedlist
PRO
344
40k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Site-Speed That Sticks
csswizardry
4
420
RailsConf 2023
tenderlove
29
1k
Practical Orchestrator
shlominoach
186
10k
Building Flexible Design Systems
yeseniaperezcruz
328
38k
Building Applications with DynamoDB
mza
93
6.2k
Building Adaptive Systems
keathley
40
2.4k

Transcript

  1. )JOU#BTFE5SBJOJOHGPS/PO"VUPSFHSFTTJWF .BDIJOF5SBOTMBUJPO -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. 1BQFS ɾ&./-1*+$/-1 ɾIUUQTBSYJWPSHBCT

  3. "CTUSBDU ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ"VUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO "35 ʹൺ΂ͯʜ ਪ࿦࣌ͷܭࢉ࣌ؒˣ

    ຋༁ͷ඼࣭ˣ

  4. *OUSPEVDUJPO ⾣"35WT/"35 ɾ"VUPSFHSFTTJWFUSBOTMBUJPO "35 ɾ/POBVUPSFHSFTTJWFUSBOTMBUJPO /"35 "35 /"35 ݪݴޠଆจͱ໨తݴޠଆจͷฏۉจ௕ࠩ ෳ਺ͷग़ྗީิΛಘΔͨΊͷ෯

    ͜͜Ͱ͸ʜ

  5. *OUSPEVDUJPO ⾣"35ͱ/"35ͷҧ͍Λௐࠪ ɾ/"35͕ࢧ཭໓྾ͳग़ྗΛ͍ͯ͠ΔҐஔͰ͸ɺӅΕঢ়ଶͷྨࣅ౓͕ ඇৗʹߴ͘ͳΔ ɾ/"35ͷ஫ऍ෼෍͸ɺ"35ΑΓ΋ᐆດੑΛؚΉ ⾣্هͷௐࠪ݁ՌΛ΋ͱʹ/"35NPEFMΛվળ

  6. 0CTFSWBUJPO ⾣$PTJOFTJNJMBSJUJFTCFUXFFOEFDPEFSIJEEFOTUBUFT /"35Ͱ͸ɺӅΕঢ়ଶͷ ྨࣅ౓͕ඇৗʹߴ͘ɺ ಉ͡τʔΫϯΛ ग़ྗ͢Δ܏޲ʹ͋Δ

  7. 0CTFSWBUJPO ⾣"UUFOUJPOEJTUSJCVUJPO "35Ͱ͸ɺશମΛΧόʔ Ͱ͖͍ͯΔͷʹର͠ɺ /"35Ͱ͸ɺzGBSNz౳ ܽམ͍ͯ͠Δ

  8. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ"35 UFBDIFS Λར༻ͭͭ͠ɺ/"35 TUVEFOU Λֶश ɾ/"35ͱ"35ͷӅΕঢ়ଶ ஫ऍ෼෍ͷࠩ෼Λଛࣦؔ਺ʹ௥Ճ )JOUTGSPNXPSEBMJHONFOU

    )JOUTGSPNIJEEFOTUBUFT /FHBUJWFMPHMJLFMJIPPE

  9. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNIJEEFOTUBUFT EFDPEFSͷl૚ t൪໨ͷӅΕঢ়ଶ  USUFBDIFS TUTUVEFOU U൪໨ͱU ൪໨ͷӅΕঢ়ଶ

    ͷྨࣅ౓͕ɺ ɹɾUFBDIFSଆͰ௿͘  ɹɾTUVEFOUଆͰߴ͍ ৔߹ʹϖφϧςΟΛ༩͑Δ

  10. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNXPSEBMJHONFOU l૚ hϔου, t൪໨ͷ஫ऍ෼෍  USUFBDIFS TUTUVEFOU UFBDIFSͱTUVEFOUؒͷ

    ஫ऍ෼෍ͷࠩ ,-EJWFSHFODF

  11. &YQFSJNFOUT

  12. &YQFSJNFOUT ⾣"CMBUJPOTUVEJFT

  13. $PODMVTJPO ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ໨ඪ຋༁ͷ඼࣭Λҡ࣋ͭͭ͠ɺਪ࿦࣌ͷܭࢉ࣌ؒΛߴ଎Խ

  14. None
  15. None