Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hint-Based_Training_for_Non-Autoregressive_Mach...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for MARUYAMA MARUYAMA
September 22, 2019
150
0

 Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf

Avatar for MARUYAMA

MARUYAMA

September 22, 2019

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
200
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
160
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
200

Featured

See All Featured
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
350
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
280
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
274
21k
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2.2k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
300
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
840
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.1k
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
220
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
More Than Pixels: Becoming A User Experience Designer
Avatar for Michelle Schulp Hunt marktimemedia
3
430
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k

Transcript

  1. )JOU#BTFE5SBJOJOHGPS/PO"VUPSFHSFTTJWF .BDIJOF5SBOTMBUJPO -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. 1BQFS ɾ&./-1*+$/-1 ɾIUUQTBSYJWPSHBCT

  3. "CTUSBDU ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ"VUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO "35 ʹൺ΂ͯʜ ਪ࿦࣌ͷܭࢉ࣌ؒˣ

    ຋༁ͷ඼࣭ˣ

  4. *OUSPEVDUJPO ⾣"35WT/"35 ɾ"VUPSFHSFTTJWFUSBOTMBUJPO "35 ɾ/POBVUPSFHSFTTJWFUSBOTMBUJPO /"35 "35 /"35 ݪݴޠଆจͱ໨తݴޠଆจͷฏۉจ௕ࠩ ෳ਺ͷग़ྗީิΛಘΔͨΊͷ෯

    ͜͜Ͱ͸ʜ

  5. *OUSPEVDUJPO ⾣"35ͱ/"35ͷҧ͍Λௐࠪ ɾ/"35͕ࢧ཭໓྾ͳग़ྗΛ͍ͯ͠ΔҐஔͰ͸ɺӅΕঢ়ଶͷྨࣅ౓͕ ඇৗʹߴ͘ͳΔ ɾ/"35ͷ஫ऍ෼෍͸ɺ"35ΑΓ΋ᐆດੑΛؚΉ ⾣্هͷௐࠪ݁ՌΛ΋ͱʹ/"35NPEFMΛվળ

  6. 0CTFSWBUJPO ⾣$PTJOFTJNJMBSJUJFTCFUXFFOEFDPEFSIJEEFOTUBUFT /"35Ͱ͸ɺӅΕঢ়ଶͷ ྨࣅ౓͕ඇৗʹߴ͘ɺ ಉ͡τʔΫϯΛ ग़ྗ͢Δ܏޲ʹ͋Δ

  7. 0CTFSWBUJPO ⾣"UUFOUJPOEJTUSJCVUJPO "35Ͱ͸ɺશମΛΧόʔ Ͱ͖͍ͯΔͷʹର͠ɺ /"35Ͱ͸ɺzGBSNz౳ ܽམ͍ͯ͠Δ

  8. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ"35 UFBDIFS Λར༻ͭͭ͠ɺ/"35 TUVEFOU Λֶश ɾ/"35ͱ"35ͷӅΕঢ়ଶ ஫ऍ෼෍ͷࠩ෼Λଛࣦؔ਺ʹ௥Ճ )JOUTGSPNXPSEBMJHONFOU

    )JOUTGSPNIJEEFOTUBUFT /FHBUJWFMPHMJLFMJIPPE

  9. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNIJEEFOTUBUFT EFDPEFSͷl૚ t൪໨ͷӅΕঢ়ଶ  USUFBDIFS TUTUVEFOU U൪໨ͱU ൪໨ͷӅΕঢ়ଶ

    ͷྨࣅ౓͕ɺ ɹɾUFBDIFSଆͰ௿͘  ɹɾTUVEFOUଆͰߴ͍ ৔߹ʹϖφϧςΟΛ༩͑Δ

  10. .FUIPE ⾣)JOUTGSPNUIF"35UFBDIFS.PEFM ɾ)JOUTGSPNXPSEBMJHONFOU l૚ hϔου, t൪໨ͷ஫ऍ෼෍  USUFBDIFS TUTUVEFOU UFBDIFSͱTUVEFOUؒͷ

    ஫ऍ෼෍ͷࠩ ,-EJWFSHFODF

  11. &YQFSJNFOUT

  12. &YQFSJNFOUT ⾣"CMBUJPOTUVEJFT

  13. $PODMVTJPO ⾣"35ͷӅΕঢ়ଶ΍஫ऍ෼෍͔ΒzIJOUzΛಘΔֶशख๏ΛఏҊ ⾣8.5&O%F %F&Oʹ͓͍ͯ-45."35Λ্ճΔੑೳ ⾣/POBVUPSFHSFTTJWFNBDIJOFUSBOTMBUJPO /"35 ɾ໨ඪ຋༁ͷ඼࣭Λҡ࣋ͭͭ͠ɺਪ࿦࣌ͷܭࢉ࣌ؒΛߴ଎Խ

  14. None
  15. None