Dynamic Multi-Level Multi-Task Learning for Sentence Simplification

弊研究室で行なったCOLING2018読み会の発表資料です。

Transcript

1. $ )BO
   (VP
   3BNBLBOUI 1BTVOVSV
   .PIJU #BOTBM %ZOBNJD
   .VMUJ-FWFM
   .VMUJ5BTL
   -FBSOJOH
   GPS
   4FOUFODF
   4JNQMJGJDBUJPO #
   ੢ݪ େو $0-*/(ಡΈձʢʣ  
   
2. ໨࣍ l ֓ཁ l Ϟσϧ l ධՁํ๏ l ݁Ռ l "CMBUJPOT
   
   "OBMZTJT  
   
3. ֓ཁ จͷฏқԽ l ෼ׂɺ࡟আɺݴ͍׵͑ͳͲͰɺՄಡੑΛ্͛Δ l ༗ޮͳೖྗจ΋࿦ཧతʹؚΊΔ΂͖ʢؚҙʣ #BTFMJOF l ϙΠϯλίϐʔϝΧχζϜͷTFRTFR  
   
4. ֓ཁ ఏҊख๏ l ϚϧνλεΫɾϚϧνϨϕϧ֊૚ ◦ ิॿλεΫʢؚҙɾݴ͍׵͑ʣ͕ɺҟͳΔϨϕϧͷ֊૚ l λεΫͷ੾Γସ͑ํΛಈతʹֶश ◦ ଟ࿹όϯσΟοτϕʔεͷ܇࿅ख๏ ධՁɾ෼ੳ l ࣗಈධՁʢ4"3*ɺ',(-ʣͱखಈධՁͰ༏Εͨ  
   
5. ໨࣍ l ֓ཁ l Ϟσϧ l ධՁํ๏ l ݁Ռ l "CMBUJPOT
   
   "OBMZTJT Ø Baseline Ø   Ø  Ø 
    Ø 
    Ø      
   
6. Ϟσϧɿ#BTFMJOF ϙΠϯλίϐʔจฏқԽϞσϧ l ҎԼͷ૚Λඋ͑ͨTFRTFRϞσϧ ◦ Ξςϯγϣϯʢ#BIEBOBV FU
   BM
   ʣ ◦ ϙΠϯλίϐʔϝΧχζϜʢ4FF
   FU
   BM
   ʣ  
   
7. Ϟσϧɿ#BTFMJOF Ξςϯγϣϯ 4FF
   FU
   BM
   l(FU
   5P
   5IF
   1PJOU
   4VNNBSJ[BUJPO
   XJUI
   1PJOUFS(FOFSBUPS
   /FUXPSLTz
   BS9JWF   
   
8. Ϟσϧɿ#BTFMJOF ϙΠϯλίϐʔϝΧχζϜ 4FF
   FU
   BM
   l(FU
   5P
   5IF
   1PJOU
   4VNNBSJ[BUJPO
   XJUI
   1PJOUFS(FOFSBUPS
   /FUXPSLTz
   BS9JWF   
   
9. ϞσϧɿิॿλεΫ̍ ؚҙੜ੒λεΫ l ฏқจ͸ೖྗʹै͏΂͖ l ҙຯతʢߴʣ૚ l ؚҙੜ੒Ϟσϧ܇࿅༻σʔληοτ ◦ 4/-*
   #PXNBO
   FU
   BM
    ◦ .VMUJ/-*
   8JMMJBNT
   FU
   BM
     
   
10. ϞσϧɿิॿλεΫ̎ ݴ͍׵͑ੜ੒λεΫ l ߏจ΍ޠኮͰɺฒ΂ସ͑΍ॻ͖׵͑ l ޠኮ౷ޠʢ௿ʣ૚ l ݴ͍׵͑ੜ੒λεΫ༻܇࿅σʔληοτ ◦ 1BSB/.5 8JFUJOH BOE
    (JNQFM
    B  
    
11. ϞσϧɿϚϧνλεΫϞσϧ  
    
12. ϞσϧɿϚϧνλεΫֶश TFRTFR
    Ͱ͸ l Τϯίʔμ΍σίʔμͷɺ૚΍ύϥϝʔλڞ༗ ఏҊख๏ l ૚ڞ༗Ͱ͸ɺύϥϝʔλͷҰ෦Λඇެ։ɺ ࢒Γʢؔ࿈දݱʣΛڞ༗ l ڞ༗ύϥϝʔλΛଛࣦؔ਺ͷϖφϧςΟ߲Ͱɺ ͋Δڑ཭ࢦඪʹ͚ۙͮΔ  
    
13. ϞσϧɿϚϧνϨϕϧڞ༗ TFRTFR
    ͷ֤֊૚ͰҟͳΔػೳΛ΋ͭ l #FMJOLPW FU
    BM
     l ௿૚ʢೖྗଆʣʹ୯ޠߏ଄Λֶशʢݴ͍׵͑ʣ l ߴ૚ʹҙຯʹয఺Λ߹ΘͤΔʢؚҙʣ  
    
14. Ϟσϧɿιϑτڞ༗ ϋʔυڞ༗ l ڞ༗͢ΔύϥϝʔλΛ௚઀݁ͼ͚ͭΔ ιϑτڞ༗ l ҟͳΔλεΫ͕ɺύϥϝʔλۭؒͷͲͷ෦෼Λڞ༗͢Δ ͔બ୒Ͱ͖Δ l ଛࣦؔ਺ ! " = −log () * +; " + . "/ − 0/ ◦ " ͸ओλεΫʢฏқԽʣͷશͯͷύϥϝʔλ ◦ "/ 0/ ͸ओλεΫͱิॿλεΫͷڞ༗ύϥϝʔλͷαϒηοτ  
    
15. ϞσϧɿϚϧνλεΫ܇࿅ طଘख๏ l ʢ੩తͳʣࠞ߹ൺ !"" : !$% : !&& ◦ ओλεΫʢฏқԽʣɿؚҙɿݴ͍׵͑ ఏҊख๏ l ੩తͰ͸ͳ͘ಈతʹ܇࿅͍ͨ͠  
    
16. Ϟσϧɿಈతࠞ߹ൺֶश ଟ࿹όϯσΟοτ l XJUI
    #PMU[NBOO
    FYQMPSBUJPO
    ,BFMCMJOH FU
    BM
     l XJUI
    ࢦ਺Ҡಈฏۉߋ৽ϧʔϧ  
    
17. Ϟσϧɿಈతࠞ߹ൺֶश ଟ࿹όϯσΟοτ  
    
18. Ϟσϧɿಈతࠞ߹ൺֶश ଟ࿹όϯσΟοτ l ̏λεΫͷઃఆͷू߹ !" , ⋯ , !% l ֤ &' Ͱɺ࿹Λબ୒͠ɺใु ()* ΛಘΔ ◦ ใु͸ɺओλεΫͷෛͷ WBMJEBUJPO
    MPTT l όϯσΟοτίϯτϩʔϥͷํ਑ l ֤ &' Ͱͷ֤࿹ + ͷߦಈਪఆ஋  
    
19. ໨࣍ l ֓ཁ l Ϟσϧ l ධՁํ๏ l ݁Ռ l "CMBUJPOT
    
    "OBMZTJT  
    
20. ධՁํ๏ɿσʔληοτ 5SBJO 7BMJE 5FTU /FXTFMB     4NBMM8JLJ     -BSHF8JLJ    4/-*  .VMUJ/-* ؚҙੜ੒༻   ʢ߹Θͤͯʣ  8JFUJOH(JNQFM ݴ͍׵͑༻ . ʢ߹Θͤͯʣ,  
    
21. ධՁํ๏ɿධՁࢦඪ ࣗಈධՁ l 4"3* l ',(- ◦ ୹͍จΛධՁ͕ͪ͠ʢ4IBSEMPX
    ʣ l #-&6 ◦ ฏқԽͰ͸ؔ࿈ੑ͕௿͍ʢ;IV
    FU
    BM
     ଞʣ ◦ มߋ͠ͳ͍อकతͳγεςϜ͕ධՁ͞Ε͕ͪʢಉ্ʣ  
    
22. ධՁํ๏ɿධՁࢦඪ खಈධՁ l ྲྀெੑʢ'MVFODZʣ ◦ JT
    UIF
    PVUQVU
    HSBNNBUJDBM
    BOE
    XFMM
    GPSNFE l ଥ౰ੑʢ"EFRVBDZʣ ◦ UP
    XIBU
    FYUFOU
    JT
    UIF
    NFBOJOH
    FYQSFTTFE
    JO
    UIF
    PSJHJOBM
    TFOUFODF
    QSFTFSWFE
    JO
    UIF
    PVUQVU l ฏқੑʢ4JNQMJDJUZʣ ◦ JT
    UIF
    PVUQVU
    TJNQMFS
    UIBO
    UIF
    PSJHJOBM
    TFOUFODF  
    
23. ໨࣍ l ֓ཁ l Ϟσϧ l ධՁํ๏ l ݁Ռ l "CMBUJPOT
    
    "OBMZTJT  
    
24. ݁Ռ l #BTFMJOF
    WT
    طଘख๏ ◦ /FXTFMB Ͱ ',(-༏উɺ4"3*
    ࣍఺ ◦ 8JLJ
    Ͱ͸ಉ౳  
    
25. ݁Ռ l #BTFMJOF &OU1BS
    WT
    #BTFMJOFطଘख๏ ◦ /FXTFMB ͷ ',(-
    ͱ 4"3*Ͱ༏উ l #BTFMJOF &OU 1BS
    WT
    #BTFMJOF &OU1BS ◦ /FXTFMB ΍ 8JLJ
    Ͱ ',(-
    ΍ 4"3*
    ͍͍ͩͨ༏উ  
    
26. ݁Ռ l ʢิॿλεΫͷʣࠞ߹ൺʢಈతWT੩తʣ ◦ /FXTFMB ͱ 8JLJ4NBMM Ͱ 4"3* ༏উ  
    
27. ݁Ռ ਓखධՁ l XBZ
    WT
    ଞ ◦ ฏқੑʢ4JNQMJDJUZʣͰ༏উ ◦ ଥ౰ੑʢ"EFRVBDZʣ͸ %3&44-4 ʹෛ͚ͨˠฏқԽॏࢹ ◦ ฏۉείΞ͸ɺ%3&44-4ΑΓྑ͍  
    
28. ݁Ռ ೖग़ྗͷҰக౓ l XBZ
    ͸௿͍ʢ (SPVOEUSVUI
    ʹ͍ۙʣ l %3&44-4 ͸ߴ͍ ◦ ଥ౰ੑʢ"EFRVBDZʣ͕ߴ͔ͬͨͷ΋ᰐ͚Δ  
    
29. ໨࣍ l ֓ཁ l Ϟσϧ l ධՁํ๏ l ݁Ռ l "CMBUJPOT
    
    "OBMZTJT  
    
30. "CMBUJPOT
    
    "OBMZTJT ଞͷ૚ڞ༗ख๏͸ʁ l ௿૚ʴߴ૚͕༏উ  
    
31. "CMBUJPOT
    
    "OBMZTJT ڞ༗ʢιϑτ WT
    ϋʔυʣ͸ʁ l ιϑτ͕ 4"3*
    ڧ͍  
    
32. "CMBUJPOT
    
    "OBMZTJT 4"3*ͷৄࡉ l XBZ
    ༏উ  
    
33. "CMBUJPOT
    
    "OBMZTJT ̎ͭͷଟ࿹όϯσΟοτख๏ l ͭ໨ɿ࠷ޙΛه࿥ͯࠞ͠߹ൺΛݻఆ͢Δ l 4"3*
    
    ʢ̍ͭ໨ʣWT ʢ̎ͭ໨ʣ  
    
34. "CMBUJPOT
    
    "OBMZTJT ̎ͭͷଟ࿹όϯσΟοτख๏  
    
35. "CMBUJPOT
    
    "OBMZTJT ϚϧνλεΫֶश WT
    σʔλ֦ு l ຊ౰ʹɺิॿλεΫͷzػೳz͕ੑೳ޲্ͤͨ͞ʁ ◦ ิॿλεΫ༻ͷlσʔλ௥ՃzͷӨڹͰ͸ͳ͍ʁ l ิॿλεΫ༻σʔλʢ4/-* .VMUJ/-* ͱ 1BSB/.5ʣΛɺݸผʹ FNCFEEJOH
    ͯ͠ ओλεΫϞσϧʹ૊ΈࠐΜͩ l ఏҊख๏͕େ෯ʹ༏Ε͍ͯͨ  
    
36. "CMBUJPOT
    
    "OBMZTJT ྫ  
    
37.