文献紹介: Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

2018/07/20の文献紹介で発表

Transcript

1. Query and Output:

   Generating Words by Querying

   Distributed Word Representations

   for Paraphrase Generation
   Shuming Ma, Xu Sun, Wei Li, Sujian Li, Wenjie Li, Xuancheng Ren.

   Proceedings of NAACL-HLT 2018, pages 196-206, 2018.
   จݙ঺հ
   ௕Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ
   ҴԬເਓ
   

   View Slide

2. "CTUSBDU
   wطଘͷ4FRTFRϞσϧ͕ੜ੒͢Δจ͸

   จ๏తʹਖ਼͍͕͠ҙຯతʹෆద੾ͳ͜ͱ͕Α͋͘Δ
   w୯ޠ෼ࢄදݱͷݕࡧʹΑͬͯ୯ޠΛੜ੒͢Δ

   8PSE&NCFEEJOH"UUFOUJPO/FUXPSL 8&"/
   

   ΛఏҊ
   wݴ͍׵͕͑ॏཁͳςΩετฏқԽͱ୹จཁ໿λεΫͰ

   TUBUFPGUIFBSUΛୡ੒
   !2
   

   View Slide

3. *OUSPEVDUJPO
   w ैདྷͷ4FRTFRϞσϧ͸୯ޠͷҙຯͰ͸ͳ͘܇࿅
   ηοτͷ୯ޠ΍ύλʔϯΛ҉ه͢Δ܏޲͕͋Δ

   ˡσίʔμͷग़ྗ૚͕ҙຯత৘ใΛϞσϦϯά

   ɹ͍ͯ͠ͳ͍ͨΊ
   w σίʔμͷग़ྗ૚͕࣋ͭύϥϝʔλ਺͕ଟ͍

   ӅΕ૚ͷ࣍ݩ͕ ޠኮαΠζ͕ສͷ৔߹

   ύϥϝʔλ਺͸ ສͱͳΔ
   
   !3
   

   View Slide

4. 8&"/
   w 8PSE&NCFEEJOH"UUFOUJPO/FUXPSL
   w 3//ͷग़ྗΛΫΤϦͱͯ͠࠷΋Ұக͢Δ෼ࢄදݱ
   ͷ୯ޠΛBUUFOUJPOΛ࢖༻ͨ͠ݕࡧʹΑͬͯબ୒
   w ୯ޠͷ෼ࢄදݱ͸Τϯίʔμɺσίʔμ΁ͷೖྗ
   ʹՃ͑ͯग़ྗ૚ͷΫΤϦʹΑͬͯ΋ߋ৽͞ΕΔ
   !4
   

   View Slide

5. !5
   8&"/
   

   View Slide

6. !6
   8&"/
   

   View Slide

7. !7
   8&"/
   

   View Slide

8. !8
   8&"/
   

   View Slide

9. ΫΤϦͱ୯ޠͷηοτ͔ΒείΞΛܭࢉ
   RUλΠϜεςοϓUͷRVFSZ

   FJJ൪໨ͷީิ୯ޠ J ʜ O
   OޠኮαΠζ

   είΞ͕࠷େͱͳΔ୯ޠΛબ୒

   WBMJEBUJPOTFUTͰͷੑೳΛجʹHFOFSBMΛ࢖༻
   !9
   

   View Slide

10. 5SBJOJOH
    w ୯ޠͷબ୒ʹݕࡧΛ༻͍͍ͯΔ͕ɺҰൠతͳ
    4FRTFRͱಉ༷ʹඍ෼Մೳ

    ˠଛࣦؔ਺͸ಉ͡΋ͷ͕࢖༻Մೳ
    w "EBN

    Ћ Ќ Ќ ЏF
    !10
    

    View Slide

11. &YQFSJNFOUT 5FYU4JNQMJpDBUJPO
    
    w %BUBTFUT

    1BSBMMFM8JLJQFEJB4JNQMJpDBUJPO$PSQVT 18,1
    

    USBJOWBMJEUFTU
    

    &OHMJTI8JLJQFEJBBOE4JNQMF&OHMJTI8JLJQFEJB

    &84&8
    

    L USBJOWBMJEUFTU
    

    UFTUTFU͸".5ͰಘΒΕͨͭͷ3FGFSFODFΛ࣋ͭ
    !11
    

    View Slide

12. &YQFSJNFOUT 5FYU4JNQMJpDBUJPO
    
    w &WBMVBUJPO.FUSJDT

    #-&6

    ػց຋༁΍ฏқԽͰ޿͘༻͍ΒΕ͍ͯΔࣗಈධՁख๏

    

    ਓखධՁ

    ྲྀெੑɺଥ౰ੑɺฏқ͞ΛͰධՁ

    ฏқ͞͸ग़ྗ͕ೖྗͱൺ΂ͯͲΕ͚ͩฏқ͔Λࣔ͢
    !12
    

    View Slide

13. ݁Ռ ࣗಈධՁ
    
    !13
    

    View Slide

14. ݁Ռ ਓखධՁ
    
    !14
    

    View Slide

15. "OBMZTJT
    w 8&"/͸ैདྷͷ4FRTFRͱൺ΂ͯύϥϝʔλ͕গͳ͍
    !15
    

    View Slide

16. "OBMZTJT
    w /54XW΍1#.53͸ඞਢͷཁૉΛ͍͍ܽͯΔ
    w 4#.54"3*͸ྲྀெ͕ͩҙຯ͕ҟͳΔ
    !16
    

    View Slide

17. "OBMZTJT
    !17
    

    View Slide

18. "OBMZTJT
    !18
    ˢলུ͕ଟ͘৘ใ͕ෆ଍͍ͯ͠Δ
    

    View Slide

19. "OBMZTJT
    !19
    ˢTJFNFOTNBSUJO SSC TIVSCBͱ͍ͬͨແؔ܎ͷ

    ɹ୯ޠΛग़ྗ
    

    View Slide

20. "OBMZTJT
    !20
    ˣྲྀெ͕ͩҙຯ͕ҟͳΓΑΓཧղ͕೉͘͠ͳ͍ͬͯΔ
    

    View Slide

21. $PODMVTJPO
    w ΫΤϦʹΑΔ୯ޠ෼ࢄදݱͷݕࡧ͔Β୯ޠΛੜ੒
    ͢ΔFODPEFSEFDPEFSGSBNFXPSLΛఏҊ
    w ͭͷӳޠฏқԽσʔληοτʹ͓͍ͯ

    ϕʔεϥΠϯͱൺֱͯ͠#-&6͕ͦΕͧΕ

    ͓Αͼ޲্ͨ͠
    w ຊϞσϧ͸TUBUFPGUIFBSUΛୡ੒͍ͯ͠Δ
    !21
    

    View Slide