Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介: Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

文献紹介: Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

2018/07/20の文献紹介で発表

Yumeto Inaoka

July 20, 2018
Tweet

More Decks by Yumeto Inaoka

Other Decks in Research

Transcript

  1. Query and Output:

    Generating Words by Querying

    Distributed Word Representations

    for Paraphrase Generation
    Shuming Ma, Xu Sun, Wei Li, Sujian Li, Wenjie Li, Xuancheng Ren.

    Proceedings of NAACL-HLT 2018, pages 196-206, 2018.
    จݙ঺հ
    ௕Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ
    ҴԬເਓ

    View Slide

  2. "CTUSBDU
    wطଘͷ4FRTFRϞσϧ͕ੜ੒͢Δจ͸

    จ๏తʹਖ਼͍͕͠ҙຯతʹෆద੾ͳ͜ͱ͕Α͋͘Δ
    w୯ޠ෼ࢄදݱͷݕࡧʹΑͬͯ୯ޠΛੜ੒͢Δ

    8PSE&NCFEEJOH"UUFOUJPO/FUXPSL 8&"/

    ΛఏҊ
    wݴ͍׵͕͑ॏཁͳςΩετฏқԽͱ୹จཁ໿λεΫͰ

    TUBUFPGUIFBSUΛୡ੒
    !2

    View Slide

  3. *OUSPEVDUJPO
    w ैདྷͷ4FRTFRϞσϧ͸୯ޠͷҙຯͰ͸ͳ͘܇࿅
    ηοτͷ୯ޠ΍ύλʔϯΛ҉ه͢Δ܏޲͕͋Δ

    ˡσίʔμͷग़ྗ૚͕ҙຯత৘ใΛϞσϦϯά

    ɹ͍ͯ͠ͳ͍ͨΊ
    w σίʔμͷग़ྗ૚͕࣋ͭύϥϝʔλ਺͕ଟ͍

    ӅΕ૚ͷ࣍ݩ͕ ޠኮαΠζ͕ສͷ৔߹

    ύϥϝʔλ਺͸ ສͱͳΔ

    !3

    View Slide

  4. 8&"/
    w 8PSE&NCFEEJOH"UUFOUJPO/FUXPSL
    w 3//ͷग़ྗΛΫΤϦͱͯ͠࠷΋Ұக͢Δ෼ࢄදݱ
    ͷ୯ޠΛBUUFOUJPOΛ࢖༻ͨ͠ݕࡧʹΑͬͯબ୒
    w ୯ޠͷ෼ࢄදݱ͸Τϯίʔμɺσίʔμ΁ͷೖྗ
    ʹՃ͑ͯग़ྗ૚ͷΫΤϦʹΑͬͯ΋ߋ৽͞ΕΔ
    !4

    View Slide

  5. !5
    8&"/

    View Slide

  6. !6
    8&"/

    View Slide

  7. !7
    8&"/

    View Slide

  8. !8
    8&"/

    View Slide

  9. ΫΤϦͱ୯ޠͷηοτ͔ΒείΞΛܭࢉ
    RUλΠϜεςοϓUͷRVFSZ

    FJJ൪໨ͷީิ୯ޠ J ʜ O
    OޠኮαΠζ

    είΞ͕࠷େͱͳΔ୯ޠΛબ୒

    WBMJEBUJPOTFUTͰͷੑೳΛجʹHFOFSBMΛ࢖༻
    !9

    View Slide

  10. 5SBJOJOH
    w ୯ޠͷબ୒ʹݕࡧΛ༻͍͍ͯΔ͕ɺҰൠతͳ
    4FRTFRͱಉ༷ʹඍ෼Մೳ

    ˠଛࣦؔ਺͸ಉ͡΋ͷ͕࢖༻Մೳ
    w "EBN

    Ћ Ќ Ќ ЏF
    !10

    View Slide

  11. &YQFSJNFOUT 5FYU4JNQMJpDBUJPO

    w %BUBTFUT

    1BSBMMFM8JLJQFEJB4JNQMJpDBUJPO$PSQVT 18,1

    USBJOWBMJEUFTU

    &OHMJTI8JLJQFEJBBOE4JNQMF&OHMJTI8JLJQFEJB

    &84&8

    L USBJOWBMJEUFTU

    UFTUTFU͸".5ͰಘΒΕͨͭͷ3FGFSFODFΛ࣋ͭ
    !11

    View Slide

  12. &YQFSJNFOUT 5FYU4JNQMJpDBUJPO

    w &WBMVBUJPO.FUSJDT

    #-&6

    ػց຋༁΍ฏқԽͰ޿͘༻͍ΒΕ͍ͯΔࣗಈධՁख๏


    ਓखධՁ

    ྲྀெੑɺଥ౰ੑɺฏқ͞ΛͰධՁ

    ฏқ͞͸ग़ྗ͕ೖྗͱൺ΂ͯͲΕ͚ͩฏқ͔Λࣔ͢
    !12

    View Slide

  13. ݁Ռ ࣗಈධՁ

    !13

    View Slide

  14. ݁Ռ ਓखධՁ

    !14

    View Slide

  15. "OBMZTJT
    w 8&"/͸ैདྷͷ4FRTFRͱൺ΂ͯύϥϝʔλ͕গͳ͍
    !15

    View Slide

  16. "OBMZTJT
    w /54XW΍1#.53͸ඞਢͷཁૉΛ͍͍ܽͯΔ
    w 4#.54"3*͸ྲྀெ͕ͩҙຯ͕ҟͳΔ
    !16

    View Slide

  17. "OBMZTJT
    !17

    View Slide

  18. "OBMZTJT
    !18
    ˢলུ͕ଟ͘৘ใ͕ෆ଍͍ͯ͠Δ

    View Slide

  19. "OBMZTJT
    !19
    ˢTJFNFOTNBSUJO SSC TIVSCBͱ͍ͬͨແؔ܎ͷ

    ɹ୯ޠΛग़ྗ

    View Slide

  20. "OBMZTJT
    !20
    ˣྲྀெ͕ͩҙຯ͕ҟͳΓΑΓཧղ͕೉͘͠ͳ͍ͬͯΔ

    View Slide

  21. $PODMVTJPO
    w ΫΤϦʹΑΔ୯ޠ෼ࢄදݱͷݕࡧ͔Β୯ޠΛੜ੒
    ͢ΔFODPEFSEFDPEFSGSBNFXPSLΛఏҊ
    w ͭͷӳޠฏқԽσʔληοτʹ͓͍ͯ

    ϕʔεϥΠϯͱൺֱͯ͠#-&6͕ͦΕͧΕ

    ͓Αͼ޲্ͨ͠
    w ຊϞσϧ͸TUBUFPGUIFBSUΛୡ੒͍ͯ͠Δ
    !21

    View Slide