Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介: A Persona-Based Neural Conversation Model

Yumeto Inaoka
February 28, 2018

文献紹介: A Persona-Based Neural Conversation Model

2018/02/28の文献紹介で発表

Yumeto Inaoka

February 28, 2018
Tweet

More Decks by Yumeto Inaoka

Other Decks in Science

Transcript

  1. A Persona-Based

    Neural Conversation Model
    Jiwei Li, Michel Galley, Chris Brockett, Georgios Spithourakis,

    Jianfeng Gao, and Bill Dolan.
    Proceedings of the 54th Annual Meeting of the Association for
    Computational Linguistics, pages 994 - 1003, 2016.
    จݙ঺հ`
    ௕Ԭٕज़ՊֶେֶɹࣗવݴޠॲཧݚڀࣨɹҴԬເਓ

    View Slide

  2. "CTUSBDU
    w࿩ऀҰ؏ੑͷ໰୊Λѻ͏ฦ౴ੜ੒Ϟσϧ
    wܦྺ΍ελΠϧͷΑ͏ͳݸੑΛೖྗʹ෇Ճ
    wQFSQMFYJUZ #-&6ͷ྆ํͰੑೳ͕޲্
    wਓखධՁͰ΋Ұ؏ੑʹ͓͍ͯੑೳ͕޲্
    2

    View Slide

  3. *OUSPEVDUJPO
    wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

    ߏங͕஫໨ΛूΊ͍ͯΔ
    w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

    ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
    wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
    wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
    3

    View Slide

  4. *OUSPEVDUJPO
    wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

    ߏங͕஫໨ΛूΊ͍ͯΔ
    w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

    ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
    wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
    wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
    4

    View Slide

  5. *OUSPEVDUJPO
    wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

    ߏங͕஫໨ΛूΊ͍ͯΔ
    w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

    ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
    wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
    wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
    5

    View Slide

  6. ؔ࿈ݚڀ
    w3JUUFSΒ
    ͸౷ܭతػց຋༁ͷ໰୊ͱͯ͠औΓ૊Μͩ
    w4FSCBOΒ
    ͸ର࿩ཤྺ΁ͷґଘؔ܎Λิ଍͢Δ͜ͱΛ
    ໨తͱͨ͠֊૚తFODPEFSEFDPEFSϞσϧΛఏҊ
    w-JΒ
    ͸యܕతԠ౴ͷׂ߹ΛݮΒͨ͢Ίʹ

    ࠷େ໬౓ .-&
    Ͱ͸ͳ͘૬ޓ৘ใྔ ..*
    Λ໨తؔ਺ͱ͢Δ
    TFRTFRγεςϜΛఏҊ
    6

    View Slide

  7. ఏҊϞσϧ
    7

    View Slide

  8. ఏҊϞσϧ
    wதؒ૚Ϣχοτʹ-45.Λ༻͍ͨ3//
    w࠷ޙͷग़ྗΛ%FDPEFSʹ౉͢
    8
    &ODPEFS

    View Slide

  9. ఏҊϞσϧ
    wதؒ૚Ϣχοτʹ-45.Λ༻͍ͨ3//
    w&ODPEFSͷग़ྗΛ%FDPEFSʹೖྗ
    w4QFBLFS&NCFEEJOHΛ֤ӅΕ૚ͰՃࢉ
    9
    %FDPEFS

    View Slide

  10. ఏҊϞσϧ
    w4QFBLFS.PEFM

    ฦ౴ऀͷݸੑͷΈΛߟྀ

    4QFBLFS&NCFEEJOHΛೖྗ
    w4QFBLFS"EESFTTFF.PEFM

    ฦ౴ऀͱฉ͖खͷ྆ํΛߟྀ

    ԼࣜͰ4QFBLFS&NCFEEJOHΛ߹੒
    10

    View Slide

  11. %FDPEJOHBOE3FSBOLJOH
    ɹ.ೖྗจɹ3ฦ౴จɹc3cฦ౴จ௕

    ɹW4QFBLFS*%ɹЕ Ѝௐ੔ύϥϝʔλ
    w#FBN4FBSDI࣌ʹ্ࣜͷධՁؔ਺Ͱ3FSBOLJOHΛߦ͏
    wయܕతͰͳ͘௕͍จ͕༏ઌ͞ΕΔ
    wɹɹɹɹɹ͸3͔Β.Λग़ྗ͢ΔTFRTFRΛֶशͯ͠ܭࢉ
    11

    View Slide

  12. σʔληοτ
    w5XJUUFS1FSTPOB%BUBTFU

    ೥݄͔Βϲ݄෼ͷ5XJUUFS'JSF)PTFΛ࢖༻

    ظؒ಺ʹճҎ্λʔϯͷձ࿩Λͨ͠Ϣʔβʹݶఆ

    ϢʔβʹΑΔ ૊ͷձ࿩ؚ͕·ΕΔ

    ಉϢʔβʹΑΔ೥݄͔Βϲ݄෼ͷձ࿩Λ૊

    ͣͭ։ൃ ݕূ ςετηοτͱͯ͠ઃఆ

    ฦ౴ऀͷ4QFBLFS*%ͷΈ͕ೖ͍ͬͯΔͨΊ4QFBLFS.PEFM

    ͷΈʹར༻
    12

    View Slide

  13. σʔληοτ
    w5XJUUFS4PSEPOJ%BUBTFU 4PSEPOJ

    ैདྷͷ405"ͱͷൺֱͷͨΊʹ࢖༻

    ςετηοτͷΈ࢖༻

    ૊ͷձ࿩σʔλ

    ͭͷೖྗจʹରͯ͠࠷େݸͷฦ౴

    ˠ5XJUUFS1FSTPOB%BUBTFUͱͷ#-&6ͷൺֱ͸Ͱ͖ͳ͍
    13

    View Slide

  14. σʔληοτ
    w5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUB

    57γϦʔζl'SJFOETz l5IF#JH#BOH5IFPSZzͷࣈນ

    ਓͷओཁਓ෺ʹΑΔ ૊ͷձ࿩

    ͏ͪ։ൃ ςετηοτͱͯͦ͠ΕͧΕ ૊࢖༻
    w0QFO4VCUJUMFT

    ϊΠζΛؚΉ.ʙ.ͷࣈນσʔληοτ

    5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUBͷن໛͕খ͍ͨ͞Ί

    ຊσʔληοτͰυϝΠϯదԠΛߦ͏
    14

    View Slide

  15. ֶशͷৄࡉ
    wMBZFS-45.
    w IJEEFODFMMTGPSFBDIMBZFS
    w#BUDITJ[F
    w-FBSOJOHSBUF
    w<>ͷҰ༷෼෍ͰύϥϝʔλΛॳظԽ
    w5ISFTIPMEGPSHSBEJFOUDMJQQJOH
    w7PDBCVMBSZTJ[F
    w%SPQPVUSBUF
    w#FBNTJ[F
    15

    View Slide

  16. ݁Ռ
    w5XJUUFS4PSEPOJEBUBTFUʹ͓͚ΔධՁ
    w.5CBTFMJOF͸4.5ʹΑΔख๏
    wPVSTZTUFN͸5XJUUFS1FSTPOB%BUBTFUͰֶशͨ͠΋ͷ
    wֶशίʔύεͷن໛ %SPQPVUͷ࢖༻ ର৅Ϣʔβͷબผ͕

    վળͷཧ༝ͱߟ͑ΒΕΔ
    16

    View Slide

  17. ݁Ռ
    w5XJUUFS1FSTPOBEBUBTFUʹ͓͚ΔධՁ
    w.-&ͷ৔߹͸ ..*ͷ৔߹͸ͷվળ
    wఏҊख๏͸..*ΑΓ.-&ʹΑΓ༗ӹ
    17

    View Slide

  18. ݁Ռ
    w57TFSJFTσʔληοτʹ͓͚ΔධՁ
    w4QFBLFS.PEFM 4QFBLFS"EESFTTFF.PEFMͷ͍ͣΕ΋

    #-&6είΞΛ޲্ͤ͞Δ
    wఏҊ͢ΔͭͷϞσϧͷؒʹେ͖ͳҧ͍͸ͳ͍

    ˠਓͷύλʔϯ͕ัଊͰ͖ΔఔσʔλαΠζ͕େ͖͘ͳ͍
    18

    View Slide

  19. ݁Ռ
    w5XJUUFS1FSTPOB%BUBTFUͷ։ൃσʔλͱ

    57TFSJFTEBUBTFUͰͦΕͧΕQFSQMFYJUZΛൺֱ
    w5XJUUFSͷํ͕ߴ͘ͳΔͷ͸ϊΠζͷͨΊͱߟ͑ΒΕΔ
    19

    View Slide

  20. ݁Ռ
    wϥϯμϜʹਓͷ4QFBLFS&NCFEEJOHΛ

    4QFBLFS.PEFMʹೖྗ
    20

    View Slide

  21. ݁Ռ
    w4QFBLFS"EESFTTFF.PEFM

    ͷධՁ
    wฦ౴ऀʹහײͰ͋Δ͜ͱ͕

    ୯ޠ͔Β෼͔Δ
    wlIJNz͔ΒੑผΛਖ਼͘͠

    ೝ͍ࣝͯ͠Δ͜ͱ͕෼͔Δ
    21

    View Slide

  22. ਓखධՁ
    wΫϥ΢υιʔγϯάΛ࢖ͬͯग़ྗΛධՁ
    w4QFBLFS*%ຖʹग़ྗ͕Ұ؏͍ͯ͠Δ͔Λ࣮ݧ
    wϕʔεϥΠϯͱ1FSTPOB.PEFMͷग़ྗΛൺֱͯ͠

    ʮҰ؏͍ͯ͠Δʯ͸
    ʮ΍΍Ұ؏͍ͯ͠Δʯ͸

    ಉఔ౓Ͱ͋Δ৔߹͸ͷείΞΛ෇͚Δ
    wਓͷධՁऀͷείΞΛฏۉ͠ɺ౳෼ͷ࠶ׂ౰Λߦ͏
    22

    View Slide

  23. ਓखධՁ݁Ռ
    wಉఔ౓ͷ৔߹Λແࢹ͢Δͱɺͷࣄྫʹ͓͍ͯ

    1FSTPOB.PEFM͕ʮҰ؏͍ͯ͠Δʯʮ΍΍Ұ؏͍ͯ͠Δʯ
    ͱ൑ఆ͞Εͨ
    wʮ΍΍Ұ؏͍ͯ͠ΔʯΛແࢹ͢Δͱɺ1FSTPOB.PEFM͕

    ࣄྫͷͰ༏ҐͱͳΓɺϕʔεϥΠϯ͸ʹཹ·Δ
    23

    View Slide

  24. ࣮ࡍͷग़ྗࣄྫ
    24

    View Slide

  25. ࣮ࡍͷग़ྗࣄྫ
    25

    View Slide

  26. ݁࿦
    w1FSTPOBCBTFEͷԠ౴ੜ੒ϞσϧΛఏࣔ
    w#-&6 QFSQMFYJUZ Ұ؏ੑͷਓखධՁʹ͓͍ͯ

    ܶతͰ͸ͳ͍΋ͷͷϕʔεϥΠϯΛ্ճΔ݁Ռ
    wฦ౴ऀฉ͖खͷਓΛೖྗ͢Δ͜ͱʹϝϦοτ͕͋Δ͜ͱ
    ͕4QFBLFS"EESFTTFFϞσϧͷ݁ՌͰࣔ͞Εͨ
    26

    View Slide