文献紹介: A Persona-Based Neural Conversation Model

2018/02/28の文献紹介で発表

Transcript

1. A Persona-Based

   Neural Conversation Model
   Jiwei Li, Michel Galley, Chris Brockett, Georgios Spithourakis,

   Jianfeng Gao, and Bill Dolan.
   Proceedings of the 54th Annual Meeting of the Association for
   Computational Linguistics, pages 994 - 1003, 2016.
   จݙ঺հ`
   ௕Ԭٕज़ՊֶେֶɹࣗવݴޠॲཧݚڀࣨɹҴԬເਓ
   

   View Slide

2. "CTUSBDU
   w࿩ऀҰ؏ੑͷ໰୊Λѻ͏ฦ౴ੜ੒Ϟσϧ
   wܦྺ΍ελΠϧͷΑ͏ͳݸੑΛೖྗʹ෇Ճ
   wQFSQMFYJUZ #-&6ͷ྆ํͰੑೳ͕޲্
   wਓखධՁͰ΋Ұ؏ੑʹ͓͍ͯੑೳ͕޲্
   2
   

   View Slide

3. *OUSPEVDUJPO
   wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

   ߏங͕஫໨ΛूΊ͍ͯΔ
   w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

   ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
   wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
   wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
   3
   

   View Slide

4. *OUSPEVDUJPO
   wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

   ߏங͕஫໨ΛूΊ͍ͯΔ
   w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

   ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
   wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
   wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
   4
   

   View Slide

5. *OUSPEVDUJPO
   wେྔͷਓؒରਓؒͷର࿩ʹΑΔࣗવͳର࿩γεςϜͷ

   ߏங͕஫໨ΛूΊ͍ͯΔ
   w܇࿅σʔλ಺ͷ୅දతͳฦ౴Λฦ͢܏޲͕͋Δ

   ˠͦͷΑ͏ͳฦ౴ͷ໬౓͕ߴ͘ͳΓ΍͍ͨ͢Ί
   wໃ६ͨ͠ฦ౴Λฦ͢͜ͱ͕͋Δ
   wຊ࿦จͰ͸Ұ؏ੑͱݸੑͷ໰୊ʹ͍ͭͯऔΓ૊Ή
   5
   

   View Slide

6. ؔ࿈ݚڀ
   w3JUUFSΒ
   ͸౷ܭతػց຋༁ͷ໰୊ͱͯ͠औΓ૊Μͩ
   w4FSCBOΒ
   ͸ର࿩ཤྺ΁ͷґଘؔ܎Λิ଍͢Δ͜ͱΛ
   ໨తͱͨ͠֊૚తFODPEFSEFDPEFSϞσϧΛఏҊ
   w-JΒ
   ͸యܕతԠ౴ͷׂ߹ΛݮΒͨ͢Ίʹ

   ࠷େ໬౓ .-&
   Ͱ͸ͳ͘૬ޓ৘ใྔ ..*
   Λ໨తؔ਺ͱ͢Δ
   TFRTFRγεςϜΛఏҊ
   6
   

   View Slide

7. ఏҊϞσϧ
   7
   

   View Slide

8. ఏҊϞσϧ
   wதؒ૚Ϣχοτʹ-45.Λ༻͍ͨ3//
   w࠷ޙͷग़ྗΛ%FDPEFSʹ౉͢
   8
   &ODPEFS
   

   View Slide

9. ఏҊϞσϧ
   wதؒ૚Ϣχοτʹ-45.Λ༻͍ͨ3//
   w&ODPEFSͷग़ྗΛ%FDPEFSʹೖྗ
   w4QFBLFS&NCFEEJOHΛ֤ӅΕ૚ͰՃࢉ
   9
   %FDPEFS
   

   View Slide

10. ఏҊϞσϧ
    w4QFBLFS.PEFM

    ฦ౴ऀͷݸੑͷΈΛߟྀ

    4QFBLFS&NCFEEJOHΛೖྗ
    w4QFBLFS"EESFTTFF.PEFM

    ฦ౴ऀͱฉ͖खͷ྆ํΛߟྀ

    ԼࣜͰ4QFBLFS&NCFEEJOHΛ߹੒
    10
    

    View Slide

11. %FDPEJOHBOE3FSBOLJOH
    ɹ.ೖྗจɹ3ฦ౴จɹc3cฦ౴จ௕

    ɹW4QFBLFS*%ɹЕ Ѝௐ੔ύϥϝʔλ
    w#FBN4FBSDI࣌ʹ্ࣜͷධՁؔ਺Ͱ3FSBOLJOHΛߦ͏
    wయܕతͰͳ͘௕͍จ͕༏ઌ͞ΕΔ
    wɹɹɹɹɹ͸3͔Β.Λग़ྗ͢ΔTFRTFRΛֶशͯ͠ܭࢉ
    11
    

    View Slide

12. σʔληοτ
    w5XJUUFS1FSTPOB%BUBTFU

    ೥݄͔Βϲ݄෼ͷ5XJUUFS'JSF)PTFΛ࢖༻

    ظؒ಺ʹճҎ্λʔϯͷձ࿩Λͨ͠Ϣʔβʹݶఆ

    ϢʔβʹΑΔ ૊ͷձ࿩ؚ͕·ΕΔ

    ಉϢʔβʹΑΔ೥݄͔Βϲ݄෼ͷձ࿩Λ૊

    ͣͭ։ൃ ݕূ ςετηοτͱͯ͠ઃఆ

    ฦ౴ऀͷ4QFBLFS*%ͷΈ͕ೖ͍ͬͯΔͨΊ4QFBLFS.PEFM

    ͷΈʹར༻
    12
    

    View Slide

13. σʔληοτ
    w5XJUUFS4PSEPOJ%BUBTFU 4PSEPOJ
    

    ैདྷͷ405"ͱͷൺֱͷͨΊʹ࢖༻

    ςετηοτͷΈ࢖༻

    ૊ͷձ࿩σʔλ

    ͭͷೖྗจʹରͯ͠࠷େݸͷฦ౴

    ˠ5XJUUFS1FSTPOB%BUBTFUͱͷ#-&6ͷൺֱ͸Ͱ͖ͳ͍
    13
    

    View Slide

14. σʔληοτ
    w5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUB

    57γϦʔζl'SJFOETz l5IF#JH#BOH5IFPSZzͷࣈນ

    ਓͷओཁਓ෺ʹΑΔ ૊ͷձ࿩

    ͏ͪ։ൃ ςετηοτͱͯͦ͠ΕͧΕ ૊࢖༻
    w0QFO4VCUJUMFT

    ϊΠζΛؚΉ.ʙ.ͷࣈນσʔληοτ

    5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUBͷن໛͕খ͍ͨ͞Ί

    ຊσʔληοτͰυϝΠϯదԠΛߦ͏
    14
    

    View Slide

15. ֶशͷৄࡉ
    wMBZFS-45.
    w IJEEFODFMMTGPSFBDIMBZFS
    w#BUDITJ[F
    w-FBSOJOHSBUF
    w<>ͷҰ༷෼෍ͰύϥϝʔλΛॳظԽ
    w5ISFTIPMEGPSHSBEJFOUDMJQQJOH
    w7PDBCVMBSZTJ[F
    w%SPQPVUSBUF
    w#FBNTJ[F
    15
    

    View Slide

16. ݁Ռ
    w5XJUUFS4PSEPOJEBUBTFUʹ͓͚ΔධՁ
    w.5CBTFMJOF͸4.5ʹΑΔख๏
    wPVSTZTUFN͸5XJUUFS1FSTPOB%BUBTFUͰֶशͨ͠΋ͷ
    wֶशίʔύεͷن໛ %SPQPVUͷ࢖༻ ର৅Ϣʔβͷબผ͕

    վળͷཧ༝ͱߟ͑ΒΕΔ
    16
    

    View Slide

17. ݁Ռ
    w5XJUUFS1FSTPOBEBUBTFUʹ͓͚ΔධՁ
    w.-&ͷ৔߹͸ ..*ͷ৔߹͸ͷվળ
    wఏҊख๏͸..*ΑΓ.-&ʹΑΓ༗ӹ
    17
    

    View Slide

18. ݁Ռ
    w57TFSJFTσʔληοτʹ͓͚ΔධՁ
    w4QFBLFS.PEFM 4QFBLFS"EESFTTFF.PEFMͷ͍ͣΕ΋

    #-&6είΞΛ޲্ͤ͞Δ
    wఏҊ͢ΔͭͷϞσϧͷؒʹେ͖ͳҧ͍͸ͳ͍

    ˠਓͷύλʔϯ͕ัଊͰ͖ΔఔσʔλαΠζ͕େ͖͘ͳ͍
    18
    

    View Slide

19. ݁Ռ
    w5XJUUFS1FSTPOB%BUBTFUͷ։ൃσʔλͱ

    57TFSJFTEBUBTFUͰͦΕͧΕQFSQMFYJUZΛൺֱ
    w5XJUUFSͷํ͕ߴ͘ͳΔͷ͸ϊΠζͷͨΊͱߟ͑ΒΕΔ
    19
    

    View Slide

20. ݁Ռ
    wϥϯμϜʹਓͷ4QFBLFS&NCFEEJOHΛ

    4QFBLFS.PEFMʹೖྗ
    20
    

    View Slide

21. ݁Ռ
    w4QFBLFS"EESFTTFF.PEFM

    ͷධՁ
    wฦ౴ऀʹහײͰ͋Δ͜ͱ͕

    ୯ޠ͔Β෼͔Δ
    wlIJNz͔ΒੑผΛਖ਼͘͠

    ೝ͍ࣝͯ͠Δ͜ͱ͕෼͔Δ
    21
    

    View Slide

22. ਓखධՁ
    wΫϥ΢υιʔγϯάΛ࢖ͬͯग़ྗΛධՁ
    w4QFBLFS*%ຖʹग़ྗ͕Ұ؏͍ͯ͠Δ͔Λ࣮ݧ
    wϕʔεϥΠϯͱ1FSTPOB.PEFMͷग़ྗΛൺֱͯ͠

    ʮҰ؏͍ͯ͠Δʯ͸
    ʮ΍΍Ұ؏͍ͯ͠Δʯ͸
    

    ಉఔ౓Ͱ͋Δ৔߹͸ͷείΞΛ෇͚Δ
    wਓͷධՁऀͷείΞΛฏۉ͠ɺ౳෼ͷ࠶ׂ౰Λߦ͏
    22
    

    View Slide

23. ਓखධՁ݁Ռ
    wಉఔ౓ͷ৔߹Λແࢹ͢Δͱɺͷࣄྫʹ͓͍ͯ

    1FSTPOB.PEFM͕ʮҰ؏͍ͯ͠Δʯʮ΍΍Ұ؏͍ͯ͠Δʯ
    ͱ൑ఆ͞Εͨ
    wʮ΍΍Ұ؏͍ͯ͠ΔʯΛແࢹ͢Δͱɺ1FSTPOB.PEFM͕

    ࣄྫͷͰ༏ҐͱͳΓɺϕʔεϥΠϯ͸ʹཹ·Δ
    23
    

    View Slide

24. ࣮ࡍͷग़ྗࣄྫ
    24
    

    View Slide

25. ࣮ࡍͷग़ྗࣄྫ
    25
    

    View Slide

26. ݁࿦
    w1FSTPOBCBTFEͷԠ౴ੜ੒ϞσϧΛఏࣔ
    w#-&6 QFSQMFYJUZ Ұ؏ੑͷਓखධՁʹ͓͍ͯ

    ܶతͰ͸ͳ͍΋ͷͷϕʔεϥΠϯΛ্ճΔ݁Ռ
    wฦ౴ऀฉ͖खͷਓΛೖྗ͢Δ͜ͱʹϝϦοτ͕͋Δ͜ͱ
    ͕4QFBLFS"EESFTTFFϞσϧͷ݁ՌͰࣔ͞Εͨ
    26
    

    View Slide