Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: A Persona-Based Neural Conversation Model
Search
Yumeto Inaoka
February 28, 2018
Science
0
260
文献紹介: A Persona-Based Neural Conversation Model
2018/02/28の文献紹介で発表
Yumeto Inaoka
February 28, 2018
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
120
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
160
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
120
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
120
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
89
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
210
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
270
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
180
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
170
Other Decks in Science
See All in Science
Machine Learning for Materials (Lecture 9)
aronwalsh
0
200
はじめての「相関と因果とエビデンス」入門:“動機づけられた推論” に抗うために
takehikoihayashi
17
6.8k
【健康&筋肉と生産性向上の関連性】 【Google Cloudを企業で運用する際の知識】 をお届け
yasumuusan
0
310
ultraArmをモニター提供してもらった話
miura55
0
170
Machine Learning for Materials (Lecture 1)
aronwalsh
1
2k
第61回コンピュータビジョン勉強会「BioCLIP: A Vision Foundation Model for the Tree of Life」
x_ttyszk
1
1.5k
私たちのプロダクトにとってのよいテスト/good test for our products
camel_404
0
130
最新のAI技術を使った材料シミュレーションで材料研究現場に変革を
matlantis
0
750
Sarcoptic Mange
uni_of_nomi
1
100
機械学習を支える連続最適化
nearme_tech
PRO
1
110
深層学習を利用して 大豆の外部欠陥を判別した研究事例の紹介
kentaitakura
0
210
Direct Preference Optimization
zchenry
0
270
Featured
See All Featured
Facilitating Awesome Meetings
lara
49
6k
It's Worth the Effort
3n
183
27k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.8k
Fontdeck: Realign not Redesign
paulrobertlloyd
81
5.2k
Happy Clients
brianwarren
97
6.7k
Faster Mobile Websites
deanohume
304
30k
Speed Design
sergeychernyshev
23
550
Art, The Web, and Tiny UX
lynnandtonic
296
20k
A better future with KSS
kneath
237
17k
Optimizing for Happiness
mojombo
376
69k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
48k
Building a Modern Day E-commerce SEO Strategy
aleyda
38
6.9k
Transcript
A Persona-Based Neural Conversation Model Jiwei Li, Michel Galley, Chris
Brockett, Georgios Spithourakis, Jianfeng Gao, and Bill Dolan. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 994 - 1003, 2016. จݙհ` Ԭٕज़ՊֶେֶɹࣗવݴޠॲཧݚڀࣨɹҴԬເਓ
"CTUSBDU wऀҰ؏ੑͷΛѻ͏ฦੜϞσϧ wܦྺελΠϧͷΑ͏ͳݸੑΛೖྗʹՃ wQFSQMFYJUZ #-&6ͷ྆ํͰੑೳ্͕ wਓखධՁͰҰ؏ੑʹ͓͍ͯੑೳ্͕ 2
*OUSPEVDUJPO wେྔͷਓؒରਓؒͷରʹΑΔࣗવͳରγεςϜͷ ߏங͕ΛूΊ͍ͯΔ w܇࿅σʔλͷදతͳฦΛฦ͕͋͢Δ ˠͦͷΑ͏ͳฦͷ͕ߴ͘ͳΓ͍ͨ͢Ί wໃ६ͨ͠ฦΛฦ͢͜ͱ͕͋Δ wຊจͰҰ؏ੑͱݸੑͷʹ͍ͭͯऔΓΉ 3
*OUSPEVDUJPO wେྔͷਓؒରਓؒͷରʹΑΔࣗવͳରγεςϜͷ ߏங͕ΛूΊ͍ͯΔ w܇࿅σʔλͷදతͳฦΛฦ͕͋͢Δ ˠͦͷΑ͏ͳฦͷ͕ߴ͘ͳΓ͍ͨ͢Ί wໃ६ͨ͠ฦΛฦ͢͜ͱ͕͋Δ wຊจͰҰ؏ੑͱݸੑͷʹ͍ͭͯऔΓΉ 4
*OUSPEVDUJPO wେྔͷਓؒରਓؒͷରʹΑΔࣗવͳରγεςϜͷ ߏங͕ΛूΊ͍ͯΔ w܇࿅σʔλͷදతͳฦΛฦ͕͋͢Δ ˠͦͷΑ͏ͳฦͷ͕ߴ͘ͳΓ͍ͨ͢Ί wໃ६ͨ͠ฦΛฦ͢͜ͱ͕͋Δ wຊจͰҰ؏ੑͱݸੑͷʹ͍ͭͯऔΓΉ 5
ؔ࿈ݚڀ w3JUUFSΒ ౷ܭతػց༁ͷͱͯ͠औΓΜͩ w4FSCBOΒ ରཤྺͷґଘؔΛิ͢Δ͜ͱΛ తͱͨ͠֊తFODPEFSEFDPEFSϞσϧΛఏҊ w-JΒ
యܕతԠͷׂ߹ΛݮΒͨ͢Ίʹ ࠷େ .-& Ͱͳ͘૬ޓใྔ ..* Λతؔͱ͢Δ TFRTFRγεςϜΛఏҊ 6
ఏҊϞσϧ 7
ఏҊϞσϧ wதؒϢχοτʹ-45.Λ༻͍ͨ3// w࠷ޙͷग़ྗΛ%FDPEFSʹ͢ 8 &ODPEFS
ఏҊϞσϧ wதؒϢχοτʹ-45.Λ༻͍ͨ3// w&ODPEFSͷग़ྗΛ%FDPEFSʹೖྗ w4QFBLFS&NCFEEJOHΛ֤ӅΕͰՃࢉ 9 %FDPEFS
ఏҊϞσϧ w4QFBLFS.PEFM ฦऀͷݸੑͷΈΛߟྀ 4QFBLFS&NCFEEJOHΛೖྗ w4QFBLFS"EESFTTFF.PEFM ฦऀͱฉ͖खͷ྆ํΛߟྀ ԼࣜͰ4QFBLFS&NCFEEJOHΛ߹ 10
%FDPEJOHBOE3FSBOLJOH ɹ.ೖྗจɹ3ฦจɹc3cฦจ ɹW4QFBLFS*%ɹЕ Ѝௐύϥϝʔλ w#FBN4FBSDI࣌ʹ্ࣜͷධՁؔͰ3FSBOLJOHΛߦ͏ wయܕతͰͳ͍͘จ͕༏ઌ͞ΕΔ wɹɹɹɹɹ3͔Β.Λग़ྗ͢ΔTFRTFRΛֶशͯ͠ܭࢉ 11
σʔληοτ w5XJUUFS1FSTPOB%BUBTFU ݄͔Βϲ݄ͷ5XJUUFS'JSF)PTFΛ༻ ظؒʹճҎ্λʔϯͷձΛͨ͠Ϣʔβʹݶఆ ϢʔβʹΑΔ ͷձؚ͕·ΕΔ ಉϢʔβʹΑΔ݄͔Βϲ݄ͷձΛ ͣͭ։ൃ
ݕূ ςετηοτͱͯ͠ઃఆ ฦऀͷ4QFBLFS*%ͷΈ͕ೖ͍ͬͯΔͨΊ4QFBLFS.PEFM ͷΈʹར༻ 12
σʔληοτ w5XJUUFS4PSEPOJ%BUBTFU 4PSEPOJ ैདྷͷ405"ͱͷൺֱͷͨΊʹ༻ ςετηοτͷΈ༻ ͷձσʔλ ͭͷೖྗจʹରͯ͠࠷େݸͷฦ
ˠ5XJUUFS1FSTPOB%BUBTFUͱͷ#-&6ͷൺֱͰ͖ͳ͍ 13
σʔληοτ w5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUB 57γϦʔζl'SJFOETz l5IF#JH#BOH5IFPSZzͷࣈນ ਓͷओཁਓʹΑΔ ͷձ ͏ͪ։ൃ ςετηοτͱͯͦ͠ΕͧΕ ༻ w0QFO4VCUJUMFT
ϊΠζΛؚΉ.ʙ.ͷࣈນσʔληοτ 5FMFWJTJPO4FSJFT5SBOTDSJQUT%BUBͷن͕খ͍ͨ͞Ί ຊσʔληοτͰυϝΠϯదԠΛߦ͏ 14
ֶशͷৄࡉ wMBZFS-45. w IJEEFODFMMTGPSFBDIMBZFS w#BUDITJ[F w-FBSOJOHSBUF w<>ͷҰ༷ͰύϥϝʔλΛॳظԽ w5ISFTIPMEGPSHSBEJFOUDMJQQJOH w7PDBCVMBSZTJ[F
w%SPQPVUSBUF w#FBNTJ[F 15
݁Ռ w5XJUUFS4PSEPOJEBUBTFUʹ͓͚ΔධՁ w.5CBTFMJOF4.5ʹΑΔख๏ wPVSTZTUFN5XJUUFS1FSTPOB%BUBTFUͰֶशͨ͠ͷ wֶशίʔύεͷن %SPQPVUͷ༻ ରϢʔβͷબผ͕ վળͷཧ༝ͱߟ͑ΒΕΔ 16
݁Ռ w5XJUUFS1FSTPOBEBUBTFUʹ͓͚ΔධՁ w.-&ͷ߹ ..*ͷ߹ ͷվળ wఏҊख๏..*ΑΓ.-&ʹΑΓ༗ӹ 17
݁Ռ w57TFSJFTσʔληοτʹ͓͚ΔධՁ w4QFBLFS.PEFM 4QFBLFS"EESFTTFF.PEFMͷ͍ͣΕ #-&6είΞΛ্ͤ͞Δ wఏҊ͢ΔͭͷϞσϧͷؒʹେ͖ͳҧ͍ͳ͍ ˠਓͷύλʔϯ͕ัଊͰ͖ΔఔσʔλαΠζ͕େ͖͘ͳ͍ 18
݁Ռ w5XJUUFS1FSTPOB%BUBTFUͷ։ൃσʔλͱ 57TFSJFTEBUBTFUͰͦΕͧΕQFSQMFYJUZΛൺֱ w5XJUUFSͷํ͕ߴ͘ͳΔͷϊΠζͷͨΊͱߟ͑ΒΕΔ 19
݁Ռ wϥϯμϜʹਓͷ4QFBLFS&NCFEEJOHΛ 4QFBLFS.PEFMʹೖྗ 20
݁Ռ w4QFBLFS"EESFTTFF.PEFM ͷධՁ wฦऀʹහײͰ͋Δ͜ͱ͕ ୯ޠ͔Β͔Δ wlIJNz͔ΒੑผΛਖ਼͘͠ ೝ͍ࣝͯ͠Δ͜ͱ͕͔Δ 21
ਓखධՁ wΫϥυιʔγϯάΛͬͯग़ྗΛධՁ w4QFBLFS*%ຖʹग़ྗ͕Ұ؏͍ͯ͠Δ͔Λ࣮ݧ wϕʔεϥΠϯͱ1FSTPOB.PEFMͷग़ྗΛൺֱͯ͠ ʮҰ؏͍ͯ͠Δʯ ʮҰ؏͍ͯ͠Δʯ ಉఔͰ͋Δ߹ͷείΞΛ͚Δ
wਓͷධՁऀͷείΞΛฏۉ͠ɺͷ࠶ׂΛߦ͏ 22
ਓखධՁ݁Ռ wಉఔͷ߹Λແࢹ͢Δͱɺͷࣄྫʹ͓͍ͯ 1FSTPOB.PEFM͕ʮҰ؏͍ͯ͠ΔʯʮҰ؏͍ͯ͠Δʯ ͱఆ͞Εͨ wʮҰ؏͍ͯ͠ΔʯΛແࢹ͢Δͱɺ1FSTPOB.PEFM͕ ࣄྫͷͰ༏ҐͱͳΓɺϕʔεϥΠϯʹཹ·Δ 23
࣮ࡍͷग़ྗࣄྫ 24
࣮ࡍͷग़ྗࣄྫ 25
݁ w1FSTPOBCBTFEͷԠੜϞσϧΛఏࣔ w#-&6 QFSQMFYJUZ Ұ؏ੑͷਓखධՁʹ͓͍ͯ ܶతͰͳ͍ͷͷϕʔεϥΠϯΛ্ճΔ݁Ռ wฦऀฉ͖खͷਓΛೖྗ͢Δ͜ͱʹϝϦοτ͕͋Δ͜ͱ ͕4QFBLFS"EESFTTFFϞσϧͷ݁ՌͰࣔ͞Εͨ 26