Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Chatbot and NLP
Taketoshi Aono(青野健利 a.k.a brn)
October 02, 2018
0
930
Chatbot and NLP
ChatBotとNLP(自然言語処理について)
Taketoshi Aono(青野健利 a.k.a brn)
October 02, 2018
Tweet
Share
More Decks by Taketoshi Aono(青野健利 a.k.a brn)
See All by Taketoshi Aono(青野健利 a.k.a brn)
CA 1Day Youth Bootcamp for Frontend LT
brn
0
280
Modern TypeScript
brn
2
540
javascript - behind the scene
brn
3
460
tc39 proposals
brn
0
480
プロダクト開発とTypeScript
brn
8
2.4k
React-Springでリッチなアニメーション
brn
1
420
javascript internationalization API
brn
0
500
How V8 executes WASM
brn
3
1.3k
memory_in_javascript.pdf
brn
0
660
Featured
See All Featured
Support Driven Design
roundedbygravity
87
8.6k
Web development in the modern age
philhawksworth
197
9.3k
Docker and Python
trallard
27
1.6k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
212
20k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
21
1.4k
Facilitating Awesome Meetings
lara
29
4.1k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
29
4.4k
Practical Orchestrator
shlominoach
178
8.7k
From Idea to $5000 a Month in 5 Months
shpigford
373
44k
How GitHub Uses GitHub to Build GitHub
holman
465
280k
Making Projects Easy
brettharned
98
4.4k
BBQ
matthewcrist
74
7.9k
Transcript
ChatBot & NLP
Agenda • About myself • Intro • NLP & Chatbot
• NLP & Task oriented bot • NLP & Operations • NLP & Evaluations • NLP & UX • Future
Name @brn (ꫬꅿ⨳ⵃ) Occupation ؿٗٝزؒٝسؒٝآص،٥ط؎ذ؍ـؒٝآص، Company Cyberagent ،سذؙأةآؔ AI Messenger
OSS Contributor of V8 About http://info.b6n.ch
Disclaimer 猘כ堣唒㷕统הַNLP㼔ךؒٝآص،דכזֻծ 崞欽׃فٗتؙزךPOזךד湫䱸涸זNLPך䪮遭חא ְגך鑧כקהודֹתׇؽآطأ涸ח ת֮תⰻ鿇ך稢ְַ鑧דֹתׇկ ⥞澛涸ז鑧ָً؎ٝחזתׅկ Intro
Intro
吳䒭⠓爡AI ًحإٝآٍ٦ הְֲ؟؎غ٦ؒ٦آؑٝزך㶨⠓爡 ⚺חB2Bぢֽثٍحز؟٦ؽأך䲿⣘٥盖椚٥麊欽遤ֲ ثٍحزنحز䲿⣘׃גֶծ荈搫鎉铂Ⳣ椚ろגׅץג荈 爡醡 ת尣篖חثٍحزؔلٖ٦ة٦䫴ִגְ Intro
Channels LINE٥Facebook٥Webך3فٓحزؿؓ٦ي Webכ㼔欽ؐ؍آؑحزل٦آח㙵鴥דֲ Intro
Operators 尣篖חؔلٖ٦ة٦ָ䌢꽎 نحزד鍑寸דֹזְ颵㉏װծؔلٖ٦ة٦׃ַ「ֽֿהָꨇ ׃ְ噟「ֽ⦐➂然钠זו Intro
Organaization Intro "EUFDI4UVEJP "*-BCP "ET#VTJOFTT "*#VTJOFTT
NLP & ChatBot
ثٍحزنحزفٗتؙزך⚥דNLPכוֲ⢪גְַ ⡦ָ铬겗זךַ NLP & ChatBot
植㖈ثٍحزنحزכ㣐ֹֻ⟃♴ך2אחⴓ겲דֹ • ꧟锑 • ةأؙ䭷ぢ NLP & ChatBot
꧟锑 暴㹀ךةأؙדכ搀ֻծ➂ず㡦ך⠓鑧ך״ֲחثٍحزד꧟锑 遤ֲ Microsoftךז瘝ָ剣せ ➙㔐כ《♳־זְ NLP & ChatBot
ةأؙ䭷ぢ 暴㹀ךةأؙ鍑寸ׅ״ֲחرؠ؎ׁٝنحز FAQח瘶ִծ✮秈遤ׅ 植㖈ؽآطأה׃ג《䪔ךכ⚺חֿךنحز NLP & ChatBot
NLP & Task oriented bot
ةأؙ䭷ぢ㼎鑧דוך״ֲח荈搫鎉铂Ⳣ椚崞ַַׅ 植㖈⚺崧הזגְ2אךػة٦ٝ稱➜ NLP & Task oriented bot
FAQ 剑㢳ְ؛٦أָثٍحزنحزⵃ欽׃FAQ 颵㉏ה瘶ִךل،הזגְ欽⢽欽䠐 ぐ欽⢽ך颵㉏ה곁㹏ך颵㉏ך겲⡂䏝ַ剑أ؝،ך넝ְ瘶ִ 鵤ׅ NLP & Task oriented bot
Action bot ✮秈װ飑Ⰵ瘝遤ֲծ剑穄涸ח،ؙءّٝח籬ָBot NLPך䪮遭״⽃秪זءشٔؔד葺ְ؛٦أָ㢳ְ NLP & Task oriented bot
זךד植㖈ثٍحزنحزחֶֽ荈搫鎉铂Ⳣ椚ך⳿〡כ 葺׃䝤׃כהַֻծFAQדךؕأةو٦؟ه٦زָً؎ٝח זגְ NLP & Task oriented bot
Logic FAQח瘶ִنحزךٗآحؙכ⟃♴ • ؕأةو٦ך颵㉏ָ勻 • كؙزٕ⻉ • ׅדחكؙزٕ⻉׃גְֶ欽⢽ؿ؋؎ٕה嫰鯰 • 겲⡂أ؝،꠬ָ⦼⟃♳ךך鵤⽱
NLP & Task oriented bot
word2vec ⽃铂ⴓ侔邌植הㄎל200如⯋קוךكؙزٕח㢌䳔ׅ ךٓ؎ـٓٔ كؙزٕךぐ如⯋חכך⽃铂ך暴䗙呓秛׃גְ NLP & Task oriented bot
0.8, 0.32, 0.02, … 0.75 匌❨ 0.6, 0.26, 0.83, …
0.56 ػٔ ⽃铂ךⴓ侔邌植
vector 俑㶵كؙزٕהְֲ鎘皾〳腉ז⽃⡘ח㢌䳔דֹֿהד 鎉铂Ⳣ椚كؙزٕך鎘皾ח衅הֿׅהָדֹկ זךד⡂גְ⽃铂ず㡦كؙزٕךⰻ琎ה穠卓 ״鵚ְ⦼חז״ֲח㷕统׃גְֻկ NLP & Task oriented bot
NLP & Operations
⯓玎稱➜׃FAQך؛٦أדכ暴חFAQך麊欽ָꅾ銲חזגֻ FAQך鷄⸇٥鐰⣣瘝䛎䌢涸ח遤ִזְה䚍腉笝䭯כꨇ׃ְ NLP & Operations
暴חثٍحزنحز㼪Ⰵ׃ָծ麊欽ֲָתְַֻ׆ח䫎־⳿ ׅػة٦ٝ穠圓㢳ְ 暴ח1~2䎃כ堣唒㷕统װر؍٦فٓ٦صؚٝ꽀⢪׃ثٍح زنحزח㼎׃ג㣄䫴ְגְ곁㹏㢳ַָծ ➙כ汤ְ湡1ワ׃ג植㹋涸ז湡简ךؽآطأָ㟓ִ גְ 孡ָׅ NLP & Operations
AI ًحإٝآٍ٦דכFAQ鏣鎘㼔ךث٦يָ֮ نحزך䧭籐鋅זָFAQך鷄⸇ծ刿倜遤גְ ♧鋅⽃秪זؔلٖ٦ءّٝח鋅ִָծ ٌرٕך暴䚍欽⢽הךوحثؚٝך➬穈֮玎䏝椚鍑׃ ♳דثُ٦صؚٝ׃זְה䧭籐♴־ֿהחזַיזְ ךד⟃㢩ה㣐㢌 NLP & Operations
NLP & Evaluation
ثٍحزنحزך䚍腉寸חכ鐰⣣ָ䗳銲 • וֽ姻然חِ٦ؠ٦ך䠐㔳ח黝׃،ٝ؟٦ָ鵤ַׇ • FAQؿ؋؎ٕ荈⡤ך姻然䚍 ׃ַ׃ֿך鐰⣣כꬊ䌢חꨇ׃ְ NLP & Evaluation
Evaluate model ثٍحزنحزךٌرٕ鐰⣣ָꨇ׃ְ椚歋 • 欽⢽ؿ؋؎ٕ荈⡤ָ䌢ח刿倜ׁגְ • 劢濼ך颵㉏ח㼎ׅ䚍腉ぢ♳ָ庠בְ NLP & Evaluation
Evaluate FAQ FAQؿ؋؎ٕך鐰⣣ָꨇ׃ְ椚歋 • نحزךٌرٕח䕦갟ׁ • ך颵㉏ח㼎ׅ،ٝ؟٦ָ劤䔲חַװַׅךַⴻ 㹀דֹזְ • ؙٓ؎،ٝزך؟٦ؽأⰻ㺁ָ㢌㜥さח♧儗涸ח䚍腉
ָ♴ַָך״ֲח鋅ִ NLP & Evaluation
AI ًحإٝآٍ٦דכֿך鴟ְְ䊨㣗׃גְ ➙ךثٍحزنحز噟歲כ׳ה侧㶵ָ切僳זֿהָ㢳ְ הְֲַ噟歲垥彊ך鎘庠㛇彊ָזְךד䎢デהַכ֮ ׃ַה׃鐰⣣㛇彊⡲גְֻֿהָ㣐✲ NLP & Evaluation
NLP & UX
ثٍحزنحزך䚍腉寸ךכٌرٕך䚍腉װ欽⢽ؿ؋؎ٕ ךㅷ颵ֽדכזְ ろծثٍحزךUIծءشٔؔך圓䧭瘝ך筨さ涸ז UX罋ִֿהָꅾ銲חזגֻ NLP & Evaluation
Bot choice نحزח겲⡂䏝وحثד鵤⥋꠬ׅ⦼鏣ֽגְ㜥さծ ך꠬⦼⟃♴דכ鵤⥋׃זֻזג׃תֲָծ ꠬⦼♴־ֺׅה麩ִ瘶ִ鵤ׅ〳腉䚍ָ넝ֻז NLP & UX
Customer choice זךדծ姻鍑ך〳腉䚍ָ⚥玎䏝ך㜥さחכծؕأةو٦ח鼅䫛肇 ⳿׃ג鼅דֲ״ֲז㹋鄲חזגְ NLP & UX
Recommendation ֮ؔٝٓ؎ٝآُؒٔ٦ءّحفדך⢽ فٖئٝزד⡦顠ְְַַזְ歑䚍ךחآُؒ ٔ٦ך䱿讂遤ֲنحز ֿךنحزכNLPⵃ欽ׇ׆ծءٝفٕזءشٔؔח״ג㾜 ׅկ NLP & UX
Reception ׅץג肤㹀ך鼅䫛肇ך欽䠐ׅ • כְծ׃׳ֲָזְז 곁㹏ך鼅䫛釈 • ְְַדׅ״יծְֹדׅ״י NLP & UX
ֿ渿鴥ءشٔؔד 곁㹏חהג״弫駈䠬ך֮䱸㹏⡤꿀׃גֲ NLP & Evaluation
Future
ثٍحزنحزהְֲؽآطأךꨇ׃ׁ • ثٍحزד֮䠐 • 植朐㢳ֻךثٍحزنحزחְֶגNLPך䪮遭כ넝礵䏝זⰋ 俑嗚稊ؒٝآٝה׃ג׃ַ堣腉׃גְזְ 곁㹏כ醱꧟זةأؙ⽃秪חֿזׇֿהثٍحزח実גְ כ׆ FAQֽ耀ְֹ鏬דכזְ Future
劢勻鋅䰘ִثٍحزنحز • ثٍحزהְֲUI؝ىُص؛٦ءّٝ⟃㢩פה䎢־ • 㹋欽涸ד֮ثٍحزךד㸣穠דֹ • 䘯黝ח؝ىُص؛٦ءָّٝדֹ Future
ֿ㹋植ׅח AIًحإٝآٍ٦דכぐ㣐㷕ה欵㷕鸬䵿ד㼎鑧䪮遭ծ灇瑔遤ְ ؕأةو٦؟ه٦ز㢌ꬠׅ״ֲז؟٦ؽأ湡䭷׃גְ 欵㷕鸬䵿 • 匌⻌㣐㷕✜侄䱇 • 㣐ꢻ㣐㷕瀖랲侄䱇 Future
׀幠耮ָ֮הֲ׀ְׂת׃