Share
Embed
Transcript
44 slides
-
Construction of Dialog System • ച दझమ ҳࢿ • (ޛܻੋ
नഐܳ ఫझ۽ ߸ജೞח ࠗ࠙) • ࢿ ੋधӝ = Automatic Speech Recognition (ASR) • Ӗ ੋधӝ = Optical Character Recognition (OCR) • ఫझܳ ೧ೞח ࠗ࠙ = Natural Language Understanding (NLU) unit • ೧ೠ ఫझ۽ ച ਸ যաоѱ ೞח ࠗ࠙ = Dialog Manager (DM) • ࢎۈ ೧ೡ ࣻ ח ഋక۽ ਸ ࢤࢿ = Natural Language Generation (NLG) • (ਸ ޛܻੋ नഐ۽ ߸ജೞח ࠗ࠙) • ࢿ ۱ӝ = Text-To-Speech (TTS) • ҳ࠙ ঋ • NLU + DM / DM + NLG / NLU + DM + NLG (End-to-End Dialog System) /-6 %. /-( -
Construction of Dialog System ASR : Automatic Speech Recognition NLU
: Natural Language Understanding DM : Dialog Management NLG : Natural Language Generation TTS : Text to Speech User Utterance Text System Utterance Text ࢎਊ 어벤져스 어때? 어벤져스 봤어요! 토르 알아요? ച दझమ • ച दझమ ҳࢿ (Black Box) • ࢎਊо ߄ۄࠁח ੑীࢲ ച दझమ • ࢎਊח যڃ ݽٕ ٜযоࢲ ਸ ղח ੋೞ ঋ -
Construction of Dialog System • ച दझమ ҳࢿ (White Box)
• ӝദо / ѐߊо ߄ۄࠁח ੑীࢲ ച दझమ • ӝദա ѐߊח п ݽٕ যڌѱ ҳࢿغযঠೞח ঈ೧ঠೣ ASR : Automatic Speech Recognition NLU : Natural Language Understanding DM : Dialog Management NLG : Natural Language Generation TTS : Text to Speech User Utterance Text Semantic Frame System Action System Utterance Text User UA : ask-opinion NE : movie = 어벤져스 SA : say-opinion, ask-actor Movie = য߮ઉझ <movie> 봤어요! <actor> 알아요? 어벤져스 어때? -
Construction of Dialog System • ച दझమ ҳࢿ (White Box)
• ӝദо / ѐߊо ߄ۄࠁח ੑীࢲ ച दझమ • ӝദա ѐߊח п ݽٕ যڌѱ ҳࢿغযঠೞח ঈ೧ঠೣ ASR : Automatic Speech Recognition NLU : Natural Language Understanding DM : Dialog Management NLG : Natural Language Generation TTS : Text to Speech User Utterance Text Semantic Frame System Action System Utterance Text User UA : ask-opinion NE : movie = 어벤져스 SA : say-opinion, ask-actor Movie = য߮ઉझ <movie> 봤어요! <actor> 알아요? 어벤져스 어때? -
Construction of Dialog System (NLU, DM) • ച दझమ ҳࢿ
(NLU) • ޙਸ ஹೊఠо ೧ೞח ഋక۽ ߸ജೞח ݽٕ • ۚੋ NLU ҳࢿ • Normalizer + Tokenizer (ఫझ ઁ) • Intent Classification (ب ঈ) • Named Entity Recognition (ѐݺ ੋध) • Sentiment Analyzer (ࢎਊ ӝ࠙ ঈ) • Coreference Resolution (ഐட ೧ࣗ) • Topic Extraction (ઁ ੋध) • … • ച दझమ ҳࢿ (DM) • NLU Ѿҗ۽ ਸ ٜ݅যղח ݽٕ • ۚੋ DM ҳࢿ • System act selection (दझమ ب ࢤࢿ) • Context manager (ޙݓ ݒפ) • External Knowledge Graph (৻ࠗ ध Ӓې) • যו ࠗ࠙ NLUҊ যו ࠗ࠙ DMੋо? (VOSPDL/-6 (VOSPDL/-6 -
Construction of Dialog System (NLG, ASR, TTS) • ച दझమ
ҳࢿ (NLG) • ࢎਊо ೧ೡ ࣻ ח ޙਸ ٜ݅যղח ݽٕ • ۚੋ NLG ҳࢿ • Answer Template DB ( మ݁ DB) • Answer Sentence Decoder ( ޙ ٣؊) • Post Processor (റܻ ࠗ࠙) • Prosody Manager (ߊ ܻӝ, TTS) • …. • ച दझమ ҳࢿ (ASR) • ࢎਊ ߊਸ ੋधೞৈ ఫझ۽ ٜ݅যղח ݽٕ • ച दझమ ҳࢿ (TTS) • ఫझܳ ੋр ੋधೡ ࣻ ח ࢿਵ۽ ٜ݅যח ݽٕ -
Construction of Dialog System (Quiz) • ച दझమ ҳࢿ (ೝಯ
द) • (ޛܻੋ नഐܳ ఫझ۽ ߸ജೞח ࠗ࠙) : • ఫझܳ ೧ೞח ࠗ࠙ = Natural Language Understanding (NLU): • ೧ೠ ఫझ۽ ച ਸ যաоѱ ೞח ࠗ࠙ = Dialog Manager (DM): • ࢎۈ ೧ೡ ࣻ ח ഋక۽ ਸ ࢤࢿ = Natural Language Generation (NLG): • (ਸ ޛܻੋ नഐ۽ ߸ജೞח ࠗ࠙): • ݏࠁب۾ द -
Construction of Dialog System (Quiz) • ച दझమ ҳࢿ (ೝಯ
द) • (ޛܻੋ नഐܳ ఫझ۽ ߸ജೞח ࠗ࠙) : হ, ਗې ఫझפө! • i.e.,) ೲࣁ, ܖա := ҳӖ ࢿੋधӝ • ఫझܳ ೧ೞח ࠗ࠙ = Natural Language Understanding (NLU): • Reply Matching Model • Reaction Model • ೧ೠ ఫझ۽ ച ਸ যաоѱ ೞח ࠗ࠙ = Dialog Manager (DM): • ID-OOD Ѿ, RvR Ѿ • ࢎۈ ೧ೡ ࣻ ח ഋక۽ ਸ ࢤࢿ = Natural Language Generation (NLG): • RMM మ݁ ࢤࢿ • Reaction మ݁ ࢤࢿ • (ਸ ޛܻੋ नഐ۽ ߸ജೞח ࠗ࠙): হ, ਗې ఫझפө! • I.e.,) ೲࣁ, ܖա := ҳӖ TTS • Pingpong যڌѱ ࠁݶ End-to-End System: • ੑ۱ীࢲ ۱ө ݽ؛ 1ױ҅ (RMM, Reaction)ਸ ా೧ࢲ ܖয -
Construction of Dialog System (Quiz) • য٣ী ೧غח ݽٕੌө? (ઙਮש
ই٣যীࢲ ߊ) • ҕх, ޙ, ٜযӝ ܳ ੜೞח ݽٕ ਵݶ જѷ. • ࢎਊী ೠ ౠೠ ࠁܳ ী ࠁյ ݫࣁ۽ ߸ജೞח ݽ؛ • য ޙ ݈ైܳ بա ॳী ٮۄ ߸ജदఃח ݽ؛ • ஶబஎ ݒפݢ - নೠ ઁ৬ ഋకܳ ӝദо ֍ਵݶ ೞѱ ߜযח ݽ؛ • ޙ п ਃࣗо য٣ী োѾغযחܳ ׳ইષ • ࢤп೧ࠁب۾ द -
Construction of Dialog System (Quiz) • য٣ী ೧غח ݽٕੌө? (ઙਮש
ই٣যীࢲ ߊ) • ҕх, ޙ, ٜযӝ ܳ ੜೞח ݽٕ ਵݶ જѷ. • Dialog Managementী оө • Ӓ۞ա ࢎਊ хਸ ੍যղח স ਃೞפө NLUীب ೧ؼ ࣻ • ࢎਊী ೠ ౠೠ ࠁܳ ী ࠁյ ݫࣁ۽ ߸ജೞח ݽ؛ • Dialog Managementী ࣘೣ • NLGীب ࣘೡࣻب ਸب? • য ޙ ݈ైܳ بա ॳী ٮۄ ߸ജदఃח ݽ؛ • NLGী ࣘೡ Ѫ э • ஶబஎ ݒפݢ- নೠ ઁ৬ ഋకܳ ӝദо ֍ਵݶ ೞѱ ߜযח ݽ؛ • Dialog Managementী ࣘೣ • ޙ п ਃࣗо য٣ী োѾغযחܳ ׳ইષ • NLUী ࣘೣ • Ӓ۞ա ৮߷ೠ ইש. = NLU / DM / NLG ࢎ ҳ࠙ ݽഐ೧ח ୶ࣁ -
Evaluation Metrics • ച दझమ যڌѱ ಣоغযঠೞա? • दझమ
ܻо ӝೠ ߸ਸ ೞחо? • ҙ • Precision@N : ܻо ӝ೮؍ ߸(ٜ) ࣽਤ N উী חо • ೠ ߸ 3ѐо ࢚ਤ 10ѐী ਵݶ P@10 = 0.3 • MRR : ӝೞח ߸ ࣽਤ ࣽ ಣӐ • ܳ ٜয 3ѐ ௪ܻী ೧ࢲ ղ ೠ ߸ 1ਤ, 3ਤ, 10ਤܳ ೮ݶ • (1/1+1/3+1/10) / 3 • NDCG : • ܳ ٜয ղо մ 6ѐо ࣽࢲ۽ 3,2,3,0,1,2Ҋ о • ߣ૩۽ աৡ ੜ ݏҊ, ݄݃ਵ۽ աৡ ખ ؏ݏইب ػҊ ೞݶ • ࣻܳ ࣽਤ ࣻ (ഛח ࣽਤ ࣻ log) ғ೧ࢲ ҅ೡ ࣻ • ۧѱ ҅ೠ ࣻо DCG • NDCG = അ DCGܳ о ࢚ੋ ҃ DCG۽ ա׀ ҃ • ࢿ ҙ • ҙ۲ࢿ ࣻ ୋب ಣо • ࢿ ࣻ ୋب ಣо -
Evaluation Metrics • ച दझమ যڌѱ ಣоغযঠೞա? • दझమ
ࢎۈҗب э ਸ ೞחо? • ࢎۈҗب э যڌѱ ٜ݅? • Wizard-of-OZ (WOZ, aka ֢о): • ࢎਊח दझమۄҊ ࢤпೞҊ ੑ۱ೣ + दझమ ٍীח ѐߊо ߸ೣ • ѐߊ ߸ = ࢎۈэ • ҙ • ਬࢎب ಣо (ױয ߬٬ ױਤ, ޙ ߬٬ ױਤ) • BLEU ١ ࠺Ү ಣо • ࢿ ҙ • ࠶ۄੋ٘ పझ (ౚ݂ పझ) • ࢎۈੋ ࠙рೡ ࣻ חܳ ಣо -
Revisited: Problem Description • ஹೊఠח झझ۽ ࢎҊೞ ޅೣ • 1+1
ਸ 2۽ ҅ೡ ࣻ যب 1+1 ৵ 2ੋ ࢸݺೞ ޅೣ • ஹೊఠ۽ ޙઁܳ ಽҊ ೞݶ ޙઁܳ ҳਵ۽ ೧ঠೣ (Algorithm) • উ જ ਬഋ : • Ӗী х ࠙ࢳ೧ • о ݅ചೂ Ӓܿ Ӓ۰ • ӡ ই • જ ਬഋ: • ఫझ Tо যਸ ٸ, х కӒ (न܉х, গх, х)ী ೠ чਸ ب೧ • Ӓܿ Aо যਸ ٸ Ӓܿ Bܳ A۽ ੋधदఆ ࣻ ب۾ ߸ജ೧ • ࢶҗ ਵ۽ োѾػ ب۽ Ӓې Gо ਸ ٸ G ೠ X1ীࢲ ܲ X2ө о ࡅܲ ҃۽ܳ ҳ೧ -
Revisited (NLU) • ച दझమ ҳࢿ (NLU) • ޙਸ ஹೊఠо
೧ೞח ഋక۽ ߸ജೞח ݽٕ • ۚੋ NLU ҳࢿ • Normalizer + Tokenizer (ఫझ ઁ) • Intent Classification (ب ঈ) • Named Entity Recognition (ѐݺ ੋध) • Sentiment Analyzer (ࢎਊ ӝ࠙ ঈ) • Coreference Resolution (ഐட ೧ࣗ) • Topic Extraction (ઁ ੋध) • … • Ѫਸ যڌѱ ࣻਵ۽ աఋյ ࣻ ਸө? • Intent Classification = ޙ যਸ ٸ ېझ ೞաܳ ח স • Named Entity Recognition = ޙ যਸ ٸ غח ױযৌਸ ח স (VOSPDL/-6 -
Revisited: What is a sentence? • ޙۄח Ѫ ޖੋо? •
ചо അೞ۰ח ڷਸ աఋղח ױয (ӏੋ) োࣧ • ױࣽೠ ױয ױ Ӓ ࢚: {ࡎ, ա, ݍ} • ӏ হਵݶ ઁ۽ ػ ޙۄҊ ೞӝ য۰: ࡎਸ ղо ݍ • ڷ ݏ ঋਵݶ ઁ۽ ػ ޙۄҊ ೞӝ য۰: աח ࡎਸ ޖପۥ • ޙਸ ࠁח ف о ҙ • ഋध ҙ: ޙ ࢎۈ ڷਸ "ޙߨ"ী ݏѱ ӝࣿೞ۰Ҋ ߊػ Ѫ • ޙ ҳޙ ࠙ࢳ ١ • ӝמ ҙ: ޙ ࢎۈ "ڷ"ਸ ޙߨী ݏѱ ӝࣿೞ۰Ҋ ߊػ Ѫ • য ݽ؛ ߂ ޙ ߬٬ ١ • ܻח റ ߑߨী ઑӘ ؊ ೞҊ ೣ -
Revisited: Language Model • য ݽ؛ (Language Model) • ޙਸ
ࣻਵ۽ ӝࣿೞח ҙੋ ߑߨ • ױয ઓҙ҅ח খ ױযীࢲࠗఠ ഋࢿػҊ о • LM(ա য়ט ࡎ ݡয) = P(ա) * P(য়ט | ա) * P(ࡎ | য়ט, ա) * P (ݡয | ࡎ, য়ט, ա) • য ݽ؛ ഝਊ • য ݽ؛ਸ ਊೠ ஏ • ޙઁ : ա য়ט _ ݡয • : Argmax (P(ա) * P(য়ט | ա) * P(_ | য়ט, ա) * P (ݡয | _, য়ט, ա)) • য ݽ؛ਸ ਊೠ ޙ ࢿ Ѩࢎ • ޙઁ : ա য়ט ࡎ ݡয <=> ա ࡎਸ ޖପۥয • : LM (ա য়ט ࡎ ݡয) > LM (ա ࡎਸ ޖପۥয) • য ݽ؛ рۚച • P(A) * P(B | A) * P(C | B, A) ...= ҅ ցޖ ݆ • P(X | Y, Z, . ..) ܳ P(X | Y)۽ Ӕࢎೡ ࣻ (, ّ ױযח ߄۽ খ ױযী ೧ࢲ Ѿؽ) • Markov Assumption ( Markov Property Assumption) ۄҊ ܴࠗ -
Revisited: Language Model • য ݽ؛ (Language Model) җ ഛܫ
ݽ؛ • LM(ա য়ט ࡎ ݡয) = P(ա) * P(য়ט | ա) * P(ࡎ | য়ט) * P(ݡয | ࡎ) • য ഛܫ ݽ؛ਸ ా೧ ޙ ਗੋਸ ӝࣿೡ ࣻ • ਗੋ • ޙ ਗې ب, ച х, ݺ۸/ಣࢲ/ޙ ৈࠗ ١١ • ޙਸ աఋղח ೞա ߭ఠ ա য়ט ࡎ ݡয -
Revisited: Language Model • য ݽ؛ (Language Model) җ ഛܫ
ݽ؛ • LM(ա য়ט ࡎ ݡয) = P(ա) * P(য়ט | ա) * P(ࡎ | য়ט) * P(ݡয | ࡎ) • য ഛܫ ݽ؛ਸ ా೧ ޙ ਗੋਸ ӝࣿೡ ࣻ • ਗੋ • ޙ ਗې ب, ച х, ݺ۸/ಣࢲ/ޙ ৈࠗ ١١ • ޙਸ աఋղח ೞա ߭ఠ • ҙ • ޙ ܳ য ݽ؛ਸ ా೧ Ѩೡ ࣻ ঋਸө? ա য়ט ࡎ ݡয -
NLU (Intention Classifier) • Intention Classifier = Class Classification •
য ݽ؛ਸ ా೧ࢲ ېझ Ѩӝܳ ҳഅೡ ࣻ • য ݽ؛ Ӓܿਸ Ӓ۰ࠁ -
NLU (Intention Classifier) • Intention Classifier = Class Classification •
য ݽ؛ਸ ా೧ࢲ ېझ Ѩӝܳ ҳഅೡ ࣻ • যڌѱ য ݽ؛ਸ ҳഅೡ ࣻ ਸ Ѫੋо? • ഛܫݽ؛۽? न҃ݎਵ۽? ա য়ט ࡎ ݡয &BU 1 2 3 4 5 6 7 1 2 3 4 5 6 7 1 2 3 4 5 6 7 1 2 3 4 5 6 7 Regression Layer PGM Inference (HMM, MaxEnt) DNN Regression (Bi-LSTM, GRU) -
NLU (Named Entity Recognition) • Named Recognition = Sequence Classification
• য ݽ؛ਸ ా೧ࢲ ޙৌ Ѩӝب ҳഅೡ ࣻ • য ݽ؛ਸ Ӓ۰ࠁ -
NLU (Named Entity Recognition) • Named Recognition = Sequence Classification
• য ݽ؛ਸ ా೧ࢲ ޙৌ Ѩӝب ҳഅೡ ࣻ • যڌѱ য ݽ؛ਸ ҳഅೡ ࣻ ਸ Ѫੋо? • ഛܫݽ؛۽? न҃ݎਵ۽? ա য়ט ࡎ ݡয 0 0 #'PPE 0 1 2 3 4 5 6 7 1 2 3 4 5 6 7 PGM Inference (CRF) DNN Seq-to-Seq (Bi-LSTM, GRU) 1 2 3 4 5 6 7 1 2 3 4 5 6 7 1 2 3 4 5 6 7 1 2 3 4 5 6 7 -
NLU (Coreference Resolution) • Coreference Resolution = Pair-wise Classification •
য ݽ؛ਸ ా೧ࢲ ഐட അب ੜ ೧ࣗೡ ࣻ • যݽ؛ਸ Ӓ۰ࠁ -
NLU (Coreference Resolution) • Coreference Resolution = Pair-wise Classification •
য ݽ؛ਸ ా೧ࢲ ഐட അب ੜ ೧ࣗೡ ࣻ 4IF -PWFT )JN 7FSZ .VDI .Z 4JTUFS )BT " %PH -
Revisited (DM) • ച दझమ ҳࢿ (DM) • NLU Ѿҗ۽
ਸ ٜ݅যղח ݽٕ • ۚੋ DM ҳࢿ • System act selection (दझమ ب ࢤࢿ) • Context manager (ޙݓ ݒפ) • External Knowledge Graph (৻ࠗ ध Ӓې) • যڌѱ ਸ ࢤࢿೡ Ѫੋо? • ઁ ӝ߈ ۨਕ (= ࢎۈҗ оӰѱ ਸ ٜ݅যࠁ.) • ఃਕ٘: Supervised Learning / Accuracy / Similarity • ࣻ ӝ߈ ۨਕ (= ࣻܳ ֫ѱ ӝ۾ೞח ਸ ٜ݅যࠁ.) • ఃਕ٘: Reinforcement Learning / Reward / Task Success Rate • যڌѱ ೞݶ ਸ ੜ ٜ݅ ࣻ ਸө?: • যڌѱ ೞݶ ޙݓਸ ߈ೠ ਸ ٜ݅য յ ࣻ ਸө? • যڌѱ ೞݶ ߓ҃धਸ ߈ೠ ਸ ٜ݅য յ ࣻ ਸө? (VOSPDL/-6 -
DM Learning (Single Turn) • ചী ೧ࢲ ޙ (Query)৬
(Reply) ह Ҋ о • যڃ Queryо ٜযৡ ҃ : જ ച ݽ؛ Queryী ೠ оө ਸ • ۚੋ Ӓܿਸ Ӓ۰ࠁݶ -
DM Learning (Single Turn) • ചী ೧ࢲ ޙ (Query)৬
(Reply) ह Ҋ о • যڃ Queryо ٜযৡ ҃ : જ ച ݽ؛ Queryী ೠ оө ਸ • ۚੋ Ӓܿਸ Ӓ۰ࠁݶ ա য়ט ࡎ ݡয য Ӓې աب ݡয 2VFSZ 3FQMZ -
DM Learning (Single Turn) • ചী ೧ࢲ ޙ (Query)৬
(Reply) ह Ҋ о • যڃ Queryо ٜযৡ ҃ : જ ച ݽ؛ Queryী ೠ оө ਸ • ۚੋ Ӓܿਸ Ӓ۰ࠁݶ ա য়ט ࡎ ݡয য Ӓې աب ݡয 2VFSZ 3FQMZ -
DM Learning (Single Turn) • ചী ೧ࢲ ޙ (Query)৬
(Reply) ह Ҋ о • যڃ Queryо ٜযৡ ҃ : જ ച ݽ؛ Queryী ೠ оө ਸ -
DM Learning (Single Turn + Constraint) • Query ఃਕ٘ ࠁܳ
ഝਊೞӝ ਤ೧ࢲח যڌѱ ೧ঠೡө? • ց “ف” જই ? —> ب “ف” જইਃ . • Ӓܿਸ Ӓ۰ࠁݶ ց tفu જই 2VFSZ 3FQMZ tفu જইਃ ب -
DM Learning (Multi Turn) • ݣ౭ఢب Ӓܿਸ Ӓ۰ࠁ! • ۚੋ
Ӓܿਸ Ӓ۰ࠁݶ • ݣ౭ఢ ण য۰ • ݽٚ ࠁо ز١ೞѱ ഝਊغח Ѫ ইש • դ ఢী ೠ ઓҙ҅о ݽ؛ णਵ۽ ҳഅغӝ য۰ • ࠁо ٜযоח ࣽࢲо ਃೣ + ࠁী ٮܲ ઑѤٜ ҳഅ ਃ ա য় ࡎ ݡ 2VFSZ য Ӓ ա ݡ 3FQMZ ց ޤ ݡ 2VFSZ ա ೫ ݡ ৳ 3FQMZ ೫ ա જ ൫ 2VFSZ 3FQMZ -
DM Learning (Multi Turn) • ݣ౭ఢ ঌҊ્ܻ द (Yu et
al. 2019, Computational Linguistics) -
DM Learning (Multi Turn) • ݣ౭ఢ ঌҊ્ܻ द (Yu et
al. 2019, Computational Linguistics) -
DM Learning (Knowledge) • ചী যڌѱ धਸ ਸ ࣻ ਸө?
• ژ द Ӓܿਸ Ӓ۰ࠁ -
DM Learning (Knowledge) • ചী যڌѱ धਸ ਸ ࣻ ਸө?
• ژ द Ӓܿਸ Ӓ۰ࠁ • Ӓܿ ޙઁ ޖੌө? ա য়ט ࡎ ݡয য Ӓې աب ݡয 2VFSZ 3FQMZ ,OPXMFEHF&NCFEEJOH -
DM Learning (Knowledge) • ചী যڌѱ धਸ ਸ ࣻ ਸө?
• ܲ Ӓܿ (ױয пп ߓ҃धਸ ߈) ա য়ט ࡎ ݡয য Ӓې աب ݡয 2VFSZ 3FQMZ -
DM Learning (Knowledge) • ചী যڌѱ धਸ ਸ ࣻ ਸө?
• ܲ Ӓܿ (ױয пп ߓ҃धਸ ߈) ա য়ט ࡎ ݡয য Ӓې աب ݡয 2VFSZ 3FQMZ X = hs G = sponse e prob- graphs ds in a in G 2. , τNgi } oted as the en- bridge nstruc- urpose: , t) = formed knowledge graphs. The entity is selected by attending on the graphs and the triples within each graph. 3.3 Knowledge Interpreter h t-1 Knowledge Interpreter h t Knowledge Interpreter h t+1 Knowledge Interpreter … … rays of sunlight Knowledge Graph Knowledge Graph Knowledge Graph Word Vector Key Entity Neighboring Entity Not_A_Fact Triple Retrieved Graph Figure 3: Knowledge interpreter concatenates a word vector and the national Joint Conference on Artificial Intelligence (IJCAI-18) gi = Ngi n=1 αs n [hn; tn], (4) αs n = exp(βs n ) Ngi j=1 exp(βs j ) , (5) βs n = (Wrrn)⊤tanh(Whhn + Wttn), (6) where (hn, rn, tn) = kn , Wh, Wr, Wt are weight matri- ces for head entities, relations, and tail entities, respectively. The attention weight measures the association of a relation rn to a head entity hn and a tail entity tn . Essentially, a graph vector gi is a weighted sum of the head and tail vectors [hn; tn] of the triples contained in the graph. 3.4 Knowledge Aware Generator Not_A_Fact Triple Vector Word Vector Key Entity Neighboring Entity Attended Entity Not_A_Fact Triple Attended Graph Previously Selected Triple Vector s t-1 s t s t+1 … … a Knowledge Aware Generator lack Knowledge Graph of Knowledge Graph lack of uv Knowledge Graph Knowledge Aware Generator Knowledge Aware Generator … Figure 4: Knowledge aware generator dynamically attends on the graphs and for final w attends on to compute is defined a where Vb/ of choosing vector cg t weight me st and a gr The mo K(gi) = { late the pro formally as Proceedings of the Twenty-Seventh International Joint Conference -
DM Learning (Knowledge) • ݈۽ ޙઁо হח Ӓܿੌө? • Alexa
prize 2017 winner / Alexa prize 2018 winner • Knowledgeܳ न҃ݎਵ۽ ܖח Ѫ ചੑ݃ী ࡅח Ѫੌ ࣻب • ইө न҃ݎ ҳઑח ੋр ߓ҃धਸ ӝীח ցޖաب • न҃ݎ ҳഅҗ ݽٕ ҳഅ ࢎীࢲ Ӑഋ ח Ѫ ਃೣ *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM 4ZTUFN"SDIJUFDUVSF