with friends at restaurant favorite Japanese dinner have X be full X ( ) , “Bob had dinner with his friends at his favorite Japanese restaurant just now and he is full.” ʪIBWFEJOOFS CFGVMMʫ ֫ಘ͍ͨ͠ৗࣝతࣝ ίʔύεͷੜจ ༨ܭͳޠ͕ͨ͘͞Μೖ͍ͬͯΔ ࣝʹؚΊΔޠΛࣗಈͰબ͍ͨ͠ ͖ࠜ෦Λڭࢣͳ͠Ͱܾఆ͢Δͩͱࢥ͏ 1 2 3 2 / 31
repeatedly.”, “He was fired.”⟩ ˠ ⟨X have, fire X⟩ • ⟨“Bob has a talent for accounting work.”, “He was hired with favorable treatment.”⟩ ˠ ⟨X have, hire X⟩ ͜ͷ߹ʹ ཧతͳࣝ • ⟨X have absent repeatedly, fire X⟩ ɼ⟨X have talent, hire X⟩ ඞཁͳใΠϯελϯεຖʹҟͳΔ ଞɼ࣍ͷΑ͏ͳޠ۟ͷ༗ແʹΑͬͯΠϕϯτͷҙຯ͕େ ͖͘มΘΓಘΔ • ൱ఆදݱ • ಛఆͷ݅Λද͢म০અ • etc. 6 / 31
is sadness with , , , , , , , falling asleep She full She very trouble Tom have I He filled heart is is is falling asleep concentrating full She very trouble trouble Tom have I Bob He is is stuffed stuffed has My sadness with filled heart Z outdoors with John eat dinner has Italian restaurant at dinner has restaurant at Italian eat with John outdoors She , concentrating trouble Bob sad He has extremely is ࠓճͷઃఆɿ֤จΛґଘߏͰදݱ ʢ͖ࠜ෦ͷେ͖͞Λௐ͢ΕදݱͷநΛௐͰ͖Δʣ 8 / 31
ग़ྗ ݩͷจͷ෦ߏͷϖΞͷू߹ Z = {(xi , yi )}n i=1 తؔ Z i.i.d. ∼ PXY ͱݟͯ maximize D[PXY ∥PX PY ] is My sad He extremely is sadness with , , , , , , , falling asleep She full She very trouble Tom have I He filled heart is is is falling asleep concentrating full She very trouble trouble Tom have I Bob He is is stuffed stuffed has My sadness with filled heart Z outdoors with John eat dinner has Italian restaurant at dinner has restaurant at Italian eat with John outdoors She , concentrating trouble Bob sad He has extremely is cf. ಛબ:ೖग़ྗؒͷؔ࿈ͷྑ͞Λैଐੑʹؼண [Peng+’05][Song+’12] 9 / 31
ଆ͕ࣅ͍ͯͳ͚Ε Y ଆࣅ͍ͯͳ͍ Similar Similar Unsimilar Unsimilar Z is My sad He extremely is , , , , falling asleep concentrating full She very trouble trouble Tom have I Bob He is is stuffed has sadness with filled heart dinner has restaurant at Italian eat with John outdoors She ྨࣅੑʹج͍ͮͨҰ؏ͨ͠ʢैଐੑͷߴ͍ʣࣝΛظͰ͖Δ શҰகʹج্͍ͮͨ͑͛Ͱͳ͍ͷͰσʔλɾεύʔε ωεʹରԠͰ͖Δ 15 / 31
i=1 ग़ྗ ݩͷจͷ෦ߏͷϖΞͷू߹ Z = {(xi , yi )}n i=1 తؔ Z i.i.d. ∼ PXY ͱݟͯ max. D[PXY ∥PX PY ]ʢैଐੑ࠷େԽʣ is My sad He extremely is sadness with , , , , , , , falling asleep She full She very trouble Tom have I He filled heart is is is falling asleep concentrating full She very trouble trouble Tom have I Bob He is is stuffed stuffed has My sadness with filled heart Z outdoors with John eat dinner has Italian restaurant at dinner has restaurant at Italian eat with John outdoors She , concentrating trouble Bob sad He has extremely is ఏҊख๏ • తؔɿ σʔλɾεύʔεωεˍଟ༷ͳݴ͍͑ → HSIC • ୳ࡧɿ ߹ͤരൃ → MH Ͱ֬తࢁొΓ 20 / 31
I have had breakfast at my house . I am full . We had special dinner . We are full . I have had breakfast at ten . I ’m full . They had breakfast at the eatery . They are full now . She had breakfast with her friends . She felt happy . I had breakfast with my friends at my uncle ’s house . I feel happy . They had breakfast with their friends at the cafeteria . They felt happy . He had lunch with his friends at eleven . He felt happy . I had trouble associating with others . I cry . He had trouble with his homework . He cries . I have trouble concentrating . I cry . She had trouble reading books . She cries . ྨࣅʢΧʔωϧʣɿ k(xi , xj ) = cos(ave(wordvecs(xi )), ave(wordvecs(xj ))) ℓ(yi , yj ) = cos(ave(wordvecs(yi )), ave(wordvecs(yj ))) ϑϨʔζؒྨࣅͷయܕతͳईɽֶशࡁΈ୯ޠϕΫτϧΛར༻ɽ 23 / 31
yi I have had breakfast at my house . I am full . We had special dinner . We are full . I have had breakfast at ten . I ’m full . They had breakfast at the eatery . They are full now . She had breakfast with her friends . She felt happy . I had breakfast with my friends at my uncle ’s house . I feel happy . They had breakfast with their friends at the cafeteria . They felt happy . He had lunch with his friends at eleven . He felt happy . I had trouble associating with others . I cry . He had trouble with his homework . He cries . I have trouble concentrating . I cry . She had trouble reading books . She cries . 1 ͚ͩग़ݱ͢Δ୯ޠ (dinner, lunch) ͕සग़ޠ (breakfast) ͱͷྨࣅʹ ج͍ͮͯ͞ΕΔ ୈ 2 ϒϩοΫͷ (with) friends ͕͞Εɼࠨล → ӈลͷ༧ଌΛ༰қʹ 24 / 31