Share
Embed
Transcript
19 slides
-
୯ޠͷࢄදݱ • ୯ޠΛີͳϕΫτϧۭؒͷ1ͱͯ͠දݱ • ୯ޠؒͷԋࢉ͕Մೳʢking - man + woman =
queenʣ ࣍ݩΛಛ͚Δ୯ޠΛ֫ಘͰ͖ΕදݱΑΓϦονʹ 2 ਤ1ɿ2࣍ݩۭؒʹ͓͚Δࢄදݱͷྫ -
طଘݚڀ ࢄදݱͷ֫ಘϞσϧ • χϡʔϥϧωοτϫʔΫʹΑΔ༧ଌϞσϧ • ڞىߦྻͱߦྻղʹجͮ͘Ϟσϧ ࢄදݱͷղऍ [Faruqui+, 2015] •
ߴ࣍ݩͰૄϕΫτϧʹม • ಛྔͱͯ͠ղऍ͍͢͠ 3 -
୯ޠλΠϓΛڞى͢Δ୯ޠͷଟॏू߹Ͱදݱ 1୯ޠλΠϓΛͦͷલޙn୯ޠ͔ΒͳΔଟॏू߹Ͱදݱ จॻ1: ੨ ͷ Ξοϓϧ δϡʔε ͓͍͍͠ จॻ2:
ΦϥΫϧ ͱ Ξοϓϧ ΞϝϦΧ ͷ اۀ ͩ จॻ3:[ࢁས ͷ ͿͲ͏ δϡʔε ҿΈ ͍͢] ↓ Ξοϓϧ = [੨, ͷ, δϡʔε, , ΦϥΫϧ, ͱ, , ΞϝϦΧ] ྫɿલޙ2୯ޠͷ߹ 6 -
୯ޠλΠϓΛڞى͢Δ୯ޠͷଟॏू߹Ͱදݱ Ծઆ͔Βࣅͨ୯ޠࣅͨଟॏू߹ʹͳΓ͍͢ จॻ1: ੨ ͷ Ξοϓϧ δϡʔε ͓͍͍͠ จॻ2:
ΦϥΫϧ ͱ Ξοϓϧ ΞϝϦΧ ͷ اۀ ͩ จॻ3:[ࢁས ͷ ͿͲ͏ δϡʔε ҿΈ ͍͢] ↓ Ξοϓϧ = [੨, ͷ, δϡʔε, , ΦϥΫϧ, ͱ, , ΞϝϦΧ] ͿͲ͏ = [ࢁས, ͷ,δϡʔε, ] ྫɿલޙ2୯ޠͷ߹ 7 -
Latent Dirichlet Allocation • จॻͷ֬తੜϞσϧ [Blei+, 2003] • จॻͷ୯ޠͷڞىใ͔ΒτϐοΫΛൃݟ •
τϐοΫͰ͚݅ͮΒΕΔશ୯ޠͷ֬ • จॻͷ୯ޠͰ͚݅ͮΒΕΔτϐοΫͷ֬ 8 ػցֶश ػցֶशͱɺਓ ೳʹ͓͚Δݚ ڀ՝ͷҰͭͰɺ ਓ͕ؒࣗવʹߦͬ ͍ͯΔֶशೳྗͱ ಉ༷ͷػೳΛίϯ ϐϡʔλͰ࣮ݱʜ ݚڀ ՝ ࣝ Պֶऀ ʜ ػցֶश ਓೳ Ϟσϧ αϯϓϧ ʜ จॻσʔλ τϐοΫ τϐοΫͷ֬ -
LDAͷֶशʢτϐοΫ3ͷ߹ʣ ଟॏू߹Ͱදݱͨ͠1୯ޠΛ1จॻͱΈͳ͠ɼLDAΛֶश • ྫɿΞοϓϧ = [੨, ͷ, δϡʔε, , ΦϥΫϧ,
ͱ, , ΞϝϦΧ] 1. ୯ޠʢଟॏू߹ʣ͝ͱͷτϐοΫͷଟ߲ • ֬ͱϕΫτϧͱͯ͠ѻ͏ ྫɿΞοϓϧ = [0.3, 0.6, 0.1], ΦϥΫϧ = [0.6, 0.1, 0.3], ͿͲ͏ = [0.1, 0.7, 0.2] 2. τϐοΫ͝ͱͷ୯ޠͷଟ߲ ྫɿτϐοΫ1 = [ιϑτΣΞ:0.3, PC:0.2, ϓϩάϥϜ:0.1, …] τϐοΫ2 = [δϡʔε:0.4,ύΠ:0.2, ϑϧʔπ:0.1, …] τϐοΫ3 = [͕:0.2, ͷ:0.2, ʹ:0.1, …] 9 -
࣍ݩͷղऍ • ୯ޠͷτϐοΫͷ͕ߴ͍΄ͲɼͦͷτϐοΫΛͭ ྫɿΞοϓϧ = [0.3, 0.6, 0.1] τϐοΫͷ୯ޠͷ͕ߴ͍΄ͲɼτϐοΫΛಛ͚Δ୯ޠ τϐοΫ1
= [ιϑτΣΞ:0.3, PC:0.2, ϓϩάϥϜ:0.1, …] τϐοΫ2 = [δϡʔε:0.4, ύΠ:0.2, ϑϧʔπ:0.1, …] τϐοΫ3 = [͕:0.2, ͷ:0.2, ʹ:0.1, …] Ξοϓϧδϡʔε, ύΠ, ϑϧʔπͳͲͷ୯ޠͰಛ͚ΒΕΔ ͿͲ͏ = [0.1, 0.7, 0.2]ಉ༷ͷτϐοΫͰಛ͚ΒΕΔ ͿͲ͏ɼτϐοΫ2ͷҙຯͰΞοϓϧͱྨࣅ 10 -
ֶशσʔλͱલॲཧ ֶशσʔλ 2010ͷӳޠ൛Wikipediaͷຊจهࣄͷ1/3 ҎԼͷલॲཧͷ݁Ռ112,635୯ޠλΠϓΛ༻ લॲཧ • ස͕100Ҏ্ͷ୯ޠͷΈΛ༻ • ඇӳࣈআ •
ࣈରԠ͢Δӳ୯ޠʹม • ߴසޠͷαϒαϯϓϦϯά [Mikilov+, 2013] 13 -
ࢄදݱͷධՁํ๏ ධՁํ๏ • word similarityɿॱҐ૬ؔʹΑΔධՁ • apple tree 0.2 •
apple orange 0.7 • analogyɿਖ਼ղʹΑΔධՁ • man king woman queen ൺֱख๏ CBoWͱSkip–gram [Mikolov+, 2013] 15 -
ൺֱ࣮ݧͷ݁Ռ • word similarityͰ0.2~0.3ͷࠩ • analogyͰ0.4~0.5ͷࠩ cos: ίαΠϯྨࣅ js: δΣϯηϯγϟϊϯμΠόʔδΣϯε
16 XPSETJNJMBSJUZ BOBMPHZ EBUBTFU 84 844 843 .&/ .5 38 (PPHMF .43 $#P8 4LJQrHSBN ఏҊ๏ DPT ఏҊ๏ KT ද1ɿൺֱ࣮ݧͷ݁Ռ -
τϐοΫͷղऍɿpython • pythonͷτϐοΫͷ֬θͷߴ্͍Ґ3τϐοΫʹ • ͦΕͧΕͷτϐοΫͷ͏ͪ֬ͷߴ্͍Ґ10୯ޠ • 880ɿऄͱʮMonty Pythonʯ • 145ɿϓϩάϥϛϯά
• 732ɿߴසޠ 17 UPQJD*% В Ћ DJSDVT BSDIJWF UIF TOBLF TPGUXBSF J NPOUZ XFC JU DPCSB QSPHSBNNJOH ZPV TLFUDI EBUBCBTF CF QBMJO CBTFE IBWF MJ[BSE WJEFP B FWFOJOH TFSWFS CVU HSBJM MJOVY JG WJQFS JOUFSGBDF DBO -
τϐοΫͷղऍɿbow • bowͷτϐοΫͰα<0.2͔ͭ֬θͷߴ্͍Ґ3τϐοΫʹ • ͦΕͧΕͷτϐοΫͷ͏ͪ֬ͷߴ্͍Ґ10୯ޠ • 389ɿધɼඋͳͲ • 547ɿધ •
919ɿҥମͷ෦Ґ 18 UPQJD*% В Ћ BJSDSBGU TIJQ GBDF TQFFE TIJQT XPSO XFJHIU NFSDIBOU DBQ HVO QBUSPM TIPFT CVJMU CPBUT XFBST TIJQ OBWBM UJF NBDIJOF WFTTFMT XPSF QPXFS DSFX XFBS ESJWF DBSHP TIJSU TUFBN WFTTFM TIPVMEFS -
·ͱΊ LDAʹΑΔࢄදݱͷ֫ಘख๏ • ֬ΛϕΫτϧͱΈͳ͢ • ϕΫτϧͱͯ͠ѻ͏͜ͱɼຊධՁͰෆ͖ • ֬ͰՃࢉݮࢉʹ૬͢Δૢ࡞͕ඞཁ • ϕΫτϧͷ࣍ݩͱτϐοΫ͕ରԠ
• ޠٛʹ͍ۙτϐοΫͷ֫ಘ • Word Sense InductionͷԠ༻ 19