Share
Embed
意味役割ラベリング
次のサイトの2021年12月29日版の資料を参考にさせていただいております.
https://web.stanford.edu/~jurafsky/slp3/19.pdf
Kyao
June 28, 2022
Transcript
24 slides
-
$IBQUFS 4FNBOUJD3PMF-BCFMJOH #/BPLJ,PKJNB Speech and Language Processing. Draft of Dec
29, 2021. Copyright © 2021 Daniel Jurafsky & James H. Martin. All Rights Reserved. -
1VSQPTF w ͭͷࣄΛදݱ͢Δจෳ͋Δ w9:;DPSQPSBUJPOCPVHIUUIFTUPDL w5IFZTPMEUIFTUPDLUP9:;DPSQPSBUJPO w5IFTUPDLXBTCPVHIUCZ9:;DPSQPSBUJPO w5IFQVSDIBTFPGUIFTUPDLCZ9:;DPSQPSBUJPOʜ w5IFTUPDLQVSDIBTFCZ9:;DPSQPSBUJPOʜ ˠʮߪೖΠϕϯτͰɼࢀՃऀ9:;ࣾͱגͰɼങ͍ख9:;ࣾʯ w
දݱͷҙຯׂʢ4FNBOUJD3PMFTʣΛଊ͑ΔͨΊʹ ˠจͷߏΛղͯ͠ҙຯׂΛϥϕϦϯάʢ4FNBOUJD3PMF-BCFMJOHʣ w 1SPQ#BOL'SBNF/FU w ड़ޠʹର͢ΔҾͷදݱͷબ੍ʢ4FMFDUJPOBM3FTUSJDUJPOTʣ FYʣ -
4FNBOUJD3PMFT w /FP%BWJETPOJBOFWFOUSFQSFTFOUBUJPO FYʣ4BTIBCSPLFUIFXJOEPX 1BUPQFOFEUIFEPPS #SFBLͷओޠʮ#SFBLFSʯ 0QFOͷओޠʮ0QFOFSʯͳͲʜ ˠ%FFQSPMFTಈࢺʹର͢Δ߲ͷҙຯؔ
w ڞ௨ w ͭͷΠϕϯτʹҙࢤͷ͋Δߦҝऀʢ"(&/5ʣ͕͍Δ ∃e, x, y Breaking(e) ∧ Breaker(e, Sasha) ∧ BrokenThing(e, y) ∧ Window(y) ∃e, x, y Opening(e) ∧ Opener(e, Pat) ∧ OpenedThing(e, y) ∧ Door(y) -
%JBUIFTJT"MUFSOBUJPOT w 4FNBOUJD3PMFTͷޮՌ w ղੳπϦʔͳͲͰෆՄೳͳਪΛՄೳ w ػց༁ʹ͓͚Δதؒݴޠͱͯ͠ػೳ w 5IFNBUJDHSJEʢ HSJE
DBTFGSBNF ֨ϑϨʔϜ ड़ޠϑϨʔϜʣ w ಈࢺΛج४ͱͨ͠5IFNBUJD3PMFͷू߹ θ ಈࢺͷUIFNBUJDHJSE CSFBLˠ"(&/5 5)&.& */4536.&/5 HJWFˠ"(&/5 5)&.& (0"- -
%JBUIFTJT"MUFSOBUJPOT w 7FSC"MUFSOBUJPOTʢಈࢺަସʣ·ͨ%JBUIFTJT"MUFSOBUJPOTʢૉ࣭ަସʣ w ಈࢺΛج४ʹUIFNBUJDHSJEͰෳͷҾߏͰ࣮ݱͰ͖Δ w CSFBLˠओޠʹ"(&/5 5)&.& */4536.&/5Λ༻͍Δ͜ͱ͕Ͱ͖Δ w
HJWFˠ(0"- 5)&.&ͷॱংΛೖΕସ͑ͯҙຯಉ͡ w 7FSC/FU7FSC"MUFSOBUJPOTʹରԠͨ͠σʔλϕʔε -
4FNBOUJD3PMFT1SPCMFNTXJUI5IFNBUJD3PMFT w w 5IFNBUJD3PMFTͷఆ͕ٛࠔ FYʣ*/4536.&/5ओମͰ͋ΔϞϊͱͦ͏Ͱͳ͍Ϟϊ "(&/5༗ੜੑɼҙࢤੑɼײ֮ੑɼҼՌؔ શͯඋ͍͑ͯΔͱݶΒͳ͍ w ղܾࡦ
ಛఆͷ5IFNBUJD3PMFTΛநԽͯ͠ఆٛ 13050"(&/5ࣗൃతͳಈ࡞͢Δऀ 130501"5*&/5ӨڹΛड͚ΔϞϊ ಛఆͷಈࢺ໊ࢺͷάϧʔϓʹಛԽͨ͠5IFNBUJD3PMFTΛఆٛ FYʣ1SPQ#BOL 'SBNF/FU -
5IF1SPQPTJUJPO#BOL w 1SPQPTJUJPO#BOLʢ1SPQ#BOLʣ w ݸʑͷಈࢺͷҙຯʹରͯ͠Ҿͷ4FNBOUJD3PMFTΛఆٛ w "SH13050"(&/5 w "SH130501"5*&/5 w
"SHdಈࢺ͝ͱʹҟͳΔ w FYʣ GBMMͷओޠ130501"5*&/5 ˠ"SH͕ͳ͍ -
5IF1SPQPTJUJPO#BOL w FYʣ ˠҟͳΔදݱͰ͋ͬͯਪͯ͠จͷҰ؏ͨ͠ҙຯใΛ֫ಘ "SH.Tम০ՃతҙຯΛࢦ͢Ҿ "SH.T ҙຯ ྫ "SH.5.1
XIFO ZFTUFSEBZFWFOJOH OPX -0$ XIFSF BUUIFNVTFVN JO4BO'SBODJTDP %*3 XIFSFUPGSPN EPXO UP#BOHLPL ./3 IPX DMFBSMZ XJUINVDIFOUIVTJBTN 131$"6 XIZ CFDBVTFʜ JOSFTQPOTFUPUIFSVMJOH 3&$ UIFNTFMWFT FBDIPUIFS "%7 NJTDFMMBOFPVT 13% TFDPOEBSZQSFEJDBUJPO ʜBUFUIFNFBUSBX -
'SBNF/FU w 'SBNFͱશମతͳഎܠࣝͰྨͨ͠୯ޠͷू߹ w FYʣ (19.20) [ITEM Oil] rose
[ATTRIBUTE in price] [DIFFERENCE by 2%] . (19.21) [ITEM It] has increased [FINAL_STATE to having them 1 day a month] . (19.22) [ITEM Microsoft shares] fell [FINAL_VALUE to 7 5/8] . (19.23) [ITEM Colon cancer incidence] fell [DIFFERENCE by 50%] [GROUP among men] . (19.24) a steady increase [INITIAL_VALUE from 9.5] [FINAL_VALUE to 14.3] [ITEM in dividends] . (19.25) a [DIFFERENCE 5%] [ITEM dividend] increase . . . w SJTF JODSFBTF GBMMͳͲΛߏ͢ΔGSBNFͷத w ଠࣈɿεϩοτ w ࡉࣈɿ -
'SBNF/FU w ϑϨʔϜؒͷؔΛίʔυԽͯ͠ܧঝɼҼՌؔΛ࣮ݱ FYʣDBVTF@DIBOHF@QPTJUJPO@PO@B@TDBMF DIBOHF@QPTJUJPO@PO@B@TDBMFͱݪҼؔ w શͯͷಈࢺ͓Αͼ໊ࢺͷҼՌؔɼඇҼՌؔͷڞ௨ΠϕϯτͷҙຯΛநग़Ͱ͖Δ (19.26) [AGENT
They] raised [ITEM the price of their soda] [DIFFERENCE by 2%] . -
4FNBOUJD3PMF-BCFMJOH w จதͷ֤ड़ޠͷ֤ҾͷҙຯׂΛࣗಈతʹݟ͚ͭΔ w ڭࢣ͋Γֶश w 'SBNF/FUݻ༗ͷϑϨʔϜཁૉ w 1SPQ#BOLಈࢺݻ༗ͷϥϕϧͱ"SH.T
"'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH w ୯७ͳಛϕʔεͷΞϧΰϦζϜ ˡߏจղੳ ˡಛநग़ ˡྨ -
"'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH $-"44*':/0%&ؔ 1SVOJOHʢႩఆʣ ड़ޠͷҾʹͳΒͳͦ͏ͳߏཁૉΛࢬΓ *EFOUJfiDBUJPOʢࣝผʣ ֤ϊʔυΛϥϕϦϯά͞ΕΔҾ͔/0/&ʹೋԽ
$MBTTJfiDBUJPOʢྨʣ ϥϕϦϯά͞ΕͨҾͷશߏཁૉΛSPMFTʹྨ (MPCBM0QUJNJ[BUJPOʢେҬ࠷దղʣ ෳͷྨث͔ΒϥϕϧީิΛಘͯ࠷దղΛٻΊΔ w ಛͷ༗ޮར༻ w ܭࢉޮ্ ɿෳͷ3PMFͷϥϕϦϯά͕ڐ͞Εͳ͍ʢہॴ࠷దղͱͳͬͯ͠·͏ʣ ˠղܾࡦͱͯ͠Ճ͞ΕΔ ࣮ɿϏλϏΞϧΰϦζϜɼ࠷ॱҐ͚ɼ*-1ʢઢܗܭը๏ʣ -
"'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH w FYʣ ʣ<5IF4BO'SBODJTDP&YNBJOFS>JTTVFE<BTQFDJBMFEJUJPO><ZFTUFSEBZ> "3(5"3(&5"3("3(.5.1 Arg0 : [issued, NP,
Examiner, NNP, NP ↑ S ↓ VP ↓ VBD, active, before, VP → NP PP, ORG, The, Examiner] w ҰൠతͳجຊಛͷςϯϓϨʔτ w ड़ޠ w ߏཁૉͷϑϨʔζλΠϓʢ/1 4 11ʣ w ݟग़͠ޠʢIFBEXPSEʣͱͦͷࢺʢ//1ʣ w ߏཁૉ͔Βड़ޠʹࢸΔߏจղੳπϦʔͷύεFUDʜ w ઌͷ/1ͷ"SHʹ͍ͭͯͷಛϕΫτϧ ߏจղੳʢ1SPQ#BOLʣ -
"/FVSBM"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH w γϯϓϧͳχϡʔϥϧΞϓϩʔν w #*0ΞϓϩʔνΛ༻͍Δʢষʣ 43-ͷͰ ֎෦ʹड़ޠΛՃ w #ͱ*Λ֨3PMFͷ։࢝λάͱऴྃλά
w 0Λ֎෦λά ධՁํ๏ w ֤ҾͷϥϕϦϯάͷධՁ w 1SFDJTJPOɼ3FDBMMɼ' w ࣝผͱྨ͝ͱʹධՁ w ධՁʹ༻͍ΒΕΔσʔληοτ w $P/-- w $P/-- -
4FMFDUJPOBM3FTUSJDUJPOT w 4FMFDUJPOBM3FTUSJDUJPOTʢબ੍ʣ w ड़ޠͱͦͷҾʹର͢Δҙຯ্ͷ੍ w FYʣʮ*XBOUUPFBUTPNFQMBDFOFBSCZʯ FBUࣗಈࢺɼTPNFQMBDFOFBSCZิॿޠˠʮࢲۙ͘ͷͲ͔͜Ͱ৯͍ͨʯ
FBUଞಈࢺɼTPNFQMBDFOFBSCZతޠˠʮࢲۙ͘ͷͲ͔͜Λ৯͍ͨʯ w ड़ޠͷҙຯʹΑͬͯҾͷҙຯ͕ݶΒΕΔ w 5IFSFTUBVSBOUTFSWFTHSFFOMJQQFENVTTFMTˠ5)&.&৯ʹݶఆ w 8IJDIBJSMJOFTTFSWF%FOWFS ˠ5)&.&ॴʹݶఆ w *OSFIFBSTBM *PGUFOBTLUIFNVTJDJBOTUPJNBHJOFBUFOOJTHBNF ˠ"(&/5ʹਓؒੜʹݶఆʢݫີʣɼ5)&.&੍΄΅ͳ͠ w 3BEPOJTBOPEPSMFTTHBTUIBUDBO`UCFEFUFDUFEIVNBOTFOTFT ˠम০͢ΔҾ͍Λ࣋ͭϞϊʹݶఆ w 5PEJBHPOBMJ[FBNBUSJYJTUPfiOEJUTFJHFOWBMVFTˠ5)&.&ߦྻͷΈ -
3FQSFTFOUJOH4FMFDUJPOBM3FTUSJDUJPOT w /FP%BWJETPOJBOFWFOUSFQSFTFOUBUJPOΛ༻੍͍ͨ FYʣ w શͳ߹ཧతͳදݱ w
w ୯७ͳܗࣜͰ͋Δ͕ɼܭࢉίετ͕ߴ͍ w େنͳཧతͳࣝϕʔε͕ඞཁͰ։ൃத w ղܾࡦ w ड़ޠͷҾʹ8PSE/FUͷTZOTFUΛࢦ͢ ˠTZOTFUͷIZQPOZNʹߦ͖ண͘ w ্هͷྫͷ߹ w \GPPE OVUSJFOU^ʹઃఆ͢Δ ∃e, x, y Eating(e) ∧ Agent(e, x) ∧ Theme(e, y) ∧ EdibleThing(y) ∧ Hamburger(y) ੍ͱͯ͠Ճ FBUBIBNCVSHFSͷͱ͖ʹՃ IBNCVSHFSʹ͓͚ΔTZOTFU -
4FMFDUJPOBM1SFGFSFODFT w Ҿͷ੍Λݫີʹ࣮ͯ͠͞Ε͍͕ͯͨɼਖ਼͘͠ϥϕϦϯάͰ͖ͳ͍͜ͱ͕͋Δ ˠॊೈͳ੍ w 4FMFDUJPOBM"TTPDJBUJPO w ͱ ͷ֬ͷٙڑʢ,-%JWFSHFODFʣͰ3PMFͷબߟͷڧΛఆٛ
w ͕ͱΔҾͷՄೳੑ w ड़ޠͱҾͷҙຯΫϥεͷؔ࿈ੑʢ4FMFDUJPOBM"TTPDJBUJPOʣ P(c) P(c|v) SR (v) v AR (v, c) D(P||Q) = ∑ x P(x)log P(x) Q(x) ҙຯΫϥεɼ ಈࢺ ҙຯΫϥεͷ֬ ͕༩͑ΒΕͨͱ͖ͷҙຯΫϥεͷ֬ c v P(c) P(c|v) v SR (v) = D(P(c|v)||P(c)) = ∑ c P(c|v)log P(c|v) P(c) AR (v, c) = 1 SR (v) P(c|v)log P(c|v) P(c) SR (v) Ұҙੑ େ খ ߴ -
4FMFDUJPOBM1SFGFSFODFT w 4FMFDUJPOBM1SFGFSFODFTWJB$POEJUJPOBM1SPCBCJMJUZ w େྔͳίʔύεͷಈࢺͱ໊ࢺͷڞىճ w Ҿ໊ࢺ ಈࢺ
ಛఆͷؔ $PVOUؔ n v r C P(n|v, r) = { C(n, v, r) C(v, r) if C(n, v, r) > 0 0 otherwise P(v|n, r) = { C(n, v, r) C(n, r) if C(n, v, r) > 0 0 otherwise w ධՁ w QTFVEPXPSEʢٙࣅ୯ޠʣจ຺ʹ͓͚Δςετ୯ޠͱແؔͷ୯ޠͷ࿈݁ޠ w FYʣESJWFʹରͯ͠ɼతޠʹDBSIPVTF͕͖ͨͱ͖ ਖ਼͍͠બΛ͢Δ͔Ͳ͏͔ͰධՁʢ͜͜ͰDBSʣ w Ϛάχνϡʔυਪఆ w ਓؒͱબબʢ4FMFDUJPOBM1SFGFSFODFTʣϞσϧͷબͷ૬ؔͰධՁ -
1SJNJUJWF%FDPNQPTJUJPOPG1SFEJDBUFT w ࠓ·Ͱͷ5IFNBUJD3PMFʹج͍ͮͨཁૉղΛࡉԽͨ͠ͷΛ 1SJNJUJWF%FDPNQPTJUJPO·ͨ$PNQPOFOUJBMBOBMZTJTͱݺͿ w ಈࢺLJMMʹ͓͍ͯ FYʣ +JNLJMMFEIJTQIJMPEFOESPO
+JNEJETPNFUIJOHUPDBVTFIJTQIJMPEFOESPOUPCFDPNFOPUBMJWF ˠ w જࡏతͳҙຯૉʢ4FNBOUJD1SJNJUJWFTʣͷू߹ͰදݱͰ͖Δ FYʣ KILL(x, y) ⇔ CAUSE(x, BECOME(NOT(ALIVE(y)))) John opened the door . ⇒ CAUSE(John, BECOME(OPEN(door))) The door opened . ⇒ BECOME(OPEN(door)) The door is open . ⇒ OPEN(door) ʢݪ࢝తղʣ ʢߏཁૉղʣ -
1SJNJUJWF%FDPNQPTJUJPOPG1SFEJDBUFT w $PODFQUVBM%FQFOEFODZʢ֓೦ґଘʣ छͷݪ࢝ड़ޠͷू߹ʢݴޠड़ޠղΞϓϩʔνʣ w CSPVHIUΛ"53"/4ͱ153"/4ʹม ∃x, y Atrans(x)
∧ Actor(x, Waiter) ∧ Object(x, Check) ∧ To(x, Mary) ∧ Ptrans(y) ∧ Actor(y, Waiter) ∧ Object(y, Check) ∧ To(y, Mary) -
4VNNBSZ w ҙຯׂʢ4FNBOUJD3PMFʣͱɼड़ޠʹΑͬͯهड़͞ΕΔࣄʹ͓͍ͯɼ Ҿ͕Ռׂͨ͢ͷநతͳϞσϧɽ w ओׂʢ5IFNBUJD3PMFʣɼ༗ݶͷׂϦετʹجͮ͘ҙຯׂͷϞσϧɽ w ҙຯׂϥϕϦϯάʢ4FNBOUJD3PMF-BCFMJOHʣจͷߏཁૉʹҙຯׂ ϥϕϧΛ༩͢ΔλεΫ
w ڭࢣ͋ΓֶशλεΫͱͯ͠1SPQ#BOL'SBNF/FUͱ͍͏ϞσϧͰֶश͞ΕΔɽ w จͷղੳ͔Β࢝·Γɼ֤ղੳϊʔυʹࣗಈతʹҙຯׂͷλάΛ༩͢Δɽ w બ੍ʢ4FMFDUJPOBM3FTUSJDUJPOTʣʹΑΓɼड़ޠͦͷҾͷ୯ޠͷҙຯಛੑʹ ର͢Δ੍ΛܝࣔͰ͖Δɽ w બબʢ4FMFDUJPOBM1SFGFSFODFʣϞσϧड़ޠͱҾͷ୯ޠΫϥεͱͷؒͷؔ ࿈ʹॏΈ͚֬ΛׂΓͯΔ͜ͱ͕Ͱ͖Δ