Upgrade to Pro — share decks privately, control downloads, hide ads and more …

意味役割ラベリング

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers.
Avatar for Kyao Kyao
June 28, 2022

 意味役割ラベリング

次のサイトの2021年12月29日版の資料を参考にさせていただいております.
https://web.stanford.edu/~jurafsky/slp3/19.pdf

Avatar for Kyao

Kyao

June 28, 2022

More Decks by Kyao

Other Decks in Technology

Transcript

  1. $IBQUFS 4FNBOUJD3PMF-BCFMJOH #/BPLJ,PKJNB Speech and Language Processing. Draft of Dec

    29, 2021. Copyright © 2021 Daniel Jurafsky & James H. Martin. All Rights Reserved. 
  2. 1VSQPTF w ͭͷࣄ৅Λදݱ͢Δจ͸ෳ਺͋Δ w9:;DPSQPSBUJPOCPVHIUUIFTUPDL w5IFZTPMEUIFTUPDLUP9:;DPSQPSBUJPO w5IFTUPDLXBTCPVHIUCZ9:;DPSQPSBUJPO w5IFQVSDIBTFPGUIFTUPDLCZ9:;DPSQPSBUJPOʜ w5IFTUPDLQVSDIBTFCZ9:;DPSQPSBUJPOʜ ˠʮߪೖΠϕϯτͰɼࢀՃऀ͸9:;ࣾͱגͰɼങ͍ख͸9:;ࣾʯ w

    දݱͷҙຯ໾ׂʢ4FNBOUJD3PMFTʣΛଊ͑ΔͨΊʹ
 ˠจͷߏ଄Λ෼ղͯ͠ҙຯ໾ׂΛϥϕϦϯάʢ4FNBOUJD3PMF-BCFMJOHʣ w 1SPQ#BOL΍'SBNF/FU w ड़ޠʹର͢ΔҾ਺ͷදݱͷબ୒੍໿ʢ4FMFDUJPOBM3FTUSJDUJPOTʣ  FYʣ
  3. 4FNBOUJD3PMFT w /FP%BWJETPOJBOFWFOUSFQSFTFOUBUJPO FYʣ4BTIBCSPLFUIFXJOEPX  1BUPQFOFEUIFEPPS  #SFBLͷओޠ͸ʮ#SFBLFSʯ 0QFOͷओޠ͸ʮ0QFOFSʯͳͲʜ ˠ%FFQSPMFTಈࢺʹର͢Δ߲ͷҙຯؔ܎

    w ڞ௨఺ w ͭͷΠϕϯτʹ͸ҙࢤͷ͋Δߦҝऀʢ"(&/5ʣ͕͍Δ ∃e, x, y Breaking(e) ∧ Breaker(e, Sasha) ∧ BrokenThing(e, y) ∧ Window(y) ∃e, x, y Opening(e) ∧ Opener(e, Pat) ∧ OpenedThing(e, y) ∧ Door(y) 
  4. %JBUIFTJT"MUFSOBUJPOT w 4FNBOUJD3PMFTͷޮՌ w ղੳπϦʔͳͲͰ͸ෆՄೳͳਪ࿦ΛՄೳ w ػց຋༁ʹ͓͚Δதؒݴޠͱͯ͠ػೳ w 5IFNBUJDHSJEʢ HSJE

    DBTFGSBNF ֨ϑϨʔϜ ड़ޠϑϨʔϜʣ w ಈࢺΛج४ͱͨ͠5IFNBUJD3PMFͷू߹ θ  ಈࢺͷUIFNBUJDHJSE CSFBLˠ"(&/5 5)&.& */4536.&/5 HJWFˠ"(&/5 5)&.& (0"-
  5. 4FNBOUJD3PMFT1SPCMFNTXJUI5IFNBUJD3PMFT w ໰୊఺ w 5IFNBUJD3PMFTͷఆ͕ٛࠔ೉
 FYʣ*/4536.&/5͸ओମͰ͋ΔϞϊͱͦ͏Ͱͳ͍Ϟϊ
 "(&/5͸༗ੜੑɼҙࢤੑɼײ֮ੑɼҼՌؔ܎
 શͯඋ͍͑ͯΔͱݶΒͳ͍ w ղܾࡦ

     ಛఆͷ5IFNBUJD3PMFTΛந৅Խͯ͠ఆٛ
 13050"(&/5ࣗൃతͳಈ࡞͢Δऀ
 130501"5*&/5ӨڹΛड͚ΔϞϊ  ಛఆͷಈࢺ΍໊ࢺͷάϧʔϓʹಛԽͨ͠5IFNBUJD3PMFTΛఆٛ
 FYʣ1SPQ#BOL 'SBNF/FU 
  6. 5IF1SPQPTJUJPO#BOL  w FYʣ ˠҟͳΔදݱͰ͋ͬͯ΋ਪ࿦ͯ͠จͷҰ؏ͨ͠ҙຯ৘ใΛ֫ಘ "SH.Tम০΍෇ՃతҙຯΛࢦ͢Ҿ਺ "SH.T ҙຯ ྫ "SH.5.1

    XIFO ZFTUFSEBZFWFOJOH OPX -0$ XIFSF BUUIFNVTFVN JO4BO'SBODJTDP %*3 XIFSFUPGSPN EPXO UP#BOHLPL ./3 IPX DMFBSMZ XJUINVDIFOUIVTJBTN 131$"6 XIZ CFDBVTFʜ JOSFTQPOTFUPUIFSVMJOH 3&$ UIFNTFMWFT FBDIPUIFS "%7 NJTDFMMBOFPVT 13% TFDPOEBSZQSFEJDBUJPO ʜBUFUIFNFBUSBX
  7. 'SBNF/FU  w 'SBNFͱ͸શମతͳഎܠ஌ࣝͰ෼ྨͨ͠୯ޠͷू߹ w FYʣ (19.20) [ITEM Oil] rose

    [ATTRIBUTE in price] [DIFFERENCE by 2%] . (19.21) [ITEM It] has increased [FINAL_STATE to having them 1 day a month] . (19.22) [ITEM Microsoft shares] fell [FINAL_VALUE to 7 5/8] . (19.23) [ITEM Colon cancer incidence] fell [DIFFERENCE by 50%] [GROUP among men] . (19.24) a steady increase [INITIAL_VALUE from 9.5] [FINAL_VALUE to 14.3] [ITEM in dividends] . (19.25) a [DIFFERENCE 5%] [ITEM dividend] increase . . . w SJTF JODSFBTF GBMMͳͲΛߏ੒͢ΔGSBNFͷத਎ w ଠࣈɿεϩοτ w ࡉࣈɿ஋
  8. 4FNBOUJD3PMF-BCFMJOH  w จதͷ֤ड़ޠͷ֤Ҿ਺ͷҙຯ໾ׂΛࣗಈతʹݟ͚ͭΔ w ڭࢣ͋Γֶश w 'SBNF/FUݻ༗ͷϑϨʔϜཁૉ w 1SPQ#BOLಈࢺݻ༗ͷϥϕϧͱ"SH.T

    "'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH w ୯७ͳಛ௃ϕʔεͷΞϧΰϦζϜ ˡߏจղੳ໦ ˡಛ௃நग़ ˡ෼ྨ
  9. "'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH  $-"44*':/0%&ؔ਺  1SVOJOHʢႩఆʣ
 ड़ޠͷҾ਺ʹͳΒͳͦ͏ͳߏ੒ཁૉΛࢬ੾Γ  *EFOUJfiDBUJPOʢࣝผʣ
 ֤ϊʔυΛϥϕϦϯά͞ΕΔҾ਺͔/0/&ʹೋ஋Խ 

    $MBTTJfiDBUJPOʢ෼ྨʣ
 ϥϕϦϯά͞ΕͨҾ਺ͷશߏ੒ཁૉΛSPMFTʹ෼ྨ  (MPCBM0QUJNJ[BUJPOʢେҬ࠷దղʣ
 ෳ਺ͷ෼ྨث͔ΒϥϕϧީิΛಘͯ࠷దղΛٻΊΔ w ಛ௃ͷ༗ޮར༻ w ܭࢉޮ཰޲্ ໰୊ɿෳ਺ͷ3PMFͷϥϕϦϯά͕ڐ͞Εͳ͍ʢہॴ࠷దղͱͳͬͯ͠·͏ʣ ˠղܾࡦͱͯ͠௥Ճ͞ΕΔ ࣮૷ɿϏλϏΞϧΰϦζϜɼ࠷ॱҐ෇͚ɼ*-1ʢ੔਺ઢܗܭը๏ʣ
  10. "'FBUVSFCBTFE"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH  w FYʣ ʣ<5IF4BO'SBODJTDP&YNBJOFS>JTTVFE<BTQFDJBMFEJUJPO><ZFTUFSEBZ> "3(5"3(&5"3("3(.5.1 Arg0 : [issued, NP,

    Examiner, NNP, NP ↑ S ↓ VP ↓ VBD, active, before, VP → NP PP, ORG, The, Examiner] w Ұൠతͳجຊಛ௃ͷςϯϓϨʔτ w ड़ޠ w ߏ੒ཁૉͷϑϨʔζλΠϓʢ/1 4 11ʣ w ݟग़͠ޠʢIFBEXPSEʣͱͦͷ඼ࢺʢ//1ʣ w ߏ੒ཁૉ͔Βड़ޠʹࢸΔߏจղੳπϦʔͷύεFUDʜ w ઌͷ/1ͷ"SHʹ͍ͭͯͷಛ௃ϕΫτϧ ߏจղੳ໦ʢ1SPQ#BOLʣ
  11. "/FVSBM"MHPSJUINGPS4FNBOUJD3PMF-BCFMJOH  w γϯϓϧͳχϡʔϥϧΞϓϩʔν w #*0ΞϓϩʔνΛ༻͍Δʢষʣ 43-ͷ෼෍Ͱ ֎෦ʹड़ޠΛ௥Ճ w #ͱ*Λ֨3PMFͷ։࢝λάͱऴྃλά

    w 0Λ֎෦λά ධՁํ๏ w ֤Ҿ਺ͷϥϕϦϯάͷධՁ w 1SFDJTJPOɼ3FDBMMɼ'஋ w ࣝผͱ෼ྨ͝ͱʹධՁ w ධՁʹ༻͍ΒΕΔσʔληοτ w $P/-- w $P/--
  12. 4FMFDUJPOBM3FTUSJDUJPOT  w 4FMFDUJPOBM3FTUSJDUJPOTʢબ୒੍໿ʣ w ड़ޠͱͦͷҾ਺ʹର͢Δҙຯ্ͷ੍໿ w FYʣʮ*XBOUUPFBUTPNFQMBDFOFBSCZʯ  FBU͸ࣗಈࢺɼTPNFQMBDFOFBSCZ͸ิॿޠˠʮࢲ͸ۙ͘ͷͲ͔͜Ͱ৯΂͍ͨʯ

     FBU͸ଞಈࢺɼTPNFQMBDFOFBSCZ͸໨తޠˠʮࢲ͸ۙ͘ͷͲ͔͜Λ৯΂͍ͨʯ w ड़ޠͷҙຯʹΑͬͯҾ਺ͷҙຯ͕ݶΒΕΔ w  5IFSFTUBVSBOUTFSWFTHSFFOMJQQFENVTTFMTˠ5)&.&͸৯΂෺ʹݶఆ w  8IJDIBJSMJOFTTFSWF%FOWFS ˠ5)&.&͸৔ॴʹݶఆ w  *OSFIFBSTBM *PGUFOBTLUIFNVTJDJBOTUPJNBHJOFBUFOOJTHBNF
 ˠ"(&/5ʹ͸ਓؒ΍ੜ෺ʹݶఆʢݫີʣɼ5)&.&͸੍໿͸΄΅ͳ͠ w  3BEPOJTBOPEPSMFTTHBTUIBUDBO`UCFEFUFDUFEIVNBOTFOTFT
 ˠम০͢ΔҾ਺͸೏͍Λ࣋ͭϞϊʹݶఆ w  5PEJBHPOBMJ[FBNBUSJYJTUPfiOEJUTFJHFOWBMVFTˠ5)&.&͸ߦྻͷΈ
  13. 3FQSFTFOUJOH4FMFDUJPOBM3FTUSJDUJPOT  w /FP%BWJETPOJBOFWFOUSFQSFTFOUBUJPOΛ༻੍͍ͨ໿ FYʣ  w ׬શͳ߹ཧతͳදݱ w ໰୊఺

    w ୯७ͳܗࣜͰ͸͋Δ͕ɼܭࢉίετ͕ߴ͍ w େن໛ͳ࿦ཧతͳ஌ࣝϕʔε͕ඞཁͰ։ൃத w ղܾࡦ w ड़ޠͷҾ਺ʹ8PSE/FUͷTZOTFUΛࢦ͢
 ˠTZOTFUͷIZQPOZNʹߦ͖ண͘ w ্هͷྫͷ৔߹ w \GPPE OVUSJFOU^ʹઃఆ͢Δ ∃e, x, y Eating(e) ∧ Agent(e, x) ∧ Theme(e, y) ∧ EdibleThing(y) ∧ Hamburger(y) ੍໿ͱͯ͠௥Ճ FBUBIBNCVSHFSͷͱ͖ʹ௥Ճ IBNCVSHFSʹ͓͚ΔTZOTFU
  14. 4FMFDUJPOBM1SFGFSFODFT  w Ҿ਺΁ͷ੍໿Λݫີʹ࣮ͯ͠૷͞Ε͍͕ͯͨɼਖ਼͘͠ϥϕϦϯάͰ͖ͳ͍͜ͱ͕͋Δ
 ˠॊೈͳ੍໿΁ w 4FMFDUJPOBM"TTPDJBUJPO w ͱ ͷ֬཰෼෍ͷٙڑ཭ʢ,-%JWFSHFODFʣͰ3PMFͷબߟͷڧ౓Λఆٛ

    w  ͕ͱΔҾ਺ͷՄೳੑ w ड़ޠͱҾ਺ͷҙຯΫϥεͷؔ࿈ੑʢ4FMFDUJPOBM"TTPDJBUJPOʣ P(c) P(c|v) SR (v) v AR (v, c) D(P||Q) = ∑ x P(x)log P(x) Q(x) ҙຯΫϥεɼ ಈࢺ ҙຯΫϥεͷ֬཰  ͕༩͑ΒΕͨͱ͖ͷҙຯΫϥεͷ֬཰ c v P(c) P(c|v) v SR (v) = D(P(c|v)||P(c)) = ∑ c P(c|v)log P(c|v) P(c) AR (v, c) = 1 SR (v) P(c|v)log P(c|v) P(c)  SR (v) Ұҙੑ େ খ ߴ ௿
  15. 4FMFDUJPOBM1SFGFSFODFT  w 4FMFDUJPOBM1SFGFSFODFTWJB$POEJUJPOBM1SPCBCJMJUZ w େྔͳίʔύεͷಈࢺͱ໊ࢺͷڞىճ਺ w Ҿ਺໊ࢺ  ಈࢺ

     ಛఆͷؔ܎  $PVOUؔ਺ n v r C P(n|v, r) = { C(n, v, r) C(v, r) if C(n, v, r) > 0 0 otherwise P(v|n, r) = { C(n, v, r) C(n, r) if C(n, v, r) > 0 0 otherwise w ධՁ w QTFVEPXPSEʢٙࣅ୯ޠʣจ຺ʹ͓͚Δςετ୯ޠͱແؔ܎ͷ୯ޠͷ࿈݁ޠ w FYʣESJWFʹରͯ͠ɼ໨తޠʹDBSIPVTF͕͖ͨͱ͖
 ਖ਼͍͠બ୒Λ͢Δ͔Ͳ͏͔ͰධՁʢ͜͜Ͱ͸DBSʣ w Ϛάχνϡʔυਪఆ w ਓؒͱબ୒બ޷ʢ4FMFDUJPOBM1SFGFSFODFTʣϞσϧͷબ޷ͷ૬ؔͰධՁ
  16. 1SJNJUJWF%FDPNQPTJUJPOPG1SFEJDBUFT  w ࠓ·Ͱͷ5IFNBUJD3PMFʹج͍ͮͨཁૉ෼ղΛࡉ෼Խͨ͠΋ͷΛ
 1SJNJUJWF%FDPNQPTJUJPO·ͨ͸$PNQPOFOUJBMBOBMZTJTͱݺͿ w ಈࢺLJMMʹ͓͍ͯ FYʣ  +JNLJMMFEIJTQIJMPEFOESPO

      +JNEJETPNFUIJOHUPDBVTFIJTQIJMPEFOESPOUPCFDPNFOPUBMJWF ˠ  w જࡏతͳҙຯૉʢ4FNBOUJD1SJNJUJWFTʣͷू߹ͰදݱͰ͖Δ FYʣ           KILL(x, y) ⇔ CAUSE(x, BECOME(NOT(ALIVE(y)))) John opened the door . ⇒ CAUSE(John, BECOME(OPEN(door))) The door opened . ⇒ BECOME(OPEN(door)) The door is open . ⇒ OPEN(door) ʢݪ࢝త෼ղʣ ʢߏ੒ཁૉ෼ղʣ
  17. 1SJNJUJWF%FDPNQPTJUJPOPG1SFEJDBUFT  w $PODFQUVBM%FQFOEFODZʢ֓೦ґଘʣ
 छͷݪ࢝ड़ޠͷू߹ʢݴޠड़ޠ෼ղΞϓϩʔνʣ w CSPVHIUΛ"53"/4ͱ153"/4ʹม׵
 ∃x, y Atrans(x)

    ∧ Actor(x, Waiter) ∧ Object(x, Check) ∧ To(x, Mary) ∧ Ptrans(y) ∧ Actor(y, Waiter) ∧ Object(y, Check) ∧ To(y, Mary)
  18. 4VNNBSZ  w ҙຯ໾ׂʢ4FNBOUJD3PMFʣͱ͸ɼड़ޠʹΑͬͯهड़͞ΕΔࣄ৅ʹ͓͍ͯɼ
 Ҿ਺͕Ռͨ͢໾ׂͷந৅తͳϞσϧɽ w ओ୊໾ׂʢ5IFNBUJD3PMFʣ͸ɼ༗ݶͷ໾ׂϦετʹجͮ͘ҙຯ໾ׂͷϞσϧɽ w ҙຯ໾ׂϥϕϦϯάʢ4FNBOUJD3PMF-BCFMJOHʣ͸จͷߏ੒ཁૉʹҙຯ໾ׂ
 ϥϕϧΛ෇༩͢ΔλεΫ

    w ڭࢣ͋ΓֶशλεΫͱͯ͠1SPQ#BOL΍'SBNF/FUͱ͍͏ϞσϧͰֶश͞ΕΔɽ w จͷղੳ͔Β࢝·Γɼ֤ղੳ໦ϊʔυʹࣗಈతʹҙຯ໾ׂͷλάΛ෇༩͢Δɽ w બ୒੍໿ʢ4FMFDUJPOBM3FTUSJDUJPOTʣʹΑΓɼड़ޠ͸ͦͷҾ਺ͷ୯ޠͷҙຯಛੑʹ
 ର͢Δ੍໿ΛܝࣔͰ͖Δɽ w બ୒બ޷ʢ4FMFDUJPOBM1SFGFSFODFʣϞσϧ͸ड़ޠͱҾ਺ͷ୯ޠ΍Ϋϥεͱͷؒͷؔ ࿈ʹॏΈ෇͚΍֬཰ΛׂΓ౰ͯΔ͜ͱ͕Ͱ͖Δ