Share
Embed
Transcript
14 slides
-
ࣗݾհ খྛ ᕣՏ (Koga Kobayashi) ID: @kajyuuen ஜେֶେֶӃ
म࢜1 NERϒϩάΛॻ͍ͯ·͢ -
NERͷֶशʹ͑Δσʔλ Ξϊςʔγϣϯίʔύε • NERλεΫͰҰൠతʹར༻͞ΕΔσʔληοτ • ୯ޠʹରͯ͠ɼ֤ʑରԠ͢Δϥϕϧ͕༩͞Ε͍ͯΔ σϝϦοτ • υϝΠϯຖʹ࡞Γ͢ඞཁ͕͋Δ •
Ξϊςʔγϣϯʹߴ͍ίετ͕͔͔Δ Donald B-PER John I-PER Trump E-PER is O president O of O the O US S-LOC the O ΞϊςʔγϣϯίʔύεΛ࡞ΔίετΛݮΒ͢ or ແ͍ͨ͘͠ -
NERͷֶशʹ͑Δσʔλ ෦తΞϊςʔγϣϯίʔύε • Ұ෦ͷ୯ޠʹ͚ͩΞϊςʔγϣϯ͕༩͞Ε͍ͯΔίʔύε • Ξϊςʔλࣗ৴ͷͳ͍୯ޠʹΞϊςʔγϣϯ͠ͳͯ͘ࡁΉ σϝϦοτ • ֶशʹগ͕͠ඞཁ(ҰൠతͳCRFͰֶशग़དྷͳ͍)
Donald - John B-PER Trump E-PER is - president - of O the - US - the O ෦తΞϊςʔγϣϯίʔύε - Eraldo R Fernandes and Ulf Brefeld. 2011. Learning from partially annotated sequences. In Proceedings of ECML-KDD. - Andrew Carlson, Scott Gaffney, and Flavian Vasile. 2009. Learning a named entity tagger from gazetteers with the partial perceptron. In Proceedings of AAAI Spring Symposium: Learning by Reading and Learning to Read. - Jie Zhanming, Xie Pengjun, Lu Wei, Ding Ruixue and Li Linlin. 2019. Better Modeling of Incomplete Annotations for Named Entity Recognition. In Proceedings of NAACL. -
NERͷֶशʹ͑Δσʔλ ࣙॻ • ͍ΘΏΔࣙॻɼͨͩݴ༿ͷ༰ɼҙຯ·Ͱ͏͜ͱগͳ͍ • ༷ʑͳʹஔ͍ͯݩ͔Βଘࡏ͍ͯ͠Δ͜ͱ͕ଟ͍ • ਓ໊ࣙయ,
ༀֶ༻ޠࣙయ, ࣭ɾࡐྉσʔλϕʔε ࣙॻϚονʹΑΔݻ༗දݱநग़Ͱ • ࣙॻʹଘࡏ͠ͳ͍୯ޠΛݕग़Ͱ͖ͳ͍ • ݻ༗දݱʹؒҧͬͨϥϕϧ͕༩͞ΕΔ ͱ͍͕ͬͨੜ͡Δ Donald - John S-PER Trump - is - president - of - the - US - the - Person Dictionary John Michael ࣙॻϚον ࣙॻ + ੜίʔύεΛ༻͍ͨDistantly Supervisedͱ͍͏ख๏͕ग़ݱ -
ࠓճͷʹؔ͋Δจ ෦తΞϊςʔγϣϯίʔύε • Better Modeling of Incomplete Annotation for Named
Entity Recognition Distantly Supervised NER • Distantly Supervised Named Entity Recognition using Positive-Unlabeled Learning • Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning • Learning Named Entity Tagger using Domain-Specific Dictionary • Distant supervision for relation extraction without labeled data. • Distant supervision for relation extraction via piecewise convolutional neural networks. -
Better Modeling of Incomplete Annotations for Named Entity Recognition ෆશͳΞϊςʔγϣϯ͕ߦΘΕ͍ͯΔσʔλ͔ΒNERΛߦ͏ϞσϧͷఏҊ
Zhanming Jie, Pengjun Xie, Wei Lu, Ruixue Ding, Linlin Li NAACL 2019 എܠ • ෆશͳΞϊςʔγϣϯΛԾఆ͢Δࡍʹɼ ୯ޠϨϕϧͰϥϕϧΛऔΓআ͘ͷݱ࣮తͰͳ͍ (A.1) • ໌ࣔతʹOλάΛΞϊςʔγϣϯ͢Δ͜ͱແ͍ (A.1, A.2) ࣮ӡ༻Ͱى͖͏Δϥϕϧܽଛ A.3ʹͳΔͱஶऀओு https://github.com/kajyuuen/Incomplete-NER-Methods ࠶ݱ࣮͠·ͨ͠: -
Better Modeling of Incomplete Annotations for Named Entity Recognition
Zhanming Jie, Pengjun Xie, Wei Lu, Ruixue Ding, Linlin Li NAACL 2019 ௨ৗͷCRF ఏҊख๏ͷCRF ఏҊख๏ CRFΛ֦ு͠ɼऔΓ͏ΔϥϕϧͷΈ߹ΘͤΛߟྀ͢ΔϞσϧ ֬ ͷਪఆ Hard: ࠷Մೳੑͷߴ͍ϥϕϧܥྻʹ֬1ΛׂΓͯΔ Soft: ͋Γ͏Δશͯͷϥϕϧܥྻʹରͯ֬͠ΛׂΓͯΔ ͜ΕΒͷ֬kׂަࠩݕূʹΑͬͯਪఆΛߦ͏ q q = 1 CRF-PA ఏҊख๏ -
Better Modeling of Incomplete Annotations for Named Entity Recognition
Zhanming Jie, Pengjun Xie, Wei Lu, Ruixue Ding, Linlin Li NAACL 2019 ݁Ռ ݅ઃఆ: ޒׂͷϥϕϧܽଛ+શͯͷOλάΛআ • શͳΞϊςʔγϣϯ͕͍ͨͱ͖ʹൺͯ·ͣ·ͣͳੑೳΛࣔ͢ • ϥϕϧ͕͍͍ͯͳ͍ॴΛOͱͯ͠Έͳ͢Simpleʹେউར -
Distantly Supervised Named Entity Recognition using Positive-Unlabeled Learning
Minlong Peng, Xiaoyu Xing, Qi Zhang, Jinlan Fu, Xuanjing Huang ACL 2019 PUֶशΛར༻ͯࣙ͠ॻͱੜςΩετ͚ͩΛ༻͍ͯNERΛߦ͏ ఏҊख๏ • ࠷Ұக๏Λ༻͍ͯɼࣙॻ͔Βੜίʔύεʹରͯ͠ΞϊςʔγϣϯΛߦ͏ • ϥϕϧ͚͕ߦΘΕͨσʔλΛPositive, ͦΕҎ֎ΛUnlabeledͱֶͯ͠श • BIOɼBIOESͱ͍ͬͨϥϕϦϯάεΩʔϚΛར༻͠ͳ͍͜ͱͰɼ ࣙॻʹΑΔޡΞϊςʔγϣϯΛݮΒ͢͜ͱ͕ग़དྷΔ • ֤ΫϥεຖʹPUྨػΛ࡞ɼ༧ଌ͕֬࠷ߴ͍ΫϥεΛ࠾༻ -
Distantly Supervised Named Entity Recognition using Positive-Unlabeled Learning
Minlong Peng, Xiaoyu Xing, Qi Zhang, Jinlan Fu, Xuanjing Huang ACL 2019 ݁Ռ Ξϊςʔγϣϯίʔύε ࣙॻͱੜίʔύε ࣙॻϚονʹൺͯɼେ͖͘ੑೳΛ্ͤͨ͞ -
Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning
Yaosheng Yang, Wenliang Chen, Zhenghua Li, Zhengqiu He, Min Zhang COLING 2018 Distant SupervisionͱڧԽֶशͷΈ߹ΘͤʹΑΔNER ఏҊख๏ • ڧԽֶशΛ༻͍ͯnoisyͳϥϕϧ͚Λআ • CRF-PAΛ༻͍Δ͜ͱͰ imcompleteͳܥྻͰֶशΛՄೳʹ͢Δ എܠ • ࣙॻϚονʹΑͬͯ࡞ͨ͠ڭࢣσʔλ(Distant Supervision)ʹ imcomplete, noisyͳϥϕϧ͚͕ߦΘΕΔͱ͍͏͕͋Δ -
Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning
Yaosheng Yang, Wenliang Chen, Zhenghua Li, Zhengqiu He, Min Zhang COLING 2018 ݁Ռ ࣙॻϚονLSTM-CRF-PAͷΈͷ߹ʹൺͯɼߴ͍நग़ੑೳΛ࣋ͭ ͕খ͞ΊͷΞϊςʔγϣϯίʔύε ͕Distantly SupervisedʹΑͬͯ࡞ΒΕͨڭࢣσʔλ ℋ -
αʔϕΠ ײ • ෦తΞϊςʔγϣϯίʔύεΛֶश͢ΔϞσϧසൟʹݟΒΕͨ • Distantly Supervised NERͷݚڀͰ͔ͳΓͷ֬Ͱར༻ɼҾ༻͞ΕΔ • σʔληοτͲ͏͢Δͷ
• ࣗ࡞͢Δύλʔϯ͕͔ͳΓଟ͍ • CoNLL2003͔ΒϥϯμϜܽଛͤ͞ΔύλʔϯݟΔ • ͲͪΒʹ͠Ζ࠶ݱੑͷ͋ΔϥϕϧܽଛΛߦ͏͜ͱ͕͍͠ • ྲྀߦ͖͍ͬͯͯΔײ͢͡Δ • Nested NERDS NERͷΑ͏ͳෳࡶͳλεΫઃఆͷจଟ͍ • ࣙॻ͚ͩͰNERΛߦ͍͍ͨؾ࣋ͪͷਓͨͪࢁ͍ͦ͏ • ී௨ͷܥྻϥϕϦϯάλεΫʹݶք͕དྷ͍ͯΔʁ