論文紹介: Neural Relation Extraction for Knowledge Base Enrichment (ACL2019)

Transcript

1. Neural Relation Extraction for
   Knowledge Base Enrichment
   Bayu Distiawan Trisedya, Gerhard Weikum,
   Jianzhong Qi, Rui Zhang
   ACL 2019
   ঺հऀ: দాߞ࢙ (ཧݚAIP/౦๺େ)
   ୈ11ճ࠷ઌ୺ NLP ษڧձ (γϣʔτ࿮)
   εϥΠυதͷਤද͸ಛʹ஫ऍ͕ͳ͍ݶΓ࿦จ͔ΒͷҾ༻Ͱ͢
   1
   YAGOͷ։ൃऀ
   

   View Slide

2. 
   • MEKG'"$) >9
   GD
   – KG Enrichment
   • =1 (: Seq2Seq
   
   2
   • @C
   – ?F#-*>986IB!0'
   '34L<
   – K7IB JA;",+&,
   
   n-gram Attention
   – ?F#-*5).+/*/
   % Precision:H
   2
   

   View Slide

3. : (Wikidata)
   3
   

   View Slide

4. KG Enrichment Information
   Extraction
   ΤϯςΟςΟͱؔ܎Λ WikidataͷIDʹਖ਼نԽ͍ͨ͠
   NED => ؔ܎நग़ ͳύΠϓϥΠϯ͕ϕʔεϥΠϯ
   4
   

   View Slide

5. :
   
   
   New York University is a private university in Manhattan.
   Encoder (LSTM)
   N-gram Attention
   Decoder (LSTM)
   Triple Classifier
   
   ޻෉ᶄ
   ޻෉ᶅ
   Joint Embedding
   ޻෉ᶃ
   ೖྗจ
   ग़ྗ
   5
   ೖग़ྗͷϖΞ͸ Distant SupervisionͰੜ੒
   

   View Slide

6. : KG
   
   
   • TransE + Skip-gram
   – Anchor Context Model [Yamada 16]
   6
   New York University is a private
   university in Manhattan
   Q49210 is a Q902104 in Q11299
   J = +
   

   View Slide

7. : N-gram Attention
   •
   Entity-mention
   
   – ”New York University”
   • “New York”, “York University” …
   7
   3-gram·Ͱͷn-gram
   

   View Slide

8. : Triple Classifier
   • 5<"+(/
   5<
   (-%
   – 9: Manhattan>
   • TransE '- 04&,)-=
   7@23$#*!&-
   6;.>
   – (h + r – t)
   – .>: Negative Sample 81?
   8
   

   View Slide

9. 
   • ;87/! Distant Supervision
   – Co-reference
   – -4#(6#'
   3
   2
   • ;8!*) .,
   &!'1
   – $
   ;8!9
   • ) .,0:
   "%
   + (533.5)
   9
   

   View Slide

10. 
    10
    ύΠϓϥΠ
    ϯ͸μϝ
    N-gram
    Attention͸
    ޮՌൃش
    ClassifierͰ
    Precisionվળ
    

    View Slide

11. 
    New York University is a private university in Manhattan.
    Encoder (LSTM)
    N-gram Attention
    Decoder (LSTM)
    Triple Classifier
    
    ޻෉ᶄ
    ޻෉ᶅ
    Joint Embedding
    ޻෉ᶃ
    ೖྗจ
    ग़ྗ
    11
    ೖग़ྗͷϖΞ͸ Distant SupervisionͰੜ੒
    

    View Slide

12. 
    • !
    •
    – DS train/test
    
    test
    12
    

    View Slide