$30 off During Our Annual Pro Sale. View Details »

論文紹介: Neural Relation Extraction for Knowledge Base Enrichment (ACL2019)

Koji Matsuda
September 27, 2019

論文紹介: Neural Relation Extraction for Knowledge Base Enrichment (ACL2019)

Koji Matsuda

September 27, 2019
Tweet

More Decks by Koji Matsuda

Other Decks in Research

Transcript

  1. Neural Relation Extraction for
    Knowledge Base Enrichment
    Bayu Distiawan Trisedya, Gerhard Weikum,
    Jianzhong Qi, Rui Zhang
    ACL 2019
    ঺հऀ: দాߞ࢙ (ཧݚAIP/౦๺େ)
    ୈ11ճ࠷ઌ୺ NLP ษڧձ (γϣʔτ࿮)
    εϥΠυதͷਤද͸ಛʹ஫ऍ͕ͳ͍ݶΓ࿦จ͔ΒͷҾ༻Ͱ͢
    1
    YAGOͷ։ൃऀ

    View Slide


  2. • MEKG'"$) >9
    GD
    – KG Enrichment
    • =1 (: Seq2Seq

    2
    • @C
    – ?F#-*>986IB!0'
    '34L<
    – K7IB JA;",+&,

    n-gram Attention
    – ?F#-*5).+/*/
    % Precision:H
    2

    View Slide

  3. : (Wikidata)
    3

    View Slide

  4. KG Enrichment Information
    Extraction
    ΤϯςΟςΟͱؔ܎Λ WikidataͷIDʹਖ਼نԽ͍ͨ͠
    NED => ؔ܎நग़ ͳύΠϓϥΠϯ͕ϕʔεϥΠϯ
    4

    View Slide

  5. :


    New York University is a private university in Manhattan.
    Encoder (LSTM)
    N-gram Attention
    Decoder (LSTM)
    Triple Classifier

    ޻෉ᶄ
    ޻෉ᶅ
    Joint Embedding
    ޻෉ᶃ
    ೖྗจ
    ग़ྗ
    5
    ೖग़ྗͷϖΞ͸ Distant SupervisionͰੜ੒

    View Slide

  6. : KG


    • TransE + Skip-gram
    – Anchor Context Model [Yamada 16]
    6
    New York University is a private
    university in Manhattan
    Q49210 is a Q902104 in Q11299
    J = +

    View Slide

  7. : N-gram Attention

    Entity-mention

    – ”New York University”
    • “New York”, “York University” …
    7
    3-gram·Ͱͷn-gram

    View Slide

  8. : Triple Classifier
    • 5<"+(/
    5<
    (-%
    – 9: Manhattan>
    • TransE '- 04&,)-=
    7@23$#*!&-
    6;.>
    – (h + r – t)
    – .>: Negative Sample 81?
    8

    View Slide


  9. • ;87/! Distant Supervision
    – Co-reference
    – -4#(6#'
    3
    2
    • ;8!*) .,
    &!'1
    – $
    ;8!9
    • ) .,0:
    "%
    + (533.5)
    9

    View Slide


  10. 10
    ύΠϓϥΠ
    ϯ͸μϝ
    N-gram
    Attention͸
    ޮՌൃش
    ClassifierͰ
    Precisionվળ

    View Slide


  11. New York University is a private university in Manhattan.
    Encoder (LSTM)
    N-gram Attention
    Decoder (LSTM)
    Triple Classifier

    ޻෉ᶄ
    ޻෉ᶅ
    Joint Embedding
    ޻෉ᶃ
    ೖྗจ
    ग़ྗ
    11
    ೖग़ྗͷϖΞ͸ Distant SupervisionͰੜ੒

    View Slide


  12. • !

    – DS train/test

    test
    12

    View Slide