Modeling Fine-Grained Entity Types with Box Embeddings

Slide 1

Slide 1 text

/QFGNKPI)KPG*TCKPGF(PVKV[6[RGUYKVJ %QZ(ODGFFKPIU ;CUWOCUC1PQG/KEJCGN%QTCVMQ$PFTGY/E&CNNWO*TGI'WTTGVV 76$WUVKP7/CUU$OJGTUV*QQING4GUGCTEJ

Slide 2

Slide 2 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV )KPGITCKPGF(PVKV[6[RKPI -"/0,+ /1&01 21%,/ (PVKV[6[RGU (PVKV[/GPVKQP

Slide 3

Slide 3 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV 6X]DQQH&ROOLQV )KPGITCKPGF(PVKV[6[RKPI (PEQFGT 8GEVQT5RCEG

Slide 4

Slide 4 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV 6X]DQQH&ROOLQV )KPGITCKPGF(PVKV[6[RKPI -"/0,+ /1&01 21%,/ -"/0,+ -,)&1& &+ /1&01 (PEQFGT 䐂 6[RG(ODGFFKPIU 21%,/ 8GEVQT5RCEG

Slide 5

Slide 5 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV )KPGITCKPGF(PVKV[6[RKPI -"/0,+ /1&01 21%,/ 䐂 6[RG(ODGFFKPIU (PEQFGT 6X]DQQH&ROOLQV -"/0,+ -,)&1& &+ /1&01 21%,/ 8GEVQT5RCEG

Slide 6

Slide 6 text

+KGTCTEJKECN5VTWEVWTGKP(PVKV[6[RGU /1&01 -"/0,+ 21%,/ -,)&1& &+ *20& &+ EQCTUG ȤPG Ɣ 6[RGUGVECPDGNCTIG(I!M 7)(6&JQK

Slide 7

Slide 7 text

+KGTCTEJKECN5VTWEVWTGKP(PVKV[6[RGU /1&01 -"/0,+ 21%,/ -,)&1& &+ *20& &+ EQCTUG ȤPG Ɣ 6[RGUGVECPDGNCTIG(I!M 7)(6&JQK Ɣ 0QVCNYC[NKMGCVTGGȀ9JCVKH -"/0,+KU21%,/CPF-,)&1& &+"

Slide 8

Slide 8 text

+CTFVQECRVWTGJKGTCTEJKGUKPXGEVQTURCEG 6X]DQQH&ROOLQV -"/0,+ -,)&1& &+ /1&01 21%,/ 8GEVQT5RCEG Ɣ +QYFQYGMPQYKH/1&01KU VJGUWDV[RGQH-"/0,+"

Slide 9

Slide 9 text

+CTFVQECRVWTGJKGTCTEJKGUKPXGEVQTURCEG Ɣ +QYFQYGMPQYKH/1&01KU VJGUWDV[RGQH-"/0,+" Ɣ +QYFQYGMPQYKH-"/0,+ CPF), 1&,+CTGOWVWCNN[ GZENWUKXG" ), 1&,+ 6X]DQQH&ROOLQV -"/0,+ -,)&1& &+ /1&01 21%,/ 8GEVQT5RCEG

Slide 10

Slide 10 text

%QZ(ODGFFKPIU -"/0,+ -,)&1& &+ /1&01 21%,/ 8GEVQT5RCEG %QZ5RCEG "/0,+ 21%,/ ,)&1& &+ 27++" ,))&+0 6X]DQQH&ROOLQV

Slide 11

Slide 11 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV (ODGFFGFKP%QZ5RCEG6JKU9QTM (PEQFGT %QZ5RCEG 27++" ,))&+0

Slide 12

Slide 12 text

7KH+XQJHU*DPHVWKHILUVWRIEHVWVHOOLQJERRNVE\6X]DQQH&ROOLQV (ODGFFGFKP%QZ5RCEG6JKU9QTM -"/0,+ /1&01 21%,/ 䐅 6[RG(ODGFFKPIU (PEQFGT %QZ5RCEG "/0,+ 21%,/ ,)&1& &+ 27++" ,))&+0

Slide 13

Slide 13 text

(ODGFFGFKP%QZ5RCEG6JKU9QTM %QZ5RCEG "/0,+ 21%,/ ,)&1& &+ 27++" ,))&+0 5WKVCDNGIGQOGVT[ Ɣ %QZ$EQPVCKPUCPQVJGTDQZ% ĺ$KUUWRGTV[RGQH% Ɣ %QZGUQXGTNCRĺECPDGDQVJ Ɣ %QZGUFKULQKPVĺOWVWCNN[ GZENWUKXG

Slide 14

Slide 14 text

$RRNKECVKQPUQH%QZ(ODGFFKPIU Ɣ 9QTF0GVJ[RGTP[ORTGFKEVKQP8KNPKU.K'CUIWRVC2CVGN ż /QFGNVJGVTCPUKVKXGENQUWTGDGVYGGPYQTFUWUKPIDQZGU Ɣ 7PEGTVCKPMPQYNGFIGITCRJU&JGP ż (PVKVKGUCUDQZGUCPFTGNCVKQPUCUDQZVQDQZVTCPUHQTOCVKQPU Ɣ 4GEQOOGPFCVKQPU[UVGOU

Slide 15

Slide 15 text

Slide 16

Slide 16 text

/QFGN1XGTXKGY Ɣ (ODGFCPGPVKV[OGPVKQPCPF GPVKV[V[RGUKPVQVJGUCOGDQZ URCEG Ɣ 7UGDQZQRGTCVKQPUGIXQNWOG KPVGTUGEVKQPGVEVQEQORWVG 3W\SH_PHQWLRQDQGFRQWH[W Ɣ 6TGCVGCEJV[RGRTGFKEVKQPCUCP KPFGRGPFGPVDKPCT[ENCUUKȤECVKQP %QZ5RCEG "/0,+ 21%,/ ,)&1& &+ 27++" ,))&+0

Slide 17

Slide 17 text

+ ,!"/ 7KH+XQJHU*DPHVWKH ILUVWRIEHVWVHOOLQJERRNV E\6X]DQQH&ROOLQV "+1&,++!,+1"51 /+0#,/* >&/6@ Ɣ (PEQFGOGPVKQPCPFEQPVGZVYKVJ%(46 %QZDCUGF(PVKV[6[RKPI/QFGN "+1&,++!,+1"51 " 1,/

Slide 18

Slide 18 text

Ɣ (PEQFGOGPVKQPCPFEQPVGZVYKVJ%(46 Ɣ 6TCPUHQTOVJGGPEQFKPIKPVQCDQZ "+1"/ ##0"1 %QZDCUGF(PVKV[6[RKPI/QFGN 5,&+1p &+,&+1p + ,!"/ 7KH+XQJHU*DPHVWKH ILUVWRIEHVWVHOOLQJERRNV E\6X]DQQH&ROOLQV "+1&,++!,+1"51 /+0#,/* >&/6@ "+1&,++!,+1"51 " 1,/

Slide 19

Slide 19 text

Ɣ (ODGFGPVKV[V[RGUWUKPIDQZGU "+1"/ ##0"1 %QZDCUGF(PVKV[6[RKPI/QFGN 6-"*"!!&+$0 5,&+1p &+,&+1p Nv1%6-"" 1,/ -"/0,+ /1&01 21%,/ -,)&1& &+ 䐂䐂䐂䐂

Slide 20

Slide 20 text

%QZDCUGF/WNVKNCDGN6[RG&NCUUKȤGT Ɣ 2V[RG^OGPVKQP 8QNV[RGDQZŀOGPVKQPDQZ8QNOGPVKQPDQZ

Slide 21

Slide 21 text

Ɣ 2V[RG^OGPVKQP 8QNV[RGDQZŀOGPVKQPDQZ8QNOGPVKQPDQZ Ɣ &QORWVGUQHVXQNWOGQHKPVGTUGEVKQP %QZDCUGF/WNVKNCDGN6[RG&NCUUKȤGT 21%,/ -,)&1& &+ 6X]DQQH &ROOLQV 6X]DQQH &ROOLQV ͳPVGTUGEVKQP%QZ

Slide 22

Slide 22 text

%QZDCUGF/WNVKNCDGN6[RG&NCUUKȤGT 21%,/ -,)&1& &+ 6X]DQQH &ROOLQV 6X]DQQH &ROOLQV ͳPVGTUGEVKQP%QZ 2*"),5"00$2-1n:8:8 Ɣ 2V[RG^OGPVKQP 8QNV[RGDQZŀOGPVKQPDQZ8QNOGPVKQPDQZ Ɣ &QORWVGUQHVXQNWOGQHKPVGTUGEVKQP

Slide 23

Slide 23 text

%QZDCUGF/WNVKNCDGN6[RG&NCUUKȤGT 21%,/ -,)&1& &+ 6X]DQQH &ROOLQV 6X]DQQH &ROOLQV &QORWVGͳPVGTUGEVKQP8QNWOG /GPVKQPCPF&QPVGZV%QZ8QNWOG ͳPVGTUGEVKQP%QZ 2*"),5"00$2-1n:8:8 Ɣ 2V[RG^OGPVKQP 8QNV[RGDQZŀOGPVKQPDQZ8QNOGPVKQPDQZ Ɣ &QORWVGUQHVXQNWOGQHKPVGTUGEVKQP

Slide 24

Slide 24 text

Ɣ &QORWVGEQPFKVKQPCNRTQDCDKNKV[D[FKXKFKPIXQNWOGU %QZDCUGF/WNVKNCDGN6[RG&NCUUKȤGT 6X]DQQH&ROOLQV ŀ21%,/ 6X]DQQH&ROOLQV 6X]DQQH&ROOLQV ŀ-,)&1& &+ 6X]DQQH&ROOLQV 2TQDCDKNKV[QHNvVJV[RGWNIKXGPOGPVKQPPCPFEQPVGZVVp

Slide 25

Slide 25 text

Ɣ /KPKOK\GVJGUWOQHDKPCT[ETQUUGPVTQR[NQUUGUQXGTCNNV[RGUQXGTCNN GZCORNGU .QUU)WPEVKQP 2TQDCDKNKV[QHNvVJV[RGWNIKXGPOGPVKQPPCPFEQPVGZVVp 1DLGEVKXG

Slide 26

Slide 26 text

(ZRGTKOGPVU Ɣ (PVKV[6[RKPI ż 'QGUCDQZOQFGNKORTQXGV[RKPIRGTHQTOCPEG" Ɣ &QPUKUVGPE[ ż 9JGPCOQFGNRTGFKEVUCȤPGV[RGFQGUKVCNUQRTGFKEVVJGEQCTUGV[RG" Ɣ 4QDWUVPGUU ż +QYOWEJFQGURGTHQTOCPEGFGITCFGKHNCDGNUCTGPQKU[" Ɣ %QZ(FIGU Ɣ &CNKDTCVKQP Ɣ 'QYPUVTGCO6CUM

Slide 27

Slide 27 text

(PVKV[6[RKPI 7)(6&JQK QH6[RGUM %CUGNKPGU Ɣ 8GEVQTOQFGN%(46 Ɣ 8GEVQTOQFGN(./Q 1PQG'WTTGVV Ɣ +[RGTDQNKEOQFGN .°RG\5VTWDG 'GX4GUWNVU 7UGFFKͯGTGPVCWIOGPVGFFCVC %QZ 8GEVQT %(46 8GEVQT (./Q +[RGTDQNKE /CETQ)

Slide 28

Slide 28 text

(PVKV[6[RKPI 1PVQ0QVGU*KNNKEM QH6[RGUV[RGU %CUGNKPGU Ɣ 8GEVQTOQFGN%(46 Ɣ 'QEWOGPVNGXGN

Slide 29

Slide 29 text

(PVKV[6[RKPI 6GUV4GUWNVU 0QVG9GTGRQTV%%0CPF)ͳ*(4TGUWNVUKPQWTRCRGT %QZ 8GEVQT %(46 +KGT TCPMKPI 'QENGXGN /GPVKQP $VVP /CETQ) 1PVQ0QVGU*KNNKEM QH6[RGUV[RGU %CUGNKPGU Ɣ 8GEVQTOQFGN%(46 Ɣ 'QEWOGPVNGXGN

Slide 30

Slide 30 text

Slide 31

Slide 31 text

&QPUKUVGPE[ 9JGPCOQFGNRTGFKEVUCȤPGV[RGCTVKUVFQGUKVCNUQRTGFKEVVJGEQCTUG V[RGRGTUQP" Ɣ EQCTUGV[RGUȤPGV[RGU ż RGTUQP ż NQECVKQP ż RNCEG ż QTICPK\CVKQP 5WRGTV[RG RGTUQP NQECVKQP RNCEG QTICPK\CVKQP $EEWTCE[

Slide 32

Slide 32 text

&QPUKUVGPE[ 9JGPCOQFGNRTGFKEVUCȤPGV[RGCTVKUVFQGUKVCNUQRTGFKEVVJGEQCTUG V[RGRGTUQP" Ɣ EQCTUGV[RGUȤPGV[RGU ż RGTUQP ż NQECVKQP ż RNCEG ż QTICPK\CVKQP Ɣ %QZKUEQPUKUVGPVN[DGVVGT VJCPXGEVQTHQTCNNEQCTUG V[RGU 5WRGTV[RG RGTUQP NQECVKQP RNCEG QTICPK\CVKQP $EEWTCE[

Slide 33

Slide 33 text

4QDWUVPGUU +QYOWEJFQGURGTHQTOCPEGFGITCFGKHNCDGNUCTGPQKU[" Ɣ 1TKIKPCN7)(6VTCKPKPIFCVC Ɣ 0QKUGF&QCTUGFTQRVJGIQNF EQCTUGV[RGUYKVJR Ɣ 0QKUGF)KPG 7NVTCȤPGFTQRVJG IQNFȤPGCPFWNVTCȤPGV[RGUYKVJR /CETQ) %QZ 8GEVQT

Slide 34

Slide 34 text

Slide 35

Slide 35 text

%QZ(FIGU (FIGUQH-"/0,+CPF 1,/DQZGU

Slide 36

Slide 36 text

1,/ G G G -"/0,+ 7KHLQWHUVHFWLRQRIWKH 1,/ER[$1'PHQWLRQ ER[HVRIDOOWKHGHYH[DPSOHVZKHUHWKHPRGHO SUHGLFWVWKH 1,/W\SHLHWKHHIIHFWLYH UHJLRQRIWKH 1,/ER[ 1,/ER[ 0HQWLRQER[RIWKH GHYH[DPSOHG 7KHHIIHFWLYHUHJLRQRI WKH 1,/ER[ (ͯGEVKXG4GIKQP

Slide 37

Slide 37 text

%QZ(FIGU (FIGUQH-"/0,+CPFVJGGͯGEVKXGDQZQHVJG 1,/V[RG (FIGUQH-"/0,+CPF 1,/DQZGU

Slide 38

Slide 38 text

6CMGCYC[U Ɣ %QZGODGFFKPIUECRVWTGFGRGPFGPEKGUDGVYGGP GPVKV[V[RGUYKVJQWVGZRNKEKVUWRGTXKUKQP Ɣ (CU[VQWUGDQZGODGFFKPIUQPN[TGSWKTG OQFKȤECVKQPUQPVJGQWVRWVNC[GT JVVRUIKVJWDEQO[CUWOCUCQPQG%QZ6[RGU Ɣ 5VTQPITGUWNVUQPGPVKV[V[RKPIEQPUKUVGPE[CPF TQDWUVPGUU