[論紹] Neural Text Generation in Stories Using Entity Representation as Context

弊研究室で行なったNAACL読み会の発表資料です。

Transcript

2. @ 28 0 A 2 1 ) 2 2 ( A (82 (,
3. C 2 A ) A2C C C GC G C C C A A C2C 2 2AA2C E C GC C A C A C C2A C A2 GC ) A2C ,C A . ( C C A C2C 2 C GC
     2 ( 2 C 2A C A2
     , C 2C A C C 32 3 C 111111111111111111 2 C C C C A 2 A C 2 A
4. . 4 . 4 . - . - . !" . . . . . 4 . . . #"$% . . . . 4 . . & 4 . . - . . . 4- . '( ) = max(!($% ) , #( ) , &012234" [)]) 4 . . . - . 8"
5. 5 5 . 5 ! + 1 $ %&'(,* = ∑- .*,- /&'(,- . 5 .*,- = exp(/&'(,- 45 /&,* ) ∑ -7 exp(/&'(,-7 45 /&,* ) , /&,* . . , $ ! . , . , 5 /&'(,∗ 55 /&,* /&'(,-
6. . . 6 . ! . "~$(&, ()*) . ∝ exp(0123 4 5671819 :8,123 + <=8>1 4 ?(!)) . 6 6 6 66 :@ABB671 , . . 6. , . :@ABB671 6 6 6 . 6 , . 6 . C1 . 6 . 6 6
7. 47 7 10 3 41 2211 :4 7 0 7 7 174 317 1 : 0 4 : 0 41 .1: .1 7: ! "# = % &#'( ∝ exp &#'( - ./0 , ! 2# = 3 "# = 1, &#'( ∝ exp &#'( - .56#7#895,#'( + ;<7=# - > 3 ! ?# = @ &#'(, 95A,#'( ∝ exp .B56C#D - , B &#'( ; 95A,#'( , !(G# = H|&#'(, 9JK//56#) ∝ CFSM(&#'( + .59JK//56#)
8. 
    ,) - - ) - ) - - - ) ,) - - ,) - ) 8 - ! " = log ' (; " = ∑+ log '(-+ ; ") " () ) ,) () ) ) -+ ) ) ) () - - - ) ) / 8 ,) ( ) - ) - ,) ) - ,) ) - ) ) ,) ) , ,) ) - ,) ( - )
9. ) 14 5 C 5 2 B C 5 C B C 19 2 B 45 ) 2 B C5BC ) 2 B () B57 5 CB (( B57 5 CB ( B57 5 CB C B5 C5 35B • 4 31B54 • 25 B 1 5 5 1354 0 K C 5 • 5 5 3 312 1 1 5 5 1354 0 ,K C 5 • 5 3 454 C 5 5 C9 B 3 B9BC9 7 5 C 1 4
10. 3 3 3 : 23 1 1 E :3 3 E 1 3 ( A223 ,): E 32 2 , 3 2 , 3 E3 32 , 3 3 0 1 0A .................. 3 : 23 3 3132 3 E :3 ): E 3 2 3 3 ,): E , 3 2 , 3 , 3 , 3 ): E 3 2 3 ): E 3 2 3 3 3 3 : 23 3 A 32 33 32 1 1 A 3 2 :3 1 A 3 E 2 :3 E
11. 4 3 2 3 43 3 • . 3 3 1 3 3 .4 . 3 3 43 . 3 4 3 43 • . 3 3 1 3 3 .4 . 14 1 43 1 4 2 11 44 • 3 .4 3 143 34 3 . 4 2 3 43 3 43
12. .0 1 2 2 2 2 2 2 2 4 2 01 2 1 01 2 1 0. 02 10. 5 2 2
13. • 3 2 2 2 2 12 • , 2 2 2 2 2 2 • 2A
14. 2 1 2 20 21 2 24 2 2 2 42 2 2 2 2 05 0 2 2 21 2 05 2 2 02 A6 5 4 - 2 52 6 A 1 52 24 2
15. 2 : , : 2 : , : 1 , A , : 1 , A 2 : 2 : : , : 2 , ,5 , , 2, ,5
16. • 2, , , , , , 6 6 ,1, . 6 6 • 6 , 2, 6 , , , , , , , 6 , 6 , , 6 , , ,, • 6 , 2, 6 , , , , , 6 , 6 , 6 6 , , 6 6 6 , , , , , , , , 6 , 6 , 6 , 6 , , 6 6 2, 6 2, , ., 6 A 6 6 6 ,, 6 6 ,
17. 
     • 1 1 1 1 1 , 1 1 , 7 1 1 1 , , 1 1 1 1 1 1 1 1 1 1 1 1 1 1 • , 1 1 . 1 1 , 1 , 1 7 1 1 1 1 1 , 1 7 • 1 , 7 7 7 7