Gated End-to-End Memory Networks

長岡技術科学大学
自然言語処理研究室
文献紹介（2019-02-12）
Gated End-to-End Memory Networks
http://www.aclweb.org/anthology/E17-1001

Transcript

1. Gated End-to-End Memory Networks 9 2 0 - 1 Fei Liu and Julien Perez Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 1-10, 2017
2. • -.2 1-. - -.2 1-. - -.2 1-.
   
3. 5524 2 2 4 -24 2 2 5 / / 56 .4 2
4. • E:A ( : • ) ) -
       
5. () ) • .1 4 . 4/5 ) 5 2 ,.5 2 . 0 ( J J a MNW ()   
    
6. () ) • , / . / b M Nh d e d M J Sai c S B W B N ()   
     . 5 / ( ) 2 / / 5 5 1 / 51 ? / / / / 5 0 2 / 2 /
7. () ) • .1 .6 /5 ) 5 2 ,.56 2 .6 0 J J a MNW ( ()   
     ! " #$ , … , #' = #)
8. - - )-(
   !, #, $: &×( ): ((×&)
9. ( !, #, $: &×( ( ): ((×& ) ( ) ,- {/- } - - )-(
10. !, #, $: &×( ) ): ((×& )) ,- {/- } ( q 2 ( - - )-(
11. !, #, $: &×(1 ): ((×&1 ) 0 ,- {/- }) 0 q 2) (3)u(/- 2)5678/9, :- = <678/9, 2=/- - - )-(
12. !, #, $: &×(2 ): ((×&2 ) 1 ,- {/- } 1 q 2 (3)u)/- 4 5678/9, ( :- = <678/9, 2=/- 1 ,- {>- } - - )-(
13. 2 !, #, $: &×(41 2 ): ((×&41) 2 ,- {/- } 2 q 2 (3)u /- 5 5678/9, () :- = <678/9, 2=/- 2 ,- {>- } >- :- 5( 6 6 = ? - :- >- - - )-(
14. 6 3 ) !" 3{$" } 4 6 3 )q3' 4 (3)u $" ,-./$0!3 2 1" = 3-./$0! '4$" 6 (3 ) !" 3{5" } 4 5" 1" 1-3 2 - = 6 " 1" 5" - ' 37 4 ,-./$0! 8 0 = 3-./$0! 7 - + ' 6 :, <, =: ?×A 5 6 7: (A×? 5) - - )-(
15. !"#$ = &" + !" - - - ) ( ( 4 4 1 1 = )
16. 0 - /1 . /-/
17. Q • (-2 )- (-2) ) )- - (-2 )- (-2) ) M • G E (-2) ) AH N
    
18. ! = #(%& + () ! = # %* & + (* ⊙ σ %- & + (- + . ⊙ 1 − σ %- & + (-
    
19. , , ! = # $% & + (% ⊙ σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • σ $+ & + (+ = 1 / = # $% & + (% • σ $+ & + (+ = 0 / = &
    
20. ( ) ! = # $% & + (% ⊙ σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • 0 ≤ σ $+ & + (+ ≤ 1 H 12 , 42 H
    
21. - - 
    !"#$ = &" + !"
22. - 
    !"#$ = &" + !" ()#* = +)⨀-) () + ()⨀ * − -) () -) () = / 0- )() + 1- )
23. - - -
    
    !"#$ = &"⨀(" !" + !"⨀ 1 − (" !" (" !" = σ -. "!" + /. "
24. 
     TRf r % )3 02 ( !"#$ = &", ( = &), * = !$ 10 ( (+ $ = (+ , = ⋯ = (+ ), .+ $ = .+ , = ⋯ = .+ ) 2 2( (+ ", .+ "Rsa bx : 0 2 3 /0 = ∑2 !302 + 56 7 m G Ro - 2 3 /0 = ∑2 80 9 !302 (80 ( j gl m Ge 0 0 bxdc t L :0A R H bxRp P 0 3 : bx % n i R P
25. 
     0 • • 1 2
26. 
    
    
27. 
     6 2
28. E • • G H A a N G H d A • - e M Q
    
29. • 05 0 05 • ) HT - 05 0 • M N I E I ( 12 0 P