Gated End-to-End Memory Networks

66cc992074ab4522374e429c11fef225?s=47 youichiro
February 12, 2019

Gated End-to-End Memory Networks

長岡技術科学大学
自然言語処理研究室
文献紹介(2019-02-12)
Gated End-to-End Memory Networks
http://www.aclweb.org/anthology/E17-1001

66cc992074ab4522374e429c11fef225?s=128

youichiro

February 12, 2019
Tweet

Transcript

  1. Gated End-to-End Memory Networks 9 2 0 - 1 Fei

    Liu and Julien Perez Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 1-10, 2017
  2. • -.2 1-. - -.2 1-. - -.2 1-. 

  3. 5524 2 2 4 -24 2 2 5 / /

    56 .4 2
  4. • E:A ( : • ) ) -  

       
  5. () ) • .1 4 . 4/5 ) 5 2

    ,.5 2 . 0 ( J J a MNW ()     
  6. () ) • , / . / b M Nh

    d e d M J Sai c S B W B N ()      . 5 / ( ) 2 / / 5 5 1 / 51 ? / / / / 5 0 2 / 2 /
  7. () ) • .1 .6 /5 ) 5 2 ,.56

    2 .6 0 J J a MNW ( ()      ! " #$ , … , #' = #)
  8. - - )-(  !, #, $: &×( ): ((×&)

  9. ( !, #, $: &×( ( ): ((×& ) (

    ) ,- {/- } - - )-(
  10. !, #, $: &×( ) ): ((×& )) ,- {/-

    } ( q 2 ( - - )-(
  11. !, #, $: &×(1 ): ((×&1 ) 0 ,- {/-

    }) 0 q 2) (3)u(/- 2)5678/9, :- = <678/9, 2=/- - - )-(
  12. !, #, $: &×(2 ): ((×&2 ) 1 ,- {/-

    } 1 q 2 (3)u)/- 4 5678/9, ( :- = <678/9, 2=/- 1 ,- {>- } - - )-(
  13. 2 !, #, $: &×(41 2 ): ((×&41) 2 ,-

    {/- } 2 q 2 (3)u /- 5 5678/9, () :- = <678/9, 2=/- 2 ,- {>- } >- :- 5( 6 6 = ? - :- >- - - )-(
  14. 6 3 ) !" 3{$" } 4 6 3 )q3'

    4 (3)u $" ,-./$0!3 2 1" = 3-./$0! '4$" 6 (3 ) !" 3{5" } 4 5" 1" 1-3 2 - = 6 " 1" 5" - ' 37 4 ,-./$0! 8 0 = 3-./$0! 7 - + ' 6 :, <, =: ?×A 5 6 7: (A×? 5) - - )-(
  15. !"#$ = &" + !" - - - ) (

    ( 4 4 1 1 = )
  16. 0 - /1 . /-/

  17. Q • (-2 )- (-2) ) )- - (-2 )-

    (-2) ) M • G E (-2) ) AH N 
  18. ! = #(%& + () ! = # %* &

    + (* ⊙ σ %- & + (- + . ⊙ 1 − σ %- & + (- 
  19. , , ! = # $% & + (% ⊙

    σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • σ $+ & + (+ = 1 / = # $% & + (% • σ $+ & + (+ = 0 / = & 
  20. ( ) ! = # $% & + (% ⊙

    σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • 0 ≤ σ $+ & + (+ ≤ 1 H 12 , 42 H 
  21. - -  !"#$ = &" + !"

  22. -  !"#$ = &" + !" ()#* = +)⨀-)

    () + ()⨀ * − -) () -) () = / 0- )() + 1- )
  23. - - -  !"#$ = &"⨀(" !" + !"⨀

    1 − (" !" (" !" = σ -. "!" + /. "
  24.  TRf r % )3 02 ( !"#$ = &",

    ( = &), * = !$ 10 ( (+ $ = (+ , = ⋯ = (+ ), .+ $ = .+ , = ⋯ = .+ ) 2 2( (+ ", .+ "Rsa bx : 0 2 3 /0 = ∑2 !302 + 56 7 m G Ro - 2 3 /0 = ∑2 80 9 !302 (80 ( j gl m Ge 0 0 bxdc t L :0A R H bxRp P 0 3 : bx % n i R P
  25.  0 • • 1 2

  26.  

  27.  6 2

  28. E • • G H A a N G H

    d A • - e M Q 
  29. • 05 0 05 • ) HT - 05 0

    • M N I E I ( 12 0 P