Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Gated End-to-End Memory Networks

youichiro
February 12, 2019

Gated End-to-End Memory Networks

長岡技術科学大学
自然言語処理研究室
文献紹介(2019-02-12)
Gated End-to-End Memory Networks
http://www.aclweb.org/anthology/E17-1001

youichiro

February 12, 2019
Tweet

More Decks by youichiro

Other Decks in Technology

Transcript

  1. Gated End-to-End Memory Networks 9 2 0 - 1 Fei

    Liu and Julien Perez Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 1-10, 2017
  2. () ) • .1 4 . 4/5 ) 5 2

    ,.5 2 . 0 ( J J a MNW ()     
  3. () ) • , / . / b M Nh

    d e d M J Sai c S B W B N ()      . 5 / ( ) 2 / / 5 5 1 / 51 ? / / / / 5 0 2 / 2 /
  4. () ) • .1 .6 /5 ) 5 2 ,.56

    2 .6 0 J J a MNW ( ()      ! " #$ , … , #' = #)
  5. ( !, #, $: &×( ( ): ((×& ) (

    ) ,- {/- } - - )-(
  6. !, #, $: &×(1 ): ((×&1 ) 0 ,- {/-

    }) 0 q 2) (3)u(/- 2)5678/9, :- = <678/9, 2=/- - - )-(
  7. !, #, $: &×(2 ): ((×&2 ) 1 ,- {/-

    } 1 q 2 (3)u)/- 4 5678/9, ( :- = <678/9, 2=/- 1 ,- {>- } - - )-(
  8. 2 !, #, $: &×(41 2 ): ((×&41) 2 ,-

    {/- } 2 q 2 (3)u /- 5 5678/9, () :- = <678/9, 2=/- 2 ,- {>- } >- :- 5( 6 6 = ? - :- >- - - )-(
  9. 6 3 ) !" 3{$" } 4 6 3 )q3'

    4 (3)u $" ,-./$0!3 2 1" = 3-./$0! '4$" 6 (3 ) !" 3{5" } 4 5" 1" 1-3 2 - = 6 " 1" 5" - ' 37 4 ,-./$0! 8 0 = 3-./$0! 7 - + ' 6 :, <, =: ?×A 5 6 7: (A×? 5) - - )-(
  10. !"#$ = &" + !" - - - ) (

    ( 4 4 1 1 = )
  11. Q • (-2 )- (-2) ) )- - (-2 )-

    (-2) ) M • G E (-2) ) AH N 
  12. ! = #(%& + () ! = # %* &

    + (* ⊙ σ %- & + (- + . ⊙ 1 − σ %- & + (- 
  13. , , ! = # $% & + (% ⊙

    σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • σ $+ & + (+ = 1 / = # $% & + (% • σ $+ & + (+ = 0 / = & 
  14. ( ) ! = # $% & + (% ⊙

    σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • 0 ≤ σ $+ & + (+ ≤ 1 H 12 , 42 H 
  15. -  !"#$ = &" + !" ()#* = +)⨀-)

    () + ()⨀ * − -) () -) () = / 0- )() + 1- )
  16. - - -  !"#$ = &"⨀(" !" + !"⨀

    1 − (" !" (" !" = σ -. "!" + /. "
  17.  TRf r % )3 02 ( !"#$ = &",

    ( = &), * = !$ 10 ( (+ $ = (+ , = ⋯ = (+ ), .+ $ = .+ , = ⋯ = .+ ) 2 2( (+ ", .+ "Rsa bx : 0 2 3 /0 = ∑2 !302 + 56 7 m G Ro - 2 3 /0 = ∑2 80 9 !302 (80 ( j gl m Ge 0 0 bxdc t L :0A R H bxRp P 0 3 : bx % n i R P
  18. E • • G H A a N G H

    d A • - e M Q 
  19. • 05 0 05 • ) HT - 05 0

    • M N I E I ( 12 0 P