Gated End-to-End Memory Networks

Slide 1

Slide 1 text

Gated End-to-End Memory Networks 9 2 0 - 1 Fei Liu and Julien Perez Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 1-10, 2017

Slide 2

Slide 2 text

• -.2 1-. - -.2 1-. - -.2 1-.

Slide 3

Slide 3 text

5524 2 2 4 -24 2 2 5 / / 56 .4 2

Slide 4

Slide 4 text

• E:A ( : • ) ) -

Slide 5

Slide 5 text

() ) • .1 4 . 4/5 ) 5 2 ,.5 2 . 0 ( J J a MNW ()

Slide 6

Slide 6 text

() ) • , / . / b M Nh d e d M J Sai c S B W B N () . 5 / ( ) 2 / / 5 5 1 / 51 ? / / / / 5 0 2 / 2 /

Slide 7

Slide 7 text

() ) • .1 .6 /5 ) 5 2 ,.56 2 .6 0 J J a MNW ( () ! " #$ , … , #' = #)

Slide 8

Slide 8 text

- - )-( !, #, $: &×( ): ((×&)

Slide 9

Slide 9 text

( !, #, $: &×( ( ): ((×& ) ( ) ,- {/- } - - )-(

Slide 10

Slide 10 text

!, #, $: &×( ) ): ((×& )) ,- {/- } ( q 2 ( - - )-(

Slide 11

Slide 11 text

!, #, $: &×(1 ): ((×&1 ) 0 ,- {/- }) 0 q 2) (3)u(/- 2)5678/9, :- = <678/9, 2=/- - - )-(

Slide 12

Slide 12 text

!, #, $: &×(2 ): ((×&2 ) 1 ,- {/- } 1 q 2 (3)u)/- 4 5678/9, ( :- = <678/9, 2=/- 1 ,- {>- } - - )-(

Slide 13

Slide 13 text

2 !, #, $: &×(41 2 ): ((×&41) 2 ,- {/- } 2 q 2 (3)u /- 5 5678/9, () :- = <678/9, 2=/- 2 ,- {>- } >- :- 5( 6 6 = ? - :- >- - - )-(

Slide 14

Slide 14 text

6 3 ) !" 3{$" } 4 6 3 )q3' 4 (3)u $" ,-./$0!3 2 1" = 3-./$0! '4$" 6 (3 ) !" 3{5" } 4 5" 1" 1-3 2 - = 6 " 1" 5" - ' 37 4 ,-./$0! 8 0 = 3-./$0! 7 - + ' 6 :, <, =: ?×A 5 6 7: (A×? 5) - - )-(

Slide 15

Slide 15 text

!"#$ = &" + !" - - - ) ( ( 4 4 1 1 = )

Slide 16

Slide 16 text

0 - /1 . /-/

Slide 17

Slide 17 text

Q • (-2 )- (-2) ) )- - (-2 )- (-2) ) M • G E (-2) ) AH N

Slide 18

Slide 18 text

! = #(%& + () ! = # %* & + (* ⊙ σ %- & + (- + . ⊙ 1 − σ %- & + (-

Slide 19

Slide 19 text

, , ! = # $% & + (% ⊙ σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • σ $+ & + (+ = 1 / = # $% & + (% • σ $+ & + (+ = 0 / = &

Slide 20

Slide 20 text

( ) ! = # $% & + (% ⊙ σ $+ & + (+ + , ⊙ 1 − σ $+ & + (+ • 0 ≤ σ $+ & + (+ ≤ 1 H 12 , 42 H

Slide 21

Slide 21 text

- - !"#$ = &" + !"

Slide 22

Slide 22 text

- !"#$ = &" + !" ()#* = +)⨀-) () + ()⨀ * − -) () -) () = / 0- )() + 1- )

Slide 23

Slide 23 text

- - - !"#$ = &"⨀(" !" + !"⨀ 1 − (" !" (" !" = σ -. "!" + /. "

Slide 24

Slide 24 text

TRf r % )3 02 ( !"#$ = &", ( = &), * = !$ 10 ( (+ $ = (+ , = ⋯ = (+ ), .+ $ = .+ , = ⋯ = .+ ) 2 2( (+ ", .+ "Rsa bx : 0 2 3 /0 = ∑2 !302 + 56 7 m G Ro - 2 3 /0 = ∑2 80 9 !302 (80 ( j gl m Ge 0 0 bxdc t L :0A R H bxRp P 0 3 : bx % n i R P