Tweet
Tweet

Slide 1

Slide 1 text

จݙ঺հʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter EMNLP2019 ௕Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ

Slide 2

Slide 2 text

"CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு͸&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ୅ΘΓͱͳΔ෼෍͕"UUFOUJPOΑΓ΋͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱ͸Ͱ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2

Slide 3

Slide 3 text

"UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷ෼෍ΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO͸&YQMBOBUJPOʢઆ໌Λఏڙ͢Δ΋ͷʣ ɹͰ͸ͳ͍ʁ !3

Slide 4

Slide 4 text

&YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿ෼ྨλεΫ ɾjɿ෼ࢄΛ֬ೝ ɾjɿ෼෍ͷ਍அ ɾjɿఢରతֶश !4

Slide 5

Slide 5 text

&YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿ૒ํ޲-45. "UUFOUJPO !5

Slide 6

Slide 6 text

%FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6

Slide 7

Slide 7 text

&YQFSJNFOUj෼ྨλεΫ w "UUFOUJPOͷඞཁੑΛௐ΂ͯɺ෼ྨ λεΫͱσʔληοτͷଥ౰ੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ৔߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δ͸ͣ w ͭͷ෼ྨλεΫͰ͸ɺ"UUFOUJPOΛ ༻͍ͯ΋΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7

Slide 8

Slide 8 text

&YQFSJNFOUj෼ࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨ෼ࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ࢖༻ͯͭ͠ͷϞσϧͰ෼ੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ

Slide 9

Slide 9 text

3FTVMUj෼ࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ

Slide 10

Slide 10 text

&YQFSJNFOUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ ͭͷॏΈͷ෼෍Ͱ j ͱಉ༷ʹ෼ྨ λεΫΛղ͖ɺൺֱ͢Δ !10

Slide 11

Slide 11 text

3FTVMUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷΋ྑ͍ ݁Ռʹͳͬͨ !11

Slide 12

Slide 12 text

.FUIPEjఢରతֶश w Ҏલͷͭʢj  ʣ͸"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔ෼෍Ҏ֎Ͱɺ"UUFOUJPOͱಉ౳ͷ༧ଌ͕Ͱ͖Δ෼෍Λ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬཰తޯ഑߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ !12

Slide 13

Slide 13 text

&YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO  ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦෼͕ਓ͕ؒཧղͰ͖Δߏ଄ʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO  ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳ਺ͷ෼෍͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO͸&YQMBOBUJPOͰ͸ͳ͍ͱ͞ΕΔ !13

Slide 14

Slide 14 text

$PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔͸ఆٛʹΑΔ w ༷ʑͳֶशํ๏Ͱಘͨ୅ସͱͳΔ෼෍͸ɺैདྷͷ"UUFOUJPOʹൺ΂ͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ܎ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14