文献紹介：Attention is not not Explanation

Transcript

1. จݙ঺հʢʣ
   Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter EMNLP2019 ௕Ԭٕज़Պֶେֶ
   ࣗવݴޠॲཧݚڀࣨɹ
   ૬ాɹଠҰ
2. "CTUSBDU w l"UUFOUJPO
   JT
   OPU
   &YQMBOBUJPOz
   ͷओு͸
   &YQMBOBUJPO
   ͷఆٛʹґଘ
   w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ
   w ୅ΘΓͱͳΔ෼෍͕
   "UUFOUJPO
   ΑΓ΋͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ
   "UUFOUJPO
   ͷ༗༻ੑΛ൱ఆ͢Δ͜ͱ͸Ͱ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2
3. "UUFOUJPO
   JT
   OPU
   &YQMBOBUJPO w"UUFOUJPO
   TDPSF
   ͱॏཁͳࢦඪʢMFBWFPOFPVU
   HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ
   w"UUFOUJPO
   ͷ෼෍ΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ
   wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO
   ˠ
   "UUFOUJPO
   ͸
   &YQMBOBUJPOʢઆ໌Λఏڙ͢Δ΋ͷʣ
   ɹͰ͸ͳ͍ʁ !3
4. &YQFSJNFOU ɾ+8ɿઌߦݚڀ
   ɾjɿ෼ྨλεΫ
   ɾjɿ෼ࢄΛ֬ೝ
   ɾjɿ෼෍ͷ਍அ
   ɾjɿఢରతֶश !4
5. &YQFSJNFOUBM
   4FUVQ w @ ɾl"UUFOUJPO
   JT
   OPU
   &YQMBOBUJPOz
   ͱ΄΅ಉ͡ ɾϞσϧɿ૒ํ޲-45. "UUFOUJPO !5
6. %FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPO
   JT
   OPU
   &YQMBOBUJPOz
   ͱಉ͡ !6
7. &YQFSJNFOU
   j
   ෼ྨλεΫ w "UUFOUJPO
   ͷඞཁੑΛௐ΂ͯɺ෼ྨ λεΫͱσʔληοτͷଥ౰ੑΛ֬ೝ
   w "UUFOUJPO
   ͕ඞཁͰ͋Δ৔߹ɺ#BTF ͱ
   6OJGPSNʢ"UUFOUJPO
   ͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δ͸ͣ w ͭͷ෼ྨλεΫͰ͸ɺ"UUFOUJPO
   Λ ༻͍ͯ΋΄ͱΜͲվળ͠ͳ͍
   w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7
8. &YQFSJNFOU
   j
   ෼ࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨ෼ࢄ͕
   ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ
   ɾॳظԽͷϥϯμϜγʔυΛ
   ɹ࢖༻ͯͭ͠ͷϞσϧͰ෼ੳ
   ɹʢTFFEʣ
   ɾఢରతͳϞσϧ
   ɹʢBEWFSTBSZʣ
9. 3FTVMU
   j
   ෼ࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠
   ɹϩόετͰ͋Δ
10. &YQFSJNFOU
    j
    ෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ
    w 5SBJOFE
    .-1ɿ.-1ʹ
    "UUFOUJPO
    Λֶशͤ͞Δ
    w #BTF
    -45.ɿγϯϓϧͳ
    -45.
    ͷ
    "UUFOUJPO
    MBZFS
    Ͱී௨ʹֶश
    w "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ ͭͷॏΈͷ෼෍Ͱ j
    ͱಉ༷ʹ෼ྨ λεΫΛղ͖ɺൺֱ͢Δ !10
11. 3FTVMU
    j
    ෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ
    w 5SBJOFE
    .-1ɿ.-1ʹ
    "UUFOUJPO
    Λֶशͤ͞Δ
    w #BTF
    -45.ɿγϯϓϧͳ
    -45.
    ͷ
    "UUFOUJPO
    MBZFS
    Ͱී௨ʹֶश
    w "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ w "UUFOUJPO
    Λ༻͍ͨ #BTF
    -45.
    ͕࠷΋ྑ͍ ݁Ռʹͳͬͨ !11
12. .FUIPE
    j
    ఢରతֶश w Ҏલͷͭʢj
    
    ʣ͸
    "UUFOUJPO
    ͷ༗ҙੑΛςετ͢Δํ๏
    w "UUFOUJPO
    ʹΑΔ෼෍Ҏ֎Ͱɺ"UUFOUJPO
    ͱಉ౳ͷ༧ଌ͕Ͱ͖Δ෼෍Λ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ
    w ֬཰తޯ഑߱Լ๏Ͱߋ৽͠ɺϞσϧ
    .B
    ΛಘΔ
    !12
13. &YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ
    w -JQUPO  ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦෼͕ਓ͕ؒཧղͰ͖Δߏ଄ʹରԠ ͢Δํ๏ʯͱఆٛ
    w 3VEJO  ɿઆ໌Մೳੑ
    ʻ
    ղऍՄೳੑͱఆٛ
    w ʮೖྗͷಛఆͷཁૉʹߴ͍
    "UUFOUJPO
    XFJHIU
    ͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ
    w ෳ਺ͷ෼෍͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO
    ͸
    &YQMBOBUJPO
    Ͱ͸ͳ͍ͱ͞ΕΔ !13
14. $PODMVTJPO w &YQMBOBUJPO
    ͔Ͳ͏͔͸ఆٛʹΑΔ
    w ༷ʑͳֶशํ๏Ͱಘͨ୅ସͱͳΔ෼෍͸ɺैདྷͷ
    "UUFOUJPO
    ʹൺ΂ͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO
    ͕τʔΫϯͱ༧ଌͷؔ ܎ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14