Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介：Attention is not not Explanation

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Taichi Aida Taichi Aida
August 28, 2019
Technology
230
0

文献紹介：Attention is not not Explanation

Avatar for Taichi Aida

Taichi Aida

August 28, 2019

More Decks by Taichi Aida

See All by Taichi Aida
意味を表すベクトル表現を用いたテキスト分析
Avatar for Taichi Aida a1da4
0
150
スウェーデン滞在報告
Avatar for Taichi Aida a1da4
0
38
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
Avatar for Taichi Aida a1da4
1
320
文献紹介：A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
Avatar for Taichi Aida a1da4
1
410
YANS2024：目指せ国際会議！「ネットワーキングの極意（国際会議編）」
Avatar for Taichi Aida a1da4
0
350
言語処理学会30周年記念事業留学支援交流会＠YANS2024：「学生のための短期留学」
Avatar for Taichi Aida a1da4
1
460
新入生向けチュートリアル：文献のサーベイv2
Avatar for Taichi Aida a1da4
18
12k
文献紹介：Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
Avatar for Taichi Aida a1da4
0
260
文献紹介：WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
Avatar for Taichi Aida a1da4
1
410

Other Decks in Technology

See All in Technology
FORENSIA: ローカルLLMフォレンジックハーネス
Avatar for S.Nakano sumeshi
2
390
Head First モブプログラミング / Head First Mobprogramming
Avatar for TAKAKING22 takaking22
10
12k
【CEDEC2026】次世代デジタルカードゲームのサーバー設計と運用 〜『Shadowverse: Worlds Beyond』の舞台裏～
Avatar for Cygames, Inc. cygames
PRO
1
1.3k
ラジオの科学
Avatar for Frieve-A frievea
0
320
SmartHR Engineering Team Deck
Avatar for SmartHR Recruit smarthr
1
2.1k
【CEDEC2026】ゲームシナリオライターを支援するAIツール開発の実践 ― 設計とプロンプトの工夫 ―
Avatar for Cygames, Inc. cygames
PRO
1
850
Digitization部 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
2
7.7k
社内の7割が使うデータ基盤を、 データチーム2人で回すためにやったこと
Avatar for KOH koh_yoshi
4
1.3k
AWS ネットワーク構築でハマった（ハマりかけた） 5選とそこから得た教訓
Avatar for nagisa_53 nagisa53
4
220
ホームラボ紹介
Avatar for 世良泰明 y_sera15
0
180
サイバー捜査員研修（前半）
Avatar for Nomizo Nomizo nomizone
1
2k
Genie Codeハンズオン基礎編
Avatar for Takaaki Yayoi taka_aki
1
120

Featured

See All Featured
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
2
14k
We Are The Robots
Avatar for Honza Javorek honzajavorek
0
300
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
1.5k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
610
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon Słowik szymonslowik
1
380
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
430
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto WADA twada
PRO
119
120k
Side Projects
Avatar for Sacha Greif sachag
455
43k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k

Transcript

  1. จݙ঺հʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter

    EMNLP2019 ௕Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ

  2. "CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு͸&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ୅ΘΓͱͳΔ෼෍͕"UUFOUJPOΑΓ΋͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱ͸Ͱ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2

  3. "UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷ෼෍ΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO͸&YQMBOBUJPOʢઆ໌Λఏڙ͢Δ΋ͷʣ ɹͰ͸ͳ͍ʁ !3

  4. &YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿ෼ྨλεΫ ɾjɿ෼ࢄΛ֬ೝ ɾjɿ෼෍ͷ਍அ ɾjɿఢରతֶश !4

  5. &YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿ૒ํ޲-45. "UUFOUJPO !5

  6. %FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6

  7. &YQFSJNFOUj෼ྨλεΫ w "UUFOUJPOͷඞཁੑΛௐ΂ͯɺ෼ྨ λεΫͱσʔληοτͷଥ౰ੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ৔߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δ͸ͣ w ͭͷ෼ྨλεΫͰ͸ɺ"UUFOUJPOΛ

    ༻͍ͯ΋΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7

  8. &YQFSJNFOUj෼ࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨ෼ࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ࢖༻ͯͭ͠ͷϞσϧͰ෼ੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ

  9. 3FTVMUj෼ࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ

  10. &YQFSJNFOUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ ͭͷॏΈͷ෼෍Ͱ j ͱಉ༷ʹ෼ྨ λεΫΛղ͖ɺൺֱ͢Δ !10

  11. 3FTVMUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷΋ྑ͍ ݁Ռʹͳͬͨ !11

  12. .FUIPEjఢରతֶश w Ҏલͷͭʢj  ʣ͸"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔ෼෍Ҏ֎Ͱɺ"UUFOUJPOͱಉ౳ͷ༧ଌ͕Ͱ͖Δ෼෍Λ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬཰తޯ഑߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ

    !12

  13. &YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO  ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦෼͕ਓ͕ؒཧղͰ͖Δߏ଄ʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO

     ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳ਺ͷ෼෍͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO͸&YQMBOBUJPOͰ͸ͳ͍ͱ͞ΕΔ !13

  14. $PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔͸ఆٛʹΑΔ w ༷ʑͳֶशํ๏Ͱಘͨ୅ସͱͳΔ෼෍͸ɺैདྷͷ"UUFOUJPOʹൺ΂ͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ܎ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14