Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介：Attention is not not Explanation

Avatar for Taichi Aida Taichi Aida
August 28, 2019
Technology
0
220

文献紹介：Attention is not not Explanation

Avatar for Taichi Aida

Taichi Aida

August 28, 2019
Tweet

More Decks by Taichi Aida

See All by Taichi Aida
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
Avatar for Taichi Aida a1da4
1
190
文献紹介：A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
Avatar for Taichi Aida a1da4
1
290
YANS2024：目指せ国際会議！「ネットワーキングの極意（国際会議編）」
Avatar for Taichi Aida a1da4
0
220
言語処理学会30周年記念事業留学支援交流会＠YANS2024：「学生のための短期留学」
Avatar for Taichi Aida a1da4
1
340
新入生向けチュートリアル：文献のサーベイv2
Avatar for Taichi Aida a1da4
15
10k
文献紹介：Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
Avatar for Taichi Aida a1da4
0
180
文献紹介：WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
Avatar for Taichi Aida a1da4
1
260
文献紹介：On the Transformation of Latent Space in Fine-Tuned NLP Models
Avatar for Taichi Aida a1da4
0
100
新入生向けチュートリアル：文献のサーベイ
Avatar for Taichi Aida a1da4
0
470

Other Decks in Technology

See All in Technology
自律的なスケーリング手法FASTにおけるVPoEとしてのアカウンタビリティ / dev-productivity-con-2025
Avatar for Yoshiki Iida yoshikiiida
0
320
5min GuardDuty Extended Threat Detection EKS
Avatar for takakuni takakuni
0
180
生成AIで小説を書くためにプロンプトの制約や原則について学ぶ / prompt-engineering-for-ai-fiction
Avatar for nwiizo nwiizo
4
3.4k
OPENLOGI Company Profile
Avatar for OPENLOGI hr01
0
67k
Fabric ＋ Databricks 2025.6 の最新情報ピックアップ
Avatar for Ryoma Nagata ryomaru0825
1
160
mrubyと micro-ROSが繋ぐロボットの世界
Avatar for Katsuhiko Kageyama kishima
2
380
Node-REDのFunctionノードでMCPサーバーの実装を試してみた / Node-RED × MCP 勉強会 vol.1
Avatar for you（@youtoy） you
PRO
0
130
Tokyo_reInforce_2025_recap_iam_access_analyzer
Avatar for h-ashisan hiashisan
0
140
強化されたAmazon Location Serviceによる新機能と開発者体験
Avatar for Yasunori Kirimoto dayjournal
3
250
CursorによるPMO業務の代替 / Automating PMO Tasks with Cursor
Avatar for Motoyoshi Kosei motoyoshi_kakaku
2
790
生成AI時代の開発組織・技術・プロセス 〜 ログラスの挑戦と考察 〜
Avatar for Hiroshi Ito itohiro73
1
370
WordPressから ヘッドレスCMSへ! Storyblokへの移行プロセス
Avatar for Nagisa Yata nyata
0
330

Featured

See All Featured
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
30
2.1k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
94
6.1k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
694
190k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
462
33k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
614
210k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
23
3.5k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
107
19k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
45
7.5k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
42
7.6k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3.1k
Writing Fast Ruby
Avatar for Erik Berlin sferik
628
62k
KATA
Avatar for Megan Lloyd mclloyd
30
14k

Transcript

  1. จݙ঺հʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter

    EMNLP2019 ௕Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ

  2. "CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு͸&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ୅ΘΓͱͳΔ෼෍͕"UUFOUJPOΑΓ΋͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱ͸Ͱ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2

  3. "UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷ෼෍ΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO͸&YQMBOBUJPOʢઆ໌Λఏڙ͢Δ΋ͷʣ ɹͰ͸ͳ͍ʁ !3

  4. &YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿ෼ྨλεΫ ɾjɿ෼ࢄΛ֬ೝ ɾjɿ෼෍ͷ਍அ ɾjɿఢରతֶश !4

  5. &YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿ૒ํ޲-45. "UUFOUJPO !5

  6. %FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6

  7. &YQFSJNFOUj෼ྨλεΫ w "UUFOUJPOͷඞཁੑΛௐ΂ͯɺ෼ྨ λεΫͱσʔληοτͷଥ౰ੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ৔߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δ͸ͣ w ͭͷ෼ྨλεΫͰ͸ɺ"UUFOUJPOΛ

    ༻͍ͯ΋΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7

  8. &YQFSJNFOUj෼ࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨ෼ࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ࢖༻ͯͭ͠ͷϞσϧͰ෼ੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ

  9. 3FTVMUj෼ࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ

  10. &YQFSJNFOUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ ͭͷॏΈͷ෼෍Ͱ j ͱಉ༷ʹ෼ྨ λεΫΛղ͖ɺൺֱ͢Δ !10

  11. 3FTVMUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷΋ྑ͍ ݁Ռʹͳͬͨ !11

  12. .FUIPEjఢରతֶश w Ҏલͷͭʢj  ʣ͸"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔ෼෍Ҏ֎Ͱɺ"UUFOUJPOͱಉ౳ͷ༧ଌ͕Ͱ͖Δ෼෍Λ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬཰తޯ഑߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ

    !12

  13. &YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO  ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦෼͕ਓ͕ؒཧղͰ͖Δߏ଄ʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO

     ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳ਺ͷ෼෍͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO͸&YQMBOBUJPOͰ͸ͳ͍ͱ͞ΕΔ !13

  14. $PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔͸ఆٛʹΑΔ w ༷ʑͳֶशํ๏Ͱಘͨ୅ସͱͳΔ෼෍͸ɺैདྷͷ"UUFOUJPOʹൺ΂ͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ܎ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14