Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介：Attention is not not Explanation

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Taichi Aida Taichi Aida
August 28, 2019
Technology
230
0

文献紹介：Attention is not not Explanation

Avatar for Taichi Aida

Taichi Aida

August 28, 2019

More Decks by Taichi Aida

See All by Taichi Aida
意味を表すベクトル表現を用いたテキスト分析
Avatar for Taichi Aida a1da4
0
120
スウェーデン滞在報告
Avatar for Taichi Aida a1da4
0
26
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
Avatar for Taichi Aida a1da4
1
290
文献紹介：A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
Avatar for Taichi Aida a1da4
1
390
YANS2024：目指せ国際会議！「ネットワーキングの極意（国際会議編）」
Avatar for Taichi Aida a1da4
0
310
言語処理学会30周年記念事業留学支援交流会＠YANS2024：「学生のための短期留学」
Avatar for Taichi Aida a1da4
1
440
新入生向けチュートリアル：文献のサーベイv2
Avatar for Taichi Aida a1da4
16
12k
文献紹介：Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
Avatar for Taichi Aida a1da4
0
230
文献紹介：WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
Avatar for Taichi Aida a1da4
1
380

Other Decks in Technology

See All in Technology
The 7 pitfalls of AI
Avatar for Uwe Friedrichsen ufried
0
200
Oracle Cloud Infrastructure：2026年4月度サービス・アップデート
Avatar for oracle4engineer oracle4engineer
PRO
0
380
そのSLO 99.9%、本当に必要ですか？ 〜優先度付きSLOによる責任共有の設計思想〜 / Is that 99.9% SLO really necessary? Design philosophy of shared responsibility through prioritized SLOs
Avatar for VTRyo vtryo
0
260
Shiny New Tools Won't Fix Your Problem
Avatar for Trisha Gee trishagee
1
110
freeeで運用しているAIQAについて
Avatar for tonchan qatonchan
0
390
AIの揺らぎに“コシ”を与える階層化品質設計
Avatar for ICKX ickx
0
270
ハーネスエンジニアリング入門
Avatar for 西岡 賢一郎 (Kenichiro Nishioka) knishioka
0
140
拝啓、あの夏の僕へ〜あなたも知っているApp Runnerの世界〜
Avatar for 荒木 ARK news_it_enj
0
220
ハーネスエンジニアリング入門
Avatar for hatyibei hatyibei
0
110
"うちにはまだ早い"は本当？ ─ 小さく始めるPlatform Engineering入門
Avatar for Haruka Sakihara harukasakihara
4
350
毎日の作業を Claude Code 経由にしたら、 ノウハウがコードになった
Avatar for Hajime KOSHIRO kossykinto
1
1.1k
Oracle Cloud Infrastructure presents managed, serverless MCP Servers for Oracle AI Database
Avatar for thatjeffsmith thatjeffsmith
0
170

Featured

See All Featured
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
24k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
190
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.1k
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
0
220
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
1k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2.1k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.4k
Skip the Path - Find Your Career Trail
Avatar for Mark Kilby mkilby
1
120
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
490
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.3k
Designing Experiences People Love
Avatar for Jonathan Moore moore
143
24k

Transcript

  1. จݙ঺հʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter

    EMNLP2019 ௕Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ

  2. "CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு͸&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ୅ΘΓͱͳΔ෼෍͕"UUFOUJPOΑΓ΋͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱ͸Ͱ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2

  3. "UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷ෼෍ΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO͸&YQMBOBUJPOʢઆ໌Λఏڙ͢Δ΋ͷʣ ɹͰ͸ͳ͍ʁ !3

  4. &YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿ෼ྨλεΫ ɾjɿ෼ࢄΛ֬ೝ ɾjɿ෼෍ͷ਍அ ɾjɿఢରతֶश !4

  5. &YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿ૒ํ޲-45. "UUFOUJPO !5

  6. %FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6

  7. &YQFSJNFOUj෼ྨλεΫ w "UUFOUJPOͷඞཁੑΛௐ΂ͯɺ෼ྨ λεΫͱσʔληοτͷଥ౰ੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ৔߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δ͸ͣ w ͭͷ෼ྨλεΫͰ͸ɺ"UUFOUJPOΛ

    ༻͍ͯ΋΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7

  8. &YQFSJNFOUj෼ࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨ෼ࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ࢖༻ͯͭ͠ͷϞσϧͰ෼ੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ

  9. 3FTVMUj෼ࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ

  10. &YQFSJNFOUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ ͭͷॏΈͷ෼෍Ͱ j ͱಉ༷ʹ෼ྨ λεΫΛղ͖ɺൺֱ͢Δ !10

  11. 3FTVMUj෼෍ͷ਍அ w 6OJGPSNɿ.-1ग़ྗΛۉ౳ʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w

    "EWFSTBSZɿఢରతֶशͰಘΒΕ ͨ෼෍ʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷΋ྑ͍ ݁Ռʹͳͬͨ !11

  12. .FUIPEjఢରతֶश w Ҏલͷͭʢj  ʣ͸"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔ෼෍Ҏ֎Ͱɺ"UUFOUJPOͱಉ౳ͷ༧ଌ͕Ͱ͖Δ෼෍Λ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬཰తޯ഑߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ

    !12

  13. &YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO  ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦෼͕ਓ͕ؒཧղͰ͖Δߏ଄ʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO

     ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳ਺ͷ෼෍͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO͸&YQMBOBUJPOͰ͸ͳ͍ͱ͞ΕΔ !13

  14. $PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔͸ఆٛʹΑΔ w ༷ʑͳֶशํ๏Ͱಘͨ୅ସͱͳΔ෼෍͸ɺैདྷͷ"UUFOUJPOʹൺ΂ͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ܎ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14