Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介:Attention is not not Explanation
Search
Taichi Aida
August 28, 2019
Technology
0
220
文献紹介:Attention is not not Explanation
Taichi Aida
August 28, 2019
Tweet
Share
More Decks by Taichi Aida
See All by Taichi Aida
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
a1da4
0
120
文献紹介:A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
a1da4
1
250
YANS2024:目指せ国際会議!「ネットワーキングの極意(国際会議編)」
a1da4
0
150
言語処理学会30周年記念事業留学支援交流会@YANS2024:「学生のための短期留学」
a1da4
1
300
新入生向けチュートリアル:文献のサーベイv2
a1da4
13
9.4k
文献紹介:Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
a1da4
0
150
文献紹介:WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
a1da4
1
200
文献紹介:On the Transformation of Latent Space in Fine-Tuned NLP Models
a1da4
0
75
新入生向けチュートリアル:文献のサーベイ
a1da4
0
420
Other Decks in Technology
See All in Technology
次世代KYC活動報告 / 20250219-BizDay17-KYC-nextgen
oidfj
0
260
Oracle Cloud Infrastructure:2025年2月度サービス・アップデート
oracle4engineer
PRO
1
220
なぜ私は自分が使わないサービスを作るのか? / Why would I create a service that I would not use?
aiandrox
0
760
Cloud Spanner 導入で実現した快適な開発と運用について
colopl
1
720
運用しているアプリケーションのDBのリプレイスをやってみた
miura55
1
740
管理者しか知らないOutlookの裏側のAIを覗く#AzureTravelers
hirotomotaguchi
2
440
組織貢献をするフリーランスエンジニアという生き方
n_takehata
2
1.3k
Data-centric AI入門第6章:Data-centric AIの実践例
x_ttyszk
1
410
Nekko Cloud、 これまでとこれから ~学生サークルが作る、 小さなクラウド
logica0419
2
980
2.5Dモデルのすべて
yu4u
2
880
データ資産をシームレスに伝達するためのイベント駆動型アーキテクチャ
kakehashi
PRO
2
550
30分でわかる『アジャイルデータモデリング』
hanon52_
9
2.7k
Featured
See All Featured
Become a Pro
speakerdeck
PRO
26
5.1k
Adopting Sorbet at Scale
ufuk
74
9.2k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
The Language of Interfaces
destraynor
156
24k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
45
9.4k
Measuring & Analyzing Core Web Vitals
bluesmoon
6
240
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
59k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
12
960
Dealing with People You Can't Stand - Big Design 2015
cassininazir
366
25k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
VelocityConf: Rendering Performance Case Studies
addyosmani
328
24k
The Cult of Friendly URLs
andyhume
78
6.2k
Transcript
จݙհʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter
EMNLP2019 Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ
"CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ΘΓͱͳΔ͕"UUFOUJPOΑΓ͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱͰ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2
"UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO&YQMBOBUJPOʢઆ໌Λఏڙ͢Δͷʣ ɹͰͳ͍ʁ !3
&YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿྨλεΫ ɾjɿࢄΛ֬ೝ ɾjɿͷஅ ɾjɿఢରతֶश !4
&YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿํ-45. "UUFOUJPO !5
%FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6
&YQFSJNFOUjྨλεΫ w "UUFOUJPOͷඞཁੑΛௐͯɺྨ λεΫͱσʔληοτͷଥੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δͣ w ͭͷྨλεΫͰɺ"UUFOUJPOΛ
༻͍ͯ΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7
&YQFSJNFOUjࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ༻ͯͭ͠ͷϞσϧͰੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ
3FTVMUjࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ
&YQFSJNFOUjͷஅ w 6OJGPSNɿ.-1ग़ྗΛۉʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w
"EWFSTBSZɿఢରతֶशͰಘΒΕ ͨʹجͮ͘ ͭͷॏΈͷͰ j ͱಉ༷ʹྨ λεΫΛղ͖ɺൺֱ͢Δ !10
3FTVMUjͷஅ w 6OJGPSNɿ.-1ग़ྗΛۉʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w
"EWFSTBSZɿఢରతֶशͰಘΒΕ ͨʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷ྑ͍ ݁Ռʹͳͬͨ !11
.FUIPEjఢରతֶश w Ҏલͷͭʢj ʣ"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔҎ֎Ͱɺ"UUFOUJPOͱಉͷ༧ଌ͕Ͱ͖ΔΛ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬తޯ߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ
!12
&YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦͕ਓ͕ؒཧղͰ͖ΔߏʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO
ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳͷ͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO&YQMBOBUJPOͰͳ͍ͱ͞ΕΔ !13
$PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔ఆٛʹΑΔ w ༷ʑͳֶशํ๏ͰಘͨସͱͳΔɺैདྷͷ"UUFOUJPOʹൺͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14