Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
文献紹介:Attention is not not Explanation
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
Taichi Aida
August 28, 2019
Technology
240
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
文献紹介:Attention is not not Explanation
Taichi Aida
August 28, 2019
Transcript
14 slides
จݙհʢʣ Attention is not not Explanation Sarah Wiegreffe, Yuval Pinter
EMNLP2019 Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨɹ ૬ాɹଠҰ
"CTUSBDU w l"UUFOUJPOJTOPU&YQMBOBUJPOzͷओு&YQMBOBUJPOͷఆٛʹґଘ w ͋ΒΏΔཁૉΛߟྀͰ͖ΔΑ͏ʹɺͭͷ࣮ݧΛఏҊ͠ɺߦͳͬͨ w ΘΓͱͳΔ͕"UUFOUJPOΑΓ͏·͘ಈ࡞͠ͳ͔ͬͨͷͰɺ "UUFOUJPOͷ༗༻ੑΛ൱ఆ͢Δ͜ͱͰ͖ͳ͍͜ͱ͕Θ͔ͬͨ !2
"UUFOUJPOJTOPU&YQMBOBUJPO w"UUFOUJPOTDPSFͱॏཁͳࢦඪʢMFBWFPOFPVU HSBEJFOUʣͱͷؒʹ૬ؔ ͕ͳ͔ͬͨ w"UUFOUJPOͷΛϥϯμϜʹม͑ͨ࣌ʹ΄΅มΘΒͳ͍݁Ռ͕ग़ͨ wࢀߟɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJF BUUFOUJPOJTOPUFYQMBOBUJPO ˠ"UUFOUJPO&YQMBOBUJPOʢઆ໌Λఏڙ͢Δͷʣ ɹͰͳ͍ʁ !3
&YQFSJNFOU ɾ+8ɿઌߦݚڀ ɾjɿྨλεΫ ɾjɿࢄΛ֬ೝ ɾjɿͷஅ ɾjɿఢରతֶश !4
&YQFSJNFOUBM4FUVQ w @ ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱ΄΅ಉ͡ ɾϞσϧɿํ-45. "UUFOUJPO !5
%FpOJUJPOT Ҿ༻ɿIUUQTTQFBLFSEFDLDPNPLBZVXFOYJBOTIBPKJFBUUFOUJPOJTOPUFYQMBOBUJPO TMJEF ɾl"UUFOUJPOJTOPU&YQMBOBUJPOzͱಉ͡ !6
&YQFSJNFOUjྨλεΫ w "UUFOUJPOͷඞཁੑΛௐͯɺྨ λεΫͱσʔληοτͷଥੑΛ֬ೝ w "UUFOUJPO͕ඞཁͰ͋Δ߹ɺ#BTF ͱ6OJGPSNʢ"UUFOUJPOͷॏΈ͕ɹ ۉҰʣͷؒͰ݁Ռ͕ѱԽ͢Δͣ w ͭͷྨλεΫͰɺ"UUFOUJPOΛ
༻͍ͯ΄ͱΜͲվળ͠ͳ͍ w Ҏ߱ɺ͜ͷͭͷதͰ445ͷΈѻ͏ !7
&YQFSJNFOUjࢄͷ֬ೝ !8 ɾઌߦݚڀͰಘΒΕͨࢄ͕ ɹਖ਼͘͠ಘΒΕ͍ͯΔ͔֬ೝ ɾॳظԽͷϥϯμϜγʔυΛ ɹ༻ͯͭ͠ͷϞσϧͰੳ ɹʢTFFEʣ ɾఢରతͳϞσϧ ɹʢBEWFSTBSZʣ
3FTVMUjࢄͷ֬ೝ !9 ɾϥϯμϜγʔυͷมߋʹରͯ͠ ɹϩόετͰ͋Δ
&YQFSJNFOUjͷஅ w 6OJGPSNɿ.-1ग़ྗΛۉʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w
"EWFSTBSZɿఢରతֶशͰಘΒΕ ͨʹجͮ͘ ͭͷॏΈͷͰ j ͱಉ༷ʹྨ λεΫΛղ͖ɺൺֱ͢Δ !10
3FTVMUjͷஅ w 6OJGPSNɿ.-1ग़ྗΛۉʹߟྀ w 5SBJOFE.-1ɿ.-1ʹ "UUFOUJPOΛֶशͤ͞Δ w #BTF-45.ɿγϯϓϧͳ-45. ͷ"UUFOUJPOMBZFSͰී௨ʹֶश w
"EWFSTBSZɿఢରతֶशͰಘΒΕ ͨʹجͮ͘ w "UUFOUJPOΛ༻͍ͨ #BTF-45.͕࠷ྑ͍ ݁Ռʹͳͬͨ !11
.FUIPEjఢରతֶश w Ҏલͷͭʢj ʣ"UUFOUJPOͷ༗ҙੑΛςετ͢Δํ๏ w "UUFOUJPOʹΑΔҎ֎Ͱɺ"UUFOUJPOͱಉͷ༧ଌ͕Ͱ͖ΔΛ ಘΔͨΊʹɺఢରతֶशΛ༻͍Δ w ֬తޯ߱Լ๏Ͱߋ৽͠ɺϞσϧ.BΛಘΔ
!12
&YQMBOBUJPO w ʮઆ໌Մೳͳ"*ʯɿಁ໌ੑɺઆ໌ՄೳੑɺղऍՄೳੑ w -JQUPO ɿಁ໌ੑΛʮϞσϧͷಛఆͷ෦͕ਓ͕ؒཧղͰ͖ΔߏʹରԠ ͢Δํ๏ʯͱఆٛ w 3VEJO
ɿઆ໌ՄೳੑʻղऍՄೳੑͱఆٛ w ʮೖྗͷಛఆͷཁૉʹߴ͍"UUFOUJPOXFJHIU͕͋ΔͱɺϞσϧ͕ͦͷ༧ଌΛ ߦ͏͜ͱʹͭͳ͕Δʁʯ w ෳͷ͔Βಉ͡༧ଌ͕ಘΒΕͨ࣌ɺಁ໌ੑͷԼͷഉଞੑʹΑΓɺ "UUFOUJPO&YQMBOBUJPOͰͳ͍ͱ͞ΕΔ !13
$PODMVTJPO w &YQMBOBUJPO͔Ͳ͏͔ఆٛʹΑΔ w ༷ʑͳֶशํ๏ͰಘͨସͱͳΔɺैདྷͷ"UUFOUJPOʹൺͯ݁ Ռ͕ѱ͔ͬͨʢjʣɻ͜ΕʹΑΓɺ"UUFOUJPO͕τʔΫϯͱ༧ଌͷؔ ʹ͍ͭͯҙٛͷ͋Δ͜ͱΛֶश͍ͯ͠Δͱ͍͏͜ͱ͕ߟ͑ΒΕΔɻ !14
More Decks by Taichi Aida
See All by Taichi Aida
意味を表すベクトル表現を用いたテキスト分析
a1da4
0
180
スウェーデン滞在報告
a1da4
0
56
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
a1da4
1
350
文献紹介:A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
a1da4
1
450
YANS2024:目指せ国際会議!「ネットワーキングの極意(国際会議編)」
a1da4
0
370
言語処理学会30周年記念事業留学支援交流会@YANS2024:「学生のための短期留学」
a1da4
1
500
新入生向けチュートリアル:文献のサーベイv2
a1da4
19
14k
文献紹介:Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
a1da4
0
280
文献紹介:WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
a1da4
1
430
Other Decks in Technology
See All in Technology
JAWSコミュニティに 参加して1年経った結果
ssakita
0
140
E2E Test というハーネス — AI時代の自動テスト民主化
daishukojima
1
530
これからのデータエンジニアの役割について考える / Rethinking the Role of Data Engineers in the AI Era
okiyuki99
0
480
自治体AIコンタクトセンター、何をどこに任せる?~Amazon Connect Customer +Amazon Bedrockの実践知~ / 20261107 Satoshi Torano
shift_evolve
PRO
1
140
Agent Harnessはどう作る?事例から学ぶAI Agentの設計思想
sergicalsix
0
290
内製アプリとClaudeスキルのセキュリティチェック、 Backlogの課題で回しています。
ayaka_egaaa
0
180
高品質と高スピードを支える品質のシフトレフトのアプローチ
goyoki
3
890
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
17
120k
「AIチャットからもできないの?」と言われたら ~業務アプリをMCP対応するときの認証・認可の勘所
oidfj
0
320
マネジメントされる側の仕事は「文句」を言うこと
riyaamemiya
2
740
Kiro IDE 入門 (画面の各部から、頼み方、任せ方、戻し方まで) | 目指せ Kiro マスター 02
inariku
PRO
4
230
2026-11-11 Tamachi.sre#7 PaCにインフラリソースの命を救われました。 / PaC saves the infra resource life
masasuzu
0
160
Featured
See All Featured
Darren the Foodie - Storyboard
khoart
PRO
5
4.1k
Typedesign – Prime Four
hannesfritz
42
3.2k
Chasing Engaging Ingredients in Design
codingconduct
0
390
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.9k
KATA
mclloyd
PRO
35
16k
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
aleyda
1
2.2k
Tips & Tricks on How to Get Your First Job In Tech
honzajavorek
1
850
Abbi's Birthday
coloredviolet
5
11k
Art, The Web, and Tiny UX
lynnandtonic
304
22k
Why Our Code Smells
bkeepers
PRO
340
58k
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
soudai
PRO
68
60k
Game over? The fight for quality and originality in the time of robots
wayneb77
1
330