Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
[読み会]Teaching Categories to Human Learners with Visual Explanations
Search
mei28
May 18, 2021
0
20
[読み会]Teaching Categories to Human Learners with Visual Explanations
読み会資料
Teaching Categories to Human Learners with Visual Explanations (CVPR 2018)
mei28
May 18, 2021
Tweet
Share
More Decks by mei28
See All by mei28
[Human-AI Decision Making勉強会] 意思決定 with AIは個人vsグループで変わるの?
mei28
0
130
[読み会] Words are All You Need? Language as an Approximation for Human Similality Judgements
mei28
0
15
[参加報告] AAAI'23
mei28
0
55
[計算機構論] Learning Models of Individual Behavior in Chess
mei28
0
53
[計算機構論] Why do tree-based models still outperform deep learning on tabular data?
mei28
0
31
チーム開発と機械学習
mei28
0
33
[読み会] Knowledge distillation: A good teacher is patient and consistent
mei28
0
28
[読み会] ControlBurn- Feature Selection by Sparse Forests
mei28
0
18
[読み会] Learning Representations by Humans, for Humans
mei28
0
21
Featured
See All Featured
Faster Mobile Websites
deanohume
300
30k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
26
2.3k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
275
13k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
188
16k
Raft: Consensus for Rubyists
vanstee
133
6.3k
Agile that works and the tools we love
rasmusluckow
325
20k
Fantastic passwords and where to find them - at NoRuKo
philnash
39
2.5k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
117
18k
How GitHub (no longer) Works
holman
305
140k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
22
1.6k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
660
120k
Bootstrapping a Software Product
garrettdimon
PRO
302
110k
Transcript
Teaching Categories to Human Learners with Visual Explanations ಡΈձ@2021/05/18 ༶໌
•ը૾ྨͰػցڭࣔΛߦ͏ͱ͖ʹɼͲ͜ݟΔ͖͔ͷઆ໌Λ ͯ͠ਓؒͷύϑΥʔϚϯεΛ͋͛ͨΑʂ ͻͱ͜ͱͰ͍͏ͱ ػցڭࣔ × ը૾
•ஶऀ: •Oisin Mac Aodha, Shihan Su, Yuxin Chen, Pietro
Person, Yisong Yue •California Institute of Technology •ग़య: CVPR 2018 •ͳΜͰಡΜ͔ͩ?: ࠷৽ͷػցڭࣔΛΩϟονΞοϓ͍͔ͨ͠Β จใ
•ܭࢉػ͕ิॿ͢Δڭҭ → ݸਓ͝ͱʹಛԽͰ͖ΔΑ͏ʹͳ͍ͬͯ Δɽ •ֶݴޠڭҭͰɼશࣗಈͰߦ͑ΔΑ͏ʹͳΓͭͭ͋Δ •͔͠͠ɼઐతͳ(ҩֶͱ͔)ͰະͩͰ͖ͳ͍ •υϝΠϯࣝΛڭ͑Δͷ͕͍͠ Πϯτϩ
•ΫϥυιʔγϯάͷϫʔΧΛڭҭ͢Δ͜ͱ͕ඞཁ •ઐՈΛ͑Δͷʹίετ͕͔͔Γ੍͔ͭݶ͕͋Δ •ڭҭͰ͖ͨΒߴ࣭ͳσʔληοτ͕࡞ΕΔ •΄͔ͷυϝΠϯʹରͯ͠ਓؒͷ൚Խྗ͕ద༻Ͱ͖Δ͔? Πϯτϩ
•୯७ʹਖ਼ղϥϕϧͱαϯϓϧΛฦ͢ •͚Ͳ͜ΕͰຊʹ͍͍ͷʁ܇࿅Ͱ͖ͯΔͷʁʁ •આ໌Λ༩ֶͯ͠शޮՌΛߴΊΔ Πϯτϩ ͜Ε·ͰͷػցڭࣔͲ͏ͳͷʁ
ఏҊ: Interpretable Visual Teaching ༻ޠͷఆٛΛ͍ͯ͘͠Α : ೖྗը૾ X :
ਖ਼ղϥϕϧ Y :Ծઆू߹ அج४ͷू߹ H
•Ծઆ: ֶशࡁΈϞσϧͦͷͷɽೖྗۭ͔ؒΒग़ྗू߹ͷؔ •Ծઆू߹: Ծઆ͕ू·͍ͬͯΔͷ. MLΞϧΰϦζϜͰ࡞ΒΕΔ Մೳੑͷ͋ΔϞσϧͷू·Γ •Ծઆू߹ͷதʹ͋ΔਅͷԾઆ ʹ͚͍ۙͮͯ͘ͷ͕త h⋆
ఏҊख๏ ͪΐͬͱৄ͘͠
Title Text
• ͳը૾ू߹ ʹରֶͯ͠शऀͷԾઆ มԽ͢Δ Ծઆ ͷࣄޙ: ਪ࣌: T ⊂
X T h h P(h ∣ T) ∝ P(h) ∏ xt ∈ T yt ≠ ̂ yh t P (y t ∣ h, x t) P (y t ∣ h, x t) = 1 1 + exp ( −αh (xt) yt) ఏҊख๏ STRICTΞϧΰϦζϜ: Կ͠ͳͱ͖ͷ ճʹର͢Δ ֬৴
•ߋ৽ࣜ࣍ͷΑ͏ʹม͑Δ •৽͘͠2ͭͷݮਰ߲ΛՃ͢Δ ఏҊख๏ EXPLAINΞϧΰϦζϜ: ϑΟʔυόοΫΛߟ͑Δͱ͖ P(h ∣ T) ∝
P(h) ∏ xt ∈ T yt ≠ ̂ yh t P (y t ∣ h, x t)∏ x t ∈T ( E (e t) D (x t))
•આ໌ͷ࣭ը૾ͷ͠͞ͱಉ͡Α͏ʹଌΕͳ͍ɽ •ը૾ͷқఆڥքͱͷڑͰܭࢉͰ͖Δ •ࣗಈੜ͢Δํ๏͋ͱͰग़ͯ͘ΔΑ ఏҊख๏ EXPLAINΞϧΰϦζϜ: Modeling Explanations E (e
t) = 1 1 + exp ( −β diff (et)) ը૾ ʹର͢Δ༩͑ΒΕͨ આ໌ ͷ͠͞ x t e t
•αϯϓϧtͷઆ໌ Λ࡞Γ͍ͨ •Ϋϥυιʔγϯάͱ͔ઐՈͱ͔ʹͬͯΒ͏ͱ͔͋Δ͚ͲࣗಈͰ࡞ ΕΔͱΑ͘ͳ͍ʁ •CNNͷClass Activation MappingʹΑͬͯࣗಈͰઆ໌Λ࡞Δ e t
ఏҊख๏ EXPLAINΞϧΰϦζϜ: ࣗಈੜ e(j) = ∑ k wk c fk j (x) + b c
•͖ͬ͞ఆٛͨ͠ը૾ͷઆ໌߹͍͔Βɼը૾ͷқΛఆٛ •ࣗಈͰઆ໌Λੜ͢Δ࣌ͷϞσϧͱͯ͠ResNetϕʔεͷϞσϧ Λར༻ ఏҊख๏ EXPLAINΞϧΰϦζϜ: ը૾ͷઆ໌ੑˠқͷఆٛ diff(e) = −
1 J ∑ j e(j)log(e(j))
•ैདྷᩦཉʹޡࠩ࠷খΛ࠷దԽ → ඞͣ͠༗ӹͰͳ͍ •ೳಈֶशʹώϯτΛಘͯɼΫϥεͷදྫΛఏࣔ • ʹͳΔͱSTRICTͱಉ͡ʹͳΔ β, γ →
∞ ఏҊख๏ EXPLAINΞϧΰϦζϜ: Modeling Representativeness D (x t) = 1 1 + exp ( −γ dist (xt)) ଞͷը૾ͱൺͯ ͲΕ͘Β͍Ε͍ͯΔ͔ dist (x t) = 1 N N ∑ n=1 x t − x n 2 2
•ڭࡐू߹ ͰͳʹΛબ͢Δ͔ → ֶशऀͷޡࠩΛݮΒ͍ͨ͠ •Ծઆ ʹରͯ͠ɼ؍ଌՄೳͳσʔλͱͷޡࠩΛ࣍ͷΑ͏ʹఆٛ T h ఏҊख๏
Teaching Algorithm: ͲͷαϯϓϧΛఏࣔ͢Δ͔ʁ err c (h) = x : ( ̂ yh ≠ y c ∧ y = y c) ∨ ( ̂ yh = y c ∧ y ≠ y c) | | .
•ޡࠩͷظ͕Ұ൪େ͖ܰ͘ݮͰ͖ΔΑ͏ͳू߹Λબ •͜ͷRΛ࠷େʹ͢ΔΑ͏ͳू߹T͕ཉ͍͠ڭࡐू߹ •͔͠͠ɼٻΊΔͷྼϞδϡϥੑ͔Βࠔ •ྑ͍αϯϓϧΛ1ͭͣͭՃ͍ͯ͘͠ ఏҊख๏ ڭࡐू߹ͷબ R(T) = 1
C ∑ c ( [err c (h)] − [err c (h) ∣ T]) = 1 C ∑ c∈ ∑ h∈ℋ (P c (h) − P c (h ∣ T)) err c (h) খ͘͞ͳΔ΄Ͳ خ͍͠ x t = argmax x R(T ∪ {x})
•3ͭͷσʔληοτΛ༻͍ͯ༗ޮੑΛ֬ೝ͍ͯ͘͠ɽ 1. Butterflies (ࣝผ) 2. OCT Eyes (ບஅ) 3.
Chinese Characters (จࣈࣝผ) ࣮ݧ σʔληοτ
•Amazon Mechanical TurkͰඃݧऀ40ਓ •ࢼը૾ϥϯμϜʹఏࣔͯ͠ɼબճͷॱ൪ϥϯμϜʹ •ҐஔʹΑΔόΠΞεΛͳ͍ͯ͘͠Δɽ •ର߅ख๏ •RAND_IM: ϥϯμϜʹը૾ͱਖ਼ղϥϕϧ •RAND_EXP:
ϥϯμϜը૾ͱͦͷઆ໌ •STRICT: ͍͍ײ͡ͷը૾Λબ͢Δ ࣮ݧઃఆ ͪΐͬͱৄࡉʹ
࣮ݧઃఆ ػցڭࣔͷྲྀΕ
࣮ݧ݁Ռ Butterfly ਖ਼ͷώετάϥϜ ͕ӈʹγϑτ͍ͯ͠Δ ͜ͷσʔληοτ͍͠ ࣅͨ3छࠞཚ͕ͪ͠
࣮ݧ આ໌ը૾ͷΠϝʔδ: Butterfly
࣮ݧ݁Ռ OCT Eyes ਖ਼ͷώετάϥϜ ͕ӈʹγϑτ͍ͯ͠Δ ϥϯμϜͰ্ ͯ͠͠·ͬͯΔ
࣮ݧ આ໌ը૾ͷΠϝʔδ: OCT Eyes
࣮ݧ݁Ռ Chinese Character CNNͷઆ໌͕ࣦഊ͠ ͍ͯΔ खಈͷઆ໌͕ ੑೳྑ͍
࣮ݧ આ໌ը૾ͷΠϝʔδ: Chinese Character
•ࢹ֮తઆ໌ੑΛը૾ʹ༩͑ͯͦΕΛͱʹػցڭࣔΛߦͳͬͯ ͍͘ɽ •ैདྷͷਖ਼ղϥϕϧ͚ͩڭ͑Δํ๏ΑΓɼઆ໌͕͋Δํֶ͕शޮ Ռ͕ߴ͘ɼ͞ΒʹޮՌͷߴ͍ڭࡐू߹Λݟ͚ͭΕ͍ͯΔɽ •কདྷతʹΦϯϥΠϯͰΠϯλϥΫςΟϒʹΓ͍ͨΑͶ ·ͱΊ ը૾આ໌͖ػցڭࣔ