[読み会]Teaching Categories to Human Learners with Visual Explanations

読み会資料
Teaching Categories to Human Learners with Visual Explanations (CVPR 2018)

Transcript

1. Teaching Categories to Human Learners with Visual Explanations ಡΈձ@2021/05/18 ༶໌఩
2.  •ը૾෼ྨͰػցڭࣔΛߦ͏ͱ͖ʹɼͲ͜ݟΔ΂͖͔ͷઆ໌Λ଍ ͯ͠ਓؒͷύϑΥʔϚϯεΛ͋͛ͨΑʂ ͻͱ͜ͱͰ͍͏ͱ ػցڭࣔ × ը૾
3.  •ஶऀ: •Oisin Mac Aodha, Shihan Su, Yuxin Chen, Pietro Person, Yisong Yue •California Institute of Technology •ग़య: CVPR 2018 •ͳΜͰಡΜ͔ͩ?: ࠷৽ͷػցڭࣔΛΩϟονΞοϓ͍͔ͨ͠Β ࿦จ৘ใ
4.  •ܭࢉػ͕ิॿ͢Δڭҭ → ݸਓ͝ͱʹಛԽͰ͖ΔΑ͏ʹͳ͍ͬͯ Δɽ •਺ֶ΍ݴޠڭҭͰ͸ɼશࣗಈͰߦ͑ΔΑ͏ʹͳΓͭͭ͋Δ •͔͠͠ɼઐ໳తͳ࿩(ҩֶͱ͔)Ͱ͸ະͩͰ͖ͳ͍ •υϝΠϯ஌ࣝΛڭ͑Δͷ͕೉͍͠ Πϯτϩ
5.  •Ϋϥ΢υιʔγϯάͷϫʔΧΛڭҭ͢Δ͜ͱ͕ඞཁ •ઐ໳ՈΛ࢖͑Δͷʹίετ͕͔͔Γ੍͔ͭݶ͕͋Δ •ڭҭͰ͖ͨΒߴ඼࣭ͳσʔληοτ͕࡞ΕΔ •΄͔ͷυϝΠϯʹରͯ͠΋ਓؒͷ൚Խྗ͕ద༻Ͱ͖Δ͔΋? Πϯτϩ
6.  •୯७ʹਖ਼ղϥϕϧͱαϯϓϧΛฦ͢ •͚Ͳ͜ΕͰຊ౰ʹ͍͍ͷʁ܇࿅Ͱ͖ͯΔͷʁʁ •આ໌Λ෇༩ֶͯ͠शޮՌΛߴΊΔ Πϯτϩ ͜Ε·Ͱͷػցڭࣔ͸Ͳ͏ͳͷʁ
7.  ఏҊ: Interpretable Visual Teaching ༻ޠͷఆٛΛ͍ͯ͘͠Α : ೖྗը૾ X : ਖ਼ղϥϕϧ Y :Ծઆू߹ ൑அج४ͷू߹ H
8.  •Ծઆ: ֶशࡁΈϞσϧͦͷ΋ͷɽೖྗۭ͔ؒΒग़ྗू߹΁ͷؔ਺ •Ծઆू߹: Ծઆ͕ू·͍ͬͯΔ΋ͷ. MLΞϧΰϦζϜͰ࡞ΒΕΔ Մೳੑͷ͋ΔϞσϧͷू·Γ •Ծઆू߹ͷதʹ͋ΔਅͷԾઆ ʹ͚͍ۙͮͯ͘ͷ͕໨త h⋆ ఏҊख๏ ͪΐͬͱৄ͘͠
9.  Title Text
10.  • ͳը૾ू߹ ʹରֶͯ͠शऀͷԾઆ ͸มԽ͢Δ Ծઆ ͷࣄޙ෼෍: ਪ࿦࣌: T ⊂ X T h h P(h ∣ T) ∝ P(h) ∏ xt ∈ T yt ≠ ̂ yh t P (y t ∣ h, x t) P (y t ∣ h, x t) = 1 1 + exp ( −αh (xt) yt) ఏҊख๏ STRICTΞϧΰϦζϜ: Կ΋͠ͳͱ͖ͷ ճ౴ʹର͢Δ ֬৴౓
11.  •ߋ৽ࣜ͸࣍ͷΑ͏ʹม͑Δ •৽͘͠2ͭͷݮਰ߲Λ௥Ճ͢Δ ఏҊख๏ EXPLAINΞϧΰϦζϜ: ϑΟʔυόοΫΛߟ͑Δͱ͖ P(h ∣ T) ∝ P(h) ∏ xt ∈ T yt ≠ ̂ yh t P (y t ∣ h, x t)∏ x t ∈T ( E (e t) D (x t))
12.  •આ໌ͷ࣭͸ը૾ͷ೉͠͞ͱಉ͡Α͏ʹଌΕͳ͍ɽ •ը૾ͷ೉қ౓͸൑ఆڥքͱͷڑ཭ͰܭࢉͰ͖Δ •ࣗಈੜ੒͢Δํ๏͸͋ͱͰग़ͯ͘ΔΑ ఏҊख๏ EXPLAINΞϧΰϦζϜ: Modeling Explanations E (e t) = 1 1 + exp ( −β diff (et)) ը૾ ʹର͢Δ༩͑ΒΕͨ આ໌ ͷ೉͠͞ x t e t
13.  •αϯϓϧtͷઆ໌ Λ࡞Γ͍ͨ •Ϋϥ΢υιʔγϯάͱ͔ઐ໳Ոͱ͔ʹ΍ͬͯ΋Β͏ͱ͔͋Δ͚ͲࣗಈͰ࡞ ΕΔͱΑ͘ͳ͍ʁ •CNNͷClass Activation MappingʹΑͬͯࣗಈͰઆ໌Λ࡞Δ e t ఏҊख๏ EXPLAINΞϧΰϦζϜ: ࣗಈੜ੒ e(j) = ∑ k wk c fk j (x) + b c
14.  •͖ͬ͞ఆٛͨ͠ը૾ͷઆ໌౓߹͍͔Βɼը૾ͷ೉қ౓Λఆٛ •ࣗಈͰઆ໌Λੜ੒͢Δ࣌ͷϞσϧͱͯ͠ResNetϕʔεͷϞσϧ Λར༻ ఏҊख๏ EXPLAINΞϧΰϦζϜ: ը૾ͷઆ໌ੑˠ೉қ౓ͷఆٛ diff(e) = − 1 J ∑ j e(j)log(e(j))
15.  •ैདྷ͸ᩦཉʹޡࠩ࠷খΛ࠷దԽ → ඞͣ͠΋༗ӹͰ͸ͳ͍ •ೳಈֶशʹώϯτΛಘͯɼΫϥεͷ୅දྫΛఏࣔ • ʹͳΔͱSTRICTͱಉ͡ʹͳΔ β, γ → ∞ ఏҊख๏ EXPLAINΞϧΰϦζϜ: Modeling Representativeness D (x t) = 1 1 + exp ( −γ dist (xt)) ଞͷը૾ͱൺ΂ͯ ͲΕ͘Β͍཭Ε͍ͯΔ͔ dist (x t) = 1 N N ∑ n=1 x t − x n 2 2
16.  •ڭࡐू߹ ͰͳʹΛબ୒͢Δ͔ → ֶशऀͷޡࠩΛݮΒ͍ͨ͠ •Ծઆ ʹରͯ͠ɼ؍ଌՄೳͳσʔλͱͷޡࠩΛ࣍ͷΑ͏ʹఆٛ T h ఏҊख๏ Teaching Algorithm: ͲͷαϯϓϧΛఏࣔ͢Δ͔ʁ err c (h) = x : ( ̂ yh ≠ y c ∧ y = y c) ∨ ( ̂ yh = y c ∧ y ≠ y c) | | .
17.  •ޡࠩͷظ଴஋͕Ұ൪େ͖ܰ͘ݮͰ͖ΔΑ͏ͳू߹Λબ୒ •͜ͷRΛ࠷େʹ͢ΔΑ͏ͳू߹T͕ཉ͍͠ڭࡐू߹ •͔͠͠ɼ௚઀ٻΊΔͷ͸ྼϞδϡϥੑ͔Βࠔ೉ •ྑ͍αϯϓϧΛ1ͭͣͭ௥Ճ͍ͯ͘͠ ఏҊख๏ ڭࡐू߹ͷબ୒ R(T) = 1 C ∑ c ( [err c (h)] − [err c (h) ∣ T]) = 1 C ∑ c∈ ∑ h∈ℋ (P c (h) − P c (h ∣ T)) err c (h) খ͘͞ͳΔ΄Ͳ خ͍͠ x t = argmax x R(T ∪ {x})
18.  •3ͭͷσʔληοτΛ༻͍ͯ༗ޮੑΛ֬ೝ͍ͯ͘͠ɽ 1. Butterflies (௏ࣝผ) 2. OCT Eyes (໢ບ਍அ) 3. Chinese Characters (จࣈࣝผ) ࣮ݧ σʔληοτ
19.  •Amazon Mechanical TurkͰඃݧऀ40ਓ •໛ࢼը૾͸ϥϯμϜʹఏࣔͯ͠ɼબ୒ճ౴ͷॱ൪΋ϥϯμϜʹ •ҐஔʹΑΔόΠΞεΛͳ͍ͯ͘͠Δɽ •ର߅ख๏ •RAND_IM: ϥϯμϜʹը૾ͱਖ਼ղϥϕϧ •RAND_EXP: ϥϯμϜը૾ͱͦͷઆ໌ •STRICT: ͍͍ײ͡ͷը૾Λબ୒͢Δ ࣮ݧઃఆ ͪΐͬͱৄࡉʹ
20.  ࣮ݧઃఆ ػցڭࣔͷྲྀΕ
21.  ࣮ݧ݁Ռ Butterfly ਖ਼౴཰ͷώετάϥϜ ͕ӈʹγϑτ͍ͯ͠Δ ͜ͷσʔληοτ͸೉͍͠܏޲ ࣅͨ3छ͸ࠞཚ͕ͪ͠
22.  ࣮ݧ આ໌ը૾ͷΠϝʔδ: Butterfly
23.  ࣮ݧ݁Ռ OCT Eyes ਖ਼౴཰ͷώετάϥϜ ͕ӈʹγϑτ͍ͯ͠Δ ϥϯμϜͰ΋޲্ ͯ͠͠·ͬͯΔ
24.  ࣮ݧ આ໌ը૾ͷΠϝʔδ: OCT Eyes
25.  ࣮ݧ݁Ռ Chinese Character CNNͷઆ໌͕ࣦഊ͠ ͍ͯΔ खಈͷઆ໌͕ ੑೳྑ͍
26.  ࣮ݧ આ໌ը૾ͷΠϝʔδ: Chinese Character
27.  •ࢹ֮తઆ໌ੑΛը૾ʹ༩͑ͯͦΕΛ΋ͱʹػցڭࣔΛߦͳͬͯ ͍͘ɽ •ैདྷͷਖ਼ղϥϕϧ͚ͩڭ͑Δํ๏ΑΓɼઆ໌͕͋Δํֶ͕शޮ Ռ͕ߴ͘ɼ͞ΒʹޮՌͷߴ͍ڭࡐू߹Λݟ͚ͭΕ͍ͯΔɽ •কདྷతʹΦϯϥΠϯͰΠϯλϥΫςΟϒʹ΍Γ͍ͨΑͶ ·ͱΊ ը૾આ໌෇͖ػցڭࣔ