Share
Embed
Transcript
38 slides
-
౷ܭతҼՌਪͷհ matsuno 2020 12 ݄ 19 matsuno ౷ܭతҼՌਪͷհ
2020 12 ݄ 19 1 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 2 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 3 / 38 -
૬ؔͰͩΊͳྫ ͋ΔσʔλͰɺεϚϗήʔϜͷςϨϏ CM Λݟͨάϧʔϓͷํ͕ɺςϨϏ CM Λݟͯ ͍ͳ͍άϧʔϓʹൺͯεϚϗήʔϜͷར༻͕࣌ؒগͳ͍ [2] ʷ CM
ΛݟΔͱར༻͕࣌ؒݮগ͢Δɻར༻࣌ؒΛ૿ͨ͢Ίʹ CM Λ์ૹ͠ͳ͍ ˓ CM ΛݟΔਓςϨϏࢹௌ͕࣌ؒ͘ɺͱͱεϚϗͷར༻ස͕͍ ૬ؔؔͰͳ͘ɺҼՌؔΛݟΔඞཁ͕͋Δ ςϨϏࢹௌ࣌ؒεϚϗͷར༻සɺςϨϏ CM ΛݟΔ͔൱͔ͱɺεϚϗήʔϜͷར ༻࣌ؒͷ྆ํʹӨڹ͢Δ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 5 / 38 -
૬ؔؔɺҼՌؔɺަབྷɺٖࣅ૬ؔ ૬ؔؔ X ͕େ͖͍ͱ͖ʹ Y ͕େ͖͍ɺ·ͨখ͍͞ͱ͖ɺX ͱ Y ͷؒʹ૬͕ؔؔ͋Δͱ ͍͏
ҼՌؔ X ΛมԽͤͨ͞ͱ͖ʹ Y มԽ͢Δͱ͖ɺX ͱ Y ͷؒʹҼՌ͕ؔ͋Δͱ͍͏ ͜ͷͱ͖ɺX ΛݪҼɺY Λ݁ՌͱݺͿ ަབྷ X ͱ Y ͷͦΕͧΕΛ݁Ռͱ͢Δڞ௨ͷݪҼ C ͕͋Δͱ͖ɺ͜ͷߏΛަབྷͱ͍͏ ͜ͷͱ͖ C ΛަབྷҼࢠͱ͍͏ ٙࣅ૬ؔ ͷҼՌ͕ؔແ͍มؒʹݱΕΔ૬ؔؔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 6 / 38 -
ٙࣅ૬ؔͷྫ [3] Nicholas Cage Swimming pool drownings Number of people
who drowned by falling into a pool correlates with Films Nicolas Cage appeared in Nicholas Cage Swimming pool drownings 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 0 films 2 films 4 films 6 films 80 drownings 100 drownings 120 drownings 140 drownings tylervigen.com matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 7 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 9 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 10 / 38 -
ه๏ X: հೖର͕ͭಛྔ ࿈ଓ·ͨ 2 ͱ͢Δ ଟ࣍ݩͰΑ͍ ҼՌਪͷจ຺ͰʮڞมྔʯͱݺΕΔ Y ͱ
Z ͷަབྷҼࢠ Z: հೖͷ༗ແΛද͢ม Z = 0 ͳΒհೖແ͠ɺZ = 1 ͳΒհೖ͋Γ Ұൠʹ X ʹґଘܾͯ͠·Δ Y : ݁Ռม ࿈ଓ·ͨ 2 Ұൠʹ X ͱ Z ͷ྆ํʹґଘܾͯ͠·Δ X Z Y matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 11 / 38 -
࣮ݧݚڀ Z ͷ Y ͷޮՌΛΓ͚ͨΕɺX ͕ Y , Z ʹӨڹ͠ͳ͍Α͏ʹσʔλΛऩू͢Δͷ
͕࠷ޮՌత X Z Y දతͳํ๏ ୯७ແ࡞ҝׂΓ͚ɿͯ͢ͷݸମΛɺϥϯμϜʹॲஔ܈ (Z = 1) ͱରর܈ (Z = 0) ʹׂ Γ͚ ཚմ๏ɿॲஔޮՌʹӨڹ͢Δ͜ͱ͕ఆ͞ΕΔҼࢠʢྫɿੑผͳͲʣʹ͍ͭͯɺ྆܈Ͱό ϥϯεΛͱͬͯϥϯμϜʹׂΓ͚ ҰରൺֱɿഎܠҼࢠ͕ྨࣅͷݸମΛରԠͤ͞ɺॲஔ܈ͱରর܈ʹׂΓ͚ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 12 / 38 -
࣮ԾϞσϧ ࣄ࣮Ϟσϧɺcounterfactual model ͱ ݁Ռมຊདྷ 2 ม͋Δͱߟ͑Δ Y1 : ݸମ͕ॲஔ܈
Z = 1 ʹׂΓ͚ΒΕͨͱ͖ʹಘΒΕΔ݁Ռ Y0 : ݸମ͕ରর܈ Z = 0 ʹׂΓ͚ΒΕͨͱ͖ʹಘΒΕΔ݁Ռ Y1, Y0 જࡏత݁ՌมͱݺΕɺݪཧతʹಉ࣌ʹ؍ଌͰ͖ͳ͍ જࡏత݁ՌมΛ༻͍Δͱɺ؍ଌ Y ҎԼͷΑ͏ʹද͞ΕΔ Y = ZY1 + (1 − Z)Y0 matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 14 / 38 -
ҼՌޮՌͷఆٛ ॲஔͷޮՌ = ॲஔΛߦͬͨ߹ͱߦΘͳ͔ͬͨ߹ͷ݁Ռͷࠩ Y1 − Y0 Y0, Y1 ݸମʹରͯ͠ಉ࣌ʹ؍ଌͰ͖ͳ͍ͷͰɺूஂશମͰͷޮՌΛධՁରͱ
͢Δ ฏۉॲஔޮՌ (Average Treatment Effect, ATE) ATE = E[Y1 − Y0] = E[Y1] − E[Y0] ATE ΛͲͷΑ͏ʹਪఆ͢Δ͔ɺ͕౷ܭతҼՌਪͷओͳςʔϚ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 15 / 38 -
ͦͷଞͷҼՌޮՌ ॲஔ܈ʹ͓͚ΔฏۉॲஔޮՌ (Average Treatment Effect on the Treated, ATT) ATT
= E[Y1 − Y0|Z = 1] ॲஔʹΑͬͯಘΒΕͨޮՌ ରর܈ʹ͓͚ΔฏۉॲஔޮՌ (Average Treatment Effect on the Untreated, ATU) ATU = E[Y1 − Y0|Z = 0] ॲஔରͰͳ͔ͬͨूஂʹɺ࣮͠ࢪͨ͠ͱ͖ͷޮՌ ॲஔରΛ͛Δ͖͔Ͳ͏͔ͷஅࡐྉʹͳΔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 16 / 38 -
SUTVA ݅ ॲஔޮՌ͕ѻ͍͍͢ܗͰఆٛ͞ΕΔͨΊͷ݅ SUTVA (stable unit treatment value assumption) ݅
1 ݸମͷજࡏత݁Ռมɺଞͷݸମ͕ड͚Δॲஔʹґଘ͠ͳ͍ 2 ॲஔ 1 ௨Γʹఆ·Δ ݅ 1 ʹ͍ͭͯ ૬ޓׯব͕ͳ͍͜ͱ ҙਂ͍࣮ݧσβΠϯɺ݅ͷଥੑͷධՁ͕ඞཁ Γཱͨͳ͍߹ʹɺ૬ޓґଘੑͷϞσϧԽɺґଘؔʹ͋ΔάϧʔϓΛ 1 ݸମͱ͠ ͯѻ͏ඞཁ͕͋Δ ݅ 2 ʹ͍ͭͯ ॲஔͷ༰Λ໌֬ʹ͢Δ͜ͱ ྫɿ෩अༀͷޮՌʜ1 Կճʁ1 ճ͋ͨΓԿৣʁ৯લʁ৯ޙʁ ҎԼͰ SUTVA ݅Γཱ͍ͬͯΔͷͱ͢Δ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 17 / 38 -
ATE ͕ਪఆͰ͖ΔͨΊͷ݅ ڧ͍ҙຯͰͷແࢹՄೳੑ 1 ͖݅ಠཱੑ Y0, Y1 ⊥ Z |
X X ͕༩͑ΒΕΕɺY0, Y1 ͱ Z ಠཱ ަབྷҼࢠ X Ͱਚ͘͞Ε͍ͯͯɺଞʹॏཁͳަབྷҼࢠແ͍ 2 ͖݅ਖ਼ੑ 0 < P(Z = 1|X) < 1 X ͕༩͑ΒΕͨͱ͖ɺඞͣॲஔΛ͢Δʗ͠ͳ͍ͱ͍ͬͨϧʔϧଘࡏ͠ͳ͍ ҙͷ X ʹ͍ͭͯΓཱͭ͜ͱ͕ඞཁͳɺڧ͍݅ ҎԼͰ͜ͷ݅Γཱ͍ͬͯΔͱ͢Δ e(X) = P(Z = 1|X) είΞͱݺΕΔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 18 / 38 -
ڧ͍ҙຯͰͷແࢹՄೳੑ͕Γཱͭ߹ͷ ATE E[Y1] ɺఆ͔ٛΒ E[Y1] = ∑ Y1 Y1P(Y1) =
∑ X,Z ∑ Y1 Y1P(X, Y1, Z) ͖݅ಠཱੑ͔ΒɺP(X, Y1, Z) = P(Y1, Z|X)P(X) = P(Y1|X)P(Z|X)P(X) ͱղͰ͖ͯ E[Y1] = ∑ X,Z ∑ Y1 Y1P(Y1|X)P(Z|X)P(X) = ∑ X ∑ Y1 Y1P(Y1|X)P(X) matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 19 / 38 -
ڧ͍ҙຯͰͷແࢹՄೳੑ͕Γཱͭ߹ͷ ATE Y1 Z = 1 ͷͱ͖ͷ Y ͳͷͰɺ͖݅ਖ਼ੑ͕Γཱ͍ͬͯΕ
E[Y1] = ∑ X ∑ Y YP(Y |Z = 1, X)P(X) = EX [E[Y |Z = 1, X]] E[Y0] ʹ͍ͭͯಉ༷ʹܭࢉ͢Δͱ ATE = E[Y1] − E[Y0] = EX [E[Y |Z = 1, X]] − EX [E[Y |Z = 0, X]] ͱͳΓɺ؍ଌͰ͖Δྔ͔ΒਪఆՄೳʹͳΔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 20 / 38 -
είΞͷੑ࣭ ఆཧɿόϥϯγϯά ڞมྔ X ͱׂΓ͚ม Z ɺείΞ e(X) ͷͱͰ͖݅ಠཱ X
⊥ Z | e(X) ಉ͡είΞΛͭݸମ͕ͭ X ͷɺॲஔ܈ͱରর܈ͱͰ͍͠ ূ໌ɿ ͖݅ಠཱੑͷఆٛɿ X ⊥ Z | e(X) ⇔ P(X, Z = 1|e(X)) = P(X|e(X))P(Z = 1|e(X)) ҰํͰɺ͖݅֬ͷੑ࣭͔Β P(X, Z = 1|e(X)) = P(X|e(X))P(Z = 1|X, e(X)) = P(X|e(X))e(X) ͳͷͰɺP(Z = 1|e(X)) = e(X) ΛࣔͤΕΑ͍ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 21 / 38 -
είΞͷੑ࣭ ূ໌ʢଓ͖ʣ ɿ P(Z = 1|e(X)) = E[Z|e(X)] ظͷੑ࣭ E[A]
= EB[E[A|B]] ΑΓɺ P(Z = 1|e(X)) = EX|e(X) [E[Z|X]|e(X)] = EX|e(X) [e(X)|e(X)] = e(X) 2 matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 22 / 38 -
είΞͷੑ࣭ ఆཧɿ͖݅ಠཱੑ જࡏత݁Ռม Y0, Y1 ͱׂΓ͚ม Z ɺείΞ e(X) ͷͱͰ͖݅ಠཱ
Y0, Y1 ⊥ Z | e(X) ূ໌ɿ ͖݅ಠཱੑͷఆٛɿ Y0 ⊥ Z | e(X) ⇔ P(Y0, Z = 1|e(X)) = P(Y0|e(X))P(Z = 1|e(X)) = P(Y0|e(X))e(X) ҰํͰɺ͖݅֬ͷੑ࣭͔Β P(Y0, Z = 1|e(X)) = P(Z = 1|e(X), Y0)P(Y0|e(X)) ͳͷͰɺP(Z = 1|e(X), Y0) = e(X) ΛࣔͤΕΑ͍ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 23 / 38 -
είΞͷੑ࣭ ূ໌ʢଓ͖ʣ ɿ P(Z = 1|e(X), Y0) = E[Z|e(X), Y0]
ظͷੑ࣭ E[A] = EB[E[A|B]] ͖݅ಠཱੑ X ⊥ Z | e(X) Λॱʹద༻͢Δͱɺ P(Z = 1|e(X)) = EX|e(X),Y0 [E[Z|X, e(X), Y0]|e(X), Y0] = EX|e(X),Y0 [E[Z|X, Y0]|e(X), Y0] = EX|e(X),Y0 [E[Z|X]|e(X), Y0] = EX|e(X),Y0 [e(X)|e(X), Y0] = e(X) Y0 Λ Y1 ͱͯ͠ಉ༷ʹܭࢉͰ͖Δɻ 2 matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 24 / 38 -
είΞΛ༻͍ͨ ATE ظͷੑ࣭ E[A] = EB[E[A|B]] ͱ͖݅ಠཱੑ Y0, Y1 ⊥
Z | e(X) ΑΓɺ ATE = E[Y1] − E[Y0] = Ee(X) [E[Y1|e(X)]] − Ee(X) [E[Y0|e(X)]] = Ee(X) [E[Y |Z = 1, e(X)]] − Ee(X) [E[Y |Z = 0, e(X)]] X શମͰͳ͘ɺείΞ e(X) ͷͰظΛͱΕ ATE ͷධՁ͕Մೳ είΞ e(X) = P(Z = 1|X) ͷਪఆʹϩδεςΟ οΫճؼɺछʑͷػցֶशϞσ ϧ͕༻͍ΒΕΔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 25 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 26 / 38 -
ATE ਪఆͷͨΊͷख๏ ATE = EX [E[Y |Z = 1, X]]
− EX [E[Y |Z = 0, X]] = Ee(X) [E[Y |Z = 1, e(X)]] − Ee(X) [E[Y |Z = 0, e(X)]] ATE ͷਪఆ ˆ τ ΛಘΔ͢ΔͨΊͷख๏ɿ 1 Ϛονϯά 2 Խղੳ๏ 3 ॏΈ͚๏ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 27 / 38 -
Ϛονϯά ॲஔ܈ Z = 1 ͱରর܈ Z = 0 ͔Βɺڞมྔ
X ͕ࣅ͍ͯΔݸମΛରԠ͚ ରԠ͚͞Εͨ k ൪ͷϖΞͷ݁ՌมΛ Y (k) 1 , Y (k) 0 ͱ͢Δͱɺ ˆ τ = 1 K K ∑ k=1 (Y (k) 1 − Y (k) 0 ) ྨࣅͷج४ɿ ڞมྔͷ͝ͱʹॏΈ͚ͨ͠ L1 ڑɺL2 ڑ ڞมྔͷڞࢄߦྻ Σ Λ༻͍ͨϚϋϥϊϏεڑ (Xi − Xj )T Σ−1(Xi − Xj ) είΞͷࠩͷઈର matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 28 / 38 -
ผղੳ๏ X ʹͱ͖ͮݸମΛ K ݸͷʹׂ͠ɺ֤ͷฏۉΛ౷߹ͯ͠ਪఆ݁ՌΛಘΔ ୈ k ʹׂΓͯΒΕͨݸମͷൺΛ q(k)ɺॲஔ܈ Z
= 1 ͱରর܈ Z = 0 ͷ݁Ռม ͷฏۉΛ Y (k) 1 , Y (k) 0 ͱ͢Δͱ ˆ τ = K ∑ k=1 q(k)(Y (k) 1 − Y (k) 0 ) Ϛονϯάผղੳ๏Ͱɺ֤ʹॲஔ܈ͱର܈Λ 1 ݸମؚͣͭΉಛผͳ߹ ڞมྔ X ͷ࣍ݩ͕ߴ͍߹ʹɺείΞʹΑΔԽ͕༗ޮ είΞ͕Ε͍ͯͯɺແཧΓಉ͡ʹׂΓͯΒΕͯ͠·͏Մೳੑʹҙ͕ ඞཁ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 30 / 38 -
ॏΈ͚๏ ֬ e(X) Ͱॲஔ܈ʹׂΓͯΒΕΔݸମͷ E[Y1] ͷد༩ Y1/e(X) Ͱ͋Δ͜ͱΛ ߟྀ͢Δͱ ˆ
τ = 1 N N ∑ i=1 Zi Yi e(Xi ) − 1 N N ∑ i=1 (1 − Zi )Yi 1 − e(Xi ) e(X), 1 − e(X) ͕খ͍͞ͱਪఆ݁Ռ͕ෆ҆ఆʹͳΔʹҙ͕ඞཁ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 31 / 38 -
ൃలɿೋॏʹϩόετͳਪఆ๏ ॲஔ܈ɺରর܈ͷͦΕͧΕʹׂΓͯͨ߹ͷ݁ՌมΛϞσϧԽ (g1(X), g0(X)) ͨ͠ ߹ લϖʔδͷ ATE ͷਪఆΛ࣍ͷΑ͏ʹมߋͯ͠ΈΔ ˆ
τ = 1 N N ∑ i=1 ( Zi Yi e(Xi ) − Zi − e(Xi ) e(Xi ) × g1(Xi ) ) − 1 N N ∑ i=1 ( (1 − Zi )Yi 1 − e(Xi ) + Zi − e(Xi ) 1 − e(Xi ) × g0(Xi ) ) ͜ͷͱ͖ɺείΞͱ݁Ռมͷ͍ͣΕ͔͕ਖ਼͘͠ਪఆͰ͖͍ͯΕɺˆ τ ͷظ ATE ʹ͘͠ͳΔ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 32 / 38 -
ൃలɿೋॏʹϩόετͳਪఆ๏ είΞ͕ਖ਼͘͠ਪఆͰ͖͍ͯΔ߹ɿE[Z|X] = e(X) E[ˆ τ] = E{X} [E[ˆ τ|{X}]]
E[ˆ τ|{X}] = 1 N N ∑ i=1 ( E[Zi Yi |Xi ] e(Xi ) − E[Zi |Xi ] − e(Xi ) e(Xi ) × g1(Xi ) ) − 1 N N ∑ i=1 ( E[(1 − Zi )Yi |Xi ] 1 − e(Xi ) + E[Zi |Xi ] − e(Xi ) 1 − e(Xi ) × g0(Xi ) ) = 1 N N ∑ i=1 (E[Y1,i |Xi ] − E[Y0,i |Xi ]) −→ E[ˆ τ] = E[Y1] − E[Y0] = ATE matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 33 / 38 -
ൃలɿೋॏʹϩόετͳਪఆ๏ ݁Ռม͕ਖ਼͘͠ਪఆͰ͖͍ͯΔ߹ɿE[Y1|X] = g1(X), E[Y0|X] = g0(X) E[ZY |X] =
E[ZY1|X] = E[Z|X]g1(X), E[(1 − Z)Y |X] = E[(1 − Z)Y0|X] = (1 − E[Z|X])g0(X) E[ˆ τ|{X}] = 1 N N ∑ i=1 ( E[Zi |Xi ]g1(Xi ) e(Xi ) − E[Zi |Xi ] − e(Xi ) e(Xi ) × g1(Xi ) ) − 1 N N ∑ i=1 ( (1 − E[Zi |Xi ])g0(Xi ) 1 − e(Xi ) + E[Zi |Xi ] − e(Xi ) 1 − e(Xi ) × g0(Xi ) ) = 1 N N ∑ i=1 (g1(Xi ) − g0(Xi )) −→ E[ˆ τ] = E[Y1] − E[Y0] = ATE matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 34 / 38 -
࣍ 1 ͡Ίʹ 2 ౷ܭతҼՌਪ ఆࣜԽ ฏۉॲஔޮՌਪఆͷͨΊͷख๏ 3 ·ͱΊ matsuno
౷ܭతҼՌਪͷհ 2020 12 ݄ 19 35 / 38 -
ࠓճ͞ͳ͔ͬͨτϐοΫ ҼՌ୳ࡧ ػցֶशͱͷؔ࿈ NeurIPS 2020 Workshop Causal Discovery & Causality-Inspired
Machine Learning https://www.cmu.edu/dietrich/causality/neurips20ws/ matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 37 / 38 -
ࢀߟจݙ [1] ؠ࡚ ֶɼ౷ܭతҼՌਪɼேॻళɼ2015ɽ [2] ؠσʔλαΠΤϯεץߦҕһձɼ ʰؠσʔλαΠΤϯε Volɽ3ʱ ɼؠॻళɼ2016ɽ [3]
Spurious Correlations, https://www.tylervigen.com/spurious-correlations. matsuno ౷ܭతҼՌਪͷհ 2020 12 ݄ 19 38 / 38