Share
Embed
Transcript
18 slides
-
χϡʔϩϯϞσϧ֮͑ͯ ·͢ʁ ࣠ࡧ γφϓε ిؾύϧε f = { 0 (w0
+ w1 x + w2 y ≤ 0) 1 (w0 + w1 x + w2 y > 0) x y ॏΈw1 ॏΈw2 f ग़ྗ ೖྗ ೖྗ 1 ͍ͭ1ͷ μϛʔೖྗ ॏΈw0 ೖྗۭؒΛઢͰ ͚Δͱ͍͏ػೳ -
લճͷ෮शɿϩδεςΟο Ϋճؼͷ2ೖྗ3Ϋϥεྨ x1 x2 a0 ग़ྗ ೖྗ ೖྗ x0 ͍ͭ1ͷ
μϛʔೖྗ w00 ೖྗ૯ a1 a2 w01 w02 w20 w21 w22 y0 = exp(a0 ) ∑K−1 k=0 exp(ak ) → P(t = 0|x) y1 = exp(a1 ) ∑K−1 k=0 exp(ak ) → P(t = 1|x) y2 = exp(a2 ) ∑K−1 k=0 exp(ak ) → P(t = 2|x) a0 = ∑2 i=0 w0i xi -
2ϑΟʔυϑΥϫʔυχϡʔϥ ϧωοτͷ2ೖྗ3Ϋϥεྨ த͕ؒՃ͞Ε͚ͨͩʂ 3ʹݟ͑Δ͚ͲɺॏΈύϥϝʔλ͕͋Δ͚ͩΛ͑ͯ2ͱ͍͏߹͕ଟ͍ x1 x2 a0 ग़ྗʢ2ʣ x0 όΠΞε߲
w00 தؒʢ1ʣ w01 w02 v20 v21 v22 P(t = 0|x) y0 b1 z1 b2 z2 z0 a1 y1 a2 y2 ೖྗ v00 v01 v02 = 1 = 1 όΠΞε߲ t0 t1 t2 P(t = 1|x) P(t = 2|x) D + 1 M + 1 K ؙͷࠨ͕ೖྗ૯ɺӈ͕ͦΕ Λ׆ੑԽؔʹ௨ͨ͠ ؙͷࠨ͕ೖྗ૯ɺӈ͕ͦΕΛ ιϑτϚοΫεؔʹ௨ͨ͠ -
Ϟσϧͷࣜͷ֬ೝ h()ͱΓ͋͑ͣγάϞΠυؔͱ͢Δ தؒͷೖྗ૯ɿbj = ∑D i=0 wji xi தؒͷग़ྗɿzj =
h(bj ) ग़ྗͷೖྗ૯ɿak = ∑M j=0 vkj zj ग़ྗͷग़ྗɿyk = exp(ak ) ∑K−1 l=0 exp(al ) = exp(ak ) u ೖྗ࣍ݩ:Dɺதؒͷχϡʔϩϯͷ:Mɺग़ྗ࣍ݩ:K b = wx b0 b1 b2 = w00 w01 w02 w10 w11 w12 w20 w21 w22 x0 x1 x2 ϕΫτϧදه͢ΔͳΒ͜Μͳ͔Μ͡ʢҰ෦͚ͩʣ -
ਤͱࣜΛηοτͰ֬ೝ x1 x2 a0 ग़ྗʢ2ʣ x0 όΠΞε߲ w00 தؒʢ1ʣ w01
w02 v20 v21 v22 P(t = 0|x) y0 b1 z1 b2 z2 z0 a1 y1 a2 y2 ೖྗ v00 v01 v02 = 1 = 1 όΠΞε߲ t0 t1 t2 P(t = 1|x) P(t = 2|x) D + 1 M + 1 K ೖྗ࣍ݩ:Dɺதؒͷχϡʔϩϯͷ:Mɺग़ྗ࣍ݩ:K bj = ∑D i=0 wji xi zj = h(bj ) ak = ∑M j=0 vkj zj yk = exp(ak ) ∑K−1 l=0 exp(al ) -
ޡࠩؔʁ ͜ͷ2ϑΟʔυϑΥϫʔυχϡʔϥϧωοτʹ3Ϋϥεྨ Λղ͔ͤΔ͜ͱΛߟ͑Δ ྨͳͷͰɺޡࠩؔલճͱಉ͘͡ฏۉަࠩϔϯτϩϐʔ ޡࠩΛ͏ yͷͱ͜Ζ͕݁ہલճͱಉ͡ͳͷͰɺࣜݟͨಉ͡ɻͨ ͩɺύϥϝʔλw͚ͩͰͳ͘v͋Δͱ͜Ζ͕ҧ͏ E(w, v) =
− 1 N N−1 ∑ n=0 K−1 ∑ k=0 tnk log ynk wͱvyͷࣜͷͳ͔ʹؚ·Ε ͍ͯΔ -
ภඍͳΜ͔ͨ͘͠ͳ ͍ʂͱ͍͏߹ ඍ๏Λ͏ͱ͍͏ख͋Δɻ ඍͱ͖ͷ͜ͱͰɺ͋Δw*ͷ͖ΛಘΔʹɺ͜ͷਤͰ͍͏hΛͲΜͲΜখ ͍͚ͯۙ͘͞͠ࣅతʹٻΊΒΕΔɻ ภඍͩͬͨΒɺண͢ΔมҎ֎ݻఆʹ͢Δͱ͍͏ͷඍ๏Ͱ͓ͳ͡ɻ ͜ΕͰภඍಋؔΛಋग़͠ͳͯ͋͘ΔͷޯϕΫτϧΛͱΊΒΕΔɻ ඍͷఆٛɿ d dx
f(x) = lim h→0 f(x + h) − f(x) h E(w) w w* w* + h w* − h 2h ͲΜͲΜhΛখ͍͚ͯ͘͞͠ɺ͕ͯw*Ͱ ͷઢʹۙ͘ɻͦΕ͢ͳΘ͖ͪͰ͋Γɺͦ ͷॠؒͷมԽͰ͋ΓɺඍͰ͋Δɻඍͷ ఆٛࣜͱ͍͍ͩͨಉ͜͡ͱΛݴ͍ͬͯΔɻ ∂E ∂w | w=w* ≃ E(w* + h) − E(w* − h) 2h -
ޡࠩٯ๏֓ཁ ೖྗΛೖΕͯग़ྗΛಘΔ ֤χϡʔϩϯͰͷޡࠩΛಘΔ ॏΈΛߋ৽͢Δ δ(2) k = yk − tk
←ୈ2ͷޡࠩ δ(1) j = h′ (bj ) K−1 ∑ k=0 vkj δ(2) k ←ୈ1ͷޡࠩ vkj := vkj − αδ(2) k zj /N wji := wji − αδ(1) j xi /N bj = ∑D i=0 wji xi zj = h(bj ) ak = ∑M j=0 vkj zj yk = exp(ak ) ∑K−1 l=0 exp(al ) x1 x2 a0 ग़ྗʢ2ʣ x0 w00 தؒʢ1ʣ w01 w02 v20 v21 v22 y0 b1 z1 b2 z2 z0 a1 y1 a2 y2 ೖྗ v00 v01 v02 = 1 = 1 t0 t1 t2 D + 1 M + 1 K δ(1) j δ(2) k -
ࢀߟจݙ தҪ ӻ࢘ʮITΤϯδχΞͷͨΊͷػցֶशཧೖ ʯٕज़ධࣾ, 2015 ҏ౻ ਅʮPythonͰಈֶ͔ͯ͠Ϳʂ͋ͨΒ͍͠ػց ֶशͷڭՊॻʯᠳӭࣾ, 2018 ༔ีʮৄղ
σΟʔϓϥʔχϯά TensorFlowɾ KerasʹΑΔ࣌ܥྻσʔλॲཧʯϚΠφϏग़൛, 2017