Share
Embed
Transcript
34 slides
-
εςοϓ̍ɿύϥϝʔλΛؚ ΉϞσϧʢࣜʣΛઃఆ͢Δ ͍͵͞ΜͷഎதͷͲ͜ʢҐஔxʣΛͰͨΒɺͲΕ͘Β͍͍͵͞Μ͕تͿ͔ ʢتͼtʣΛΓ͍ͨ ͦΕΛҎԼͷΑ͏ͳଟ߲ࣜͷؔͱͯ͠දͤΔͷͰͳ͍͔ͱఆ͢Δ Mଟ߲ࣜͷ࣍ʢ࠷େͰԿͷ߲·Ͱ༻͍Δ͔ʣ ࣮ࡍʹܭࢉ͢Δͱ͖MͷΛԿ͔ʹܾΊΔͱͯ͠ɺMʴ1ݸͷ͕ະ ͷύϥϝʔλͱͳΔˠ f(x) =
w0 + w1x + w2x2 + ... + wM xM = M X m=0 wmxm {wm }M m=0 -
εςοϓ̎ɿύϥϝʔλ ΛධՁ͢Δج४ΛఆΊΔ ޡࠩؔΛఆٛ͠ɺೋޡࠩΛ࠷খͱ ͢Δύϥϝʔλ͕ྑ͍ύϥϝʔλͱ͢Δ Ϟσϧͷؔf(x)Λޡࠩؔʹೖ͢Δ ͱ͜͏ͳΔ ED = 1 2
N X n=1 {f(xn) tn }2 ED = 1 2 N X n=1 ( M X m=0 wmxm n tn)2 -
·ͣΛ۩ମతͳ Ͱߟ͑ͯΈΑ͏ ҎԼͷޡࠩؔΛ࠷খʹ͢Δύϥϝʔ λɹɹɹɹΛٻΊΔͱͲ͏͍͏͜ͱ ͔ ED = 1 2 N
X n=1 ( M X m=0 wmxm n tn)2 {wm }M m=0 -
Mʹ1ʢ1࣍ؔʣͰߟ͑ ͯΈΔ Λ؆୯ʹ͢ΔͨΊʹɺMʹ1ͱܾΊ Δɻ͢ΔͱϞσϧͷࣜͱޡࠩؔ ҎԼͷΑ͏ʹͳΔ ύϥϝʔλw0ɺw1Λదʹ̎ύλʔϯ ߟ͑ͯɺޡࠩؔͷΛٻΊΔ f(x) = w0
+ w1x ED = 1 2 N X n=1 (w0 + w1xn tn)2 -
ύλʔϯ̍ w0 = 1, w1 = 3 f(x) = 1
+ 3x ED = 1 2 N X n=1 (1 + 3xn tn)2 -
ύλʔϯ̎ w0 = 1, w1 = 4 f(x) = 1
+ 4x ED = 1 2 N X n=1 (1 + 4xn tn)2 -
ED͕ͬͱݮগ͢Δํ ͱ ͋Δ(w0, w1)ʹ͍Δͱ ͖ɺࡔͷ্ͷํEDΛw0 ͱw1Ͱภඍͨ͠ϕΫτϧͰ ද͞ΕΔɻ͜ΕΛޯϕΫτ ϧͱݺͿ EDΛ࠷খʹ͢ΔʹɺEDͷ ޯͷରํʹਐΜͰ͍͚
ྑ͍ rED(w) = @ED @w0 @ED @w1 ! ޯϕΫτϧʢࡔͷ্ͷํʣ -
EDΛภඍͨࣜ͠ ʢภඍͷৄࡉ·ͨผ్ʣ ภඍͱݴͬͯɺʮ1ͭͷม͚ͩʹணͯ͠ɺଞͷมఆͱΈ ͳͯ͠ඍ͢Δʯ͚ͩ ී௨ͷඍ͕άϥϑͷ͖Λද͍ͯ͠Δͷͱಉ͡Α͏ʹɺw0ͱw1ʹؔ ͢ΔภඍͧΕͧΕw0ํͷ͖ɺw1ํͷ͖Λද͍ͯ͠Δ 2ͭͷ͖Ληοτʹͯ͠ɺϕΫτϧͱͯ͠ղऍͨ͠ͷ͕ޯϕΫτ ϧɻޯϕΫτϧ͖ͷͬͱେ͖͍ํͱͦͷେ͖͞Λද͢ @ED @w0
= N X n=1 (f(xn) tn) = N X n=1 (w0 + w1xn tn) @ED @w1 = N X n=1 (f(xn) tn)xn = N X n=1 (w0 + w1xn tn)xn -
ޯϕΫτϧΛΑ͘ݟͯ ΈΔ w0ํw1ํɺw0ͱw1͕ܾ·ͬͯॳΊ͖͕ܾͯ·Δ ͔֬ʹάϥϑΛݟΔͱɺܗ্Ͳͷʹཱ͔ͭʹΑͬͯ ͖ҧͬͯ͘Δ rED(w) = @ED @w0 @ED
@w1 ! ޯϕΫτϧʢࡔͷ্ͷํʣ @ED @w0 = N X n=1 (w0 + w1xn tn) @ED @w1 = N X n=1 (w0 + w1xn tn)xn -
࠷ٸ߱Լ๏Λ༻͍ͨύϥϝʔ λwͷߋ৽ํ๏ʢֶशଇʣ ֶशΛБͱͯ͠ύϥϝʔλΛҎԼͷΑ͏ʹߋ৽͢Δ ʮ:=ʯɺࠨลΛӈลͰߋ৽͢ΔɺΛҙຯ͢Δͷͱ͢Δ ޯϕΫτϧͷʮٯํʯ͔ͩΒɺ্هࣜϚΠφεΛ͍ͬͯΔ ͜ͷֶशଇͰɺͪΐͬͱͣͭw0, w1Λߋ৽͍ͯ͘͠ w0 := w0
⌘ @ED @w0 w1 := w1 ⌘ @ED @w1 @ED @w0 = N X n=1 (f(xn) tn) = N X n=1 (w0 + w1xn tn) @ED @w1 = N X n=1 (f(xn) tn)xn = N X n=1 (w0 + w1xn tn)xn ࠶ܝ -
ʢࢀߟʣM࣍ͷଟ߲ࣜʹ ҰൠԽ͢Δͱ ্هͷϞσϧͰEDΛΑΓখ͘͢͞ΔʹɺֶशΛБͱͯ͠ ύϥϝʔλΛҎԼͷΑ͏ʹߋ৽͢Δ ED = 1 2 N X
n=1 {f(xn) tn }2 wm := wm ⌘ @ED @wm f(x) = w0 + w1x + w2x2 + ... + wM xM = M X m=0 wmxm ۩ମతʹҎԼͷΑ͏ͳࣜʹͳΔ wm := wm ⌘ N X n=1 (f(xn) tn)xm n -
ֶश͕ऴΘͬͨΒྃʁ ہॴղʹั·Δ͜ͱΛ͍ͭ ߟྀ͓ͯ͘͠ඞཁ͕͋Δ ͭ·ΓɺಘΒΕͨղ͕࠷খ Ͱ͋ΔอূͲ͜ͳ͍ ύϥϝʔλwͷॳظΛม ͑ͳ͕ΒԿճ͔܁Γฦ͢ͳ Ͳɺ͍Ζ͍Ζͳ͕ඞཁ x y
0 ͔͜͜Βελʔ τͨ͠Βʁ ͜͜ʹͨͲΓண͍ͯ ऴΘͬͪΌ͏͔ ࠷খ -
֬తޯ߱Լ๏ ࠷ٸ߱Լ๏Λར༻ͨ͠ύϥϝʔλͷߋ৽ํ๏͜͏͕ͩͬͨ ֬తޯ߱Լ๏Ͱ͜͏ͳΔ ͭ·ΓɺτϨʔχϯάηοτNݸશ෦ͬͯҰճߋ৽͢ΔͷͰ ͳ͘ɺ1ݸϥϯμϜʹબΜͰͦΕΛͬͯҰճߋ৽͢Δ Ұճߋ৽͢Δ·Ͱͷܭࢉྔ͕গͳ͘ͳΔͷͰޮ͕ྑ͘ͳΔ͜ͱ ͱɺہॴղʹั·Γʹ͘͘ͳΔͱ͍͏ϝϦοτ͋Δ wm := wm
⌘ N X n=1 (f(xn) tn)xm n wm := wm ⌘(f(xk) tk)xm k -
ࢀߟจݙ தҪ ӻ࢘ʮITΤϯδχΞͷͨΊͷػցֶश ཧೖʯٕज़ධࣾ, 2015 ҏ౻ ਅʮPythonͰಈֶ͔ͯ͠Ϳʂ͋ͨΒ͠ ͍ػցֶशͷڭՊॻʯᠳӭࣾ, 2018 ཱੴݡޗʮֶ͘͞͠Ϳ
ػցֶशΛཧղ͢ ΔͨΊͷֶͷ͖΄Μ ʯϚΠφϏग़൛, 2017