Share
Embed
Transcript
37 slides
-
ࠓճ ΑΓҰൠతʹɺଟ߲ࣜۙࣅΛఆ͢Δ ͜Μͳͭ ࠷খೋ๏Λ༻͍ͯΑΓਖ਼֬ͳύϥϝʔλ ʢ͜͜Ͱଟ߲ࣜͷʣΛਪఆ͢Δ f(x) = w0 + w1x
+ w2x2 + ... + wM xM = M X m=0 wmxm -
࣮ଌͯ͠Έͨ 10ݸͷͷϖΞΛศ্ٓ͜͏هड़͢Δˠ ͜ͷΑ͏ͳػցֶशͷʮݩωλʯͱͯ͠༻͢Δσʔλͷ͜ ͱΛʮτϨʔχϯάηοτʯͱ͍͏ x ʢഎதͷҐஔʣ t ʢتͼʣ 0 0.000000
0.659981 1 0.111111 0.849493 2 0.222222 1.853337 3 0.333333 1.500273 4 0.444444 0.297486 5 0.555556 0.101940 6 0.666667 -0.215201 7 0.777778 -0.665270 8 0.888889 0.107402 9 1.000000 0.098598 {(xn, tn)}10 n=1 -
xͱtͷؒʹ͋ΔؔΛఆ ͢ΔʢϞσϧΛઃఆ͢Δʣ ·ͣ࣍ͷΑ͏ͳxͷଟ߲ࣜΛఆ͢Δ f(x) = w0 + w1x + w2x2
+ ... + wM xM = M X m=0 wmxm Mଟ߲ࣜͷ࣍ʢ࠷େͰԿͷ߲·Ͱ༻͍Δ͔ʣ ࣮ࡍʹܭࢉ͢Δͱ͖MͷΛԿ͔ʹܾΊΔͱͯ͠ɺMʴ1ݸͷ ͕ະͷύϥϝʔλͱͳΔˠ ͜ΕΒͷύϥϝʔλΛ͏·ܾ͘ΊΔ͜ͱ͕Ͱ͖ΕɺτϨʔχϯ άηοτΛͰ͖Δ͚ͩਖ਼֬ʹ࠶ݱ͢Δଟ߲ࣜΛखʹೖΕΒΕΔ {wm }M m=0 -
ԿΛ࣋ͬͯʮਖ਼֬ʯͱ͢Δ͔ʢύ ϥϝʔλΛධՁ͢Δج४ΛఆΊ Δʣ ଟ߲ࣜͰܭࢉ͞ΕΔtͷͱɺ࣮ࡍʹܭଌ͞Εͨtn Λൺֱ͠ɺͦΕͧΕͷࠩͷ2Λ߹ܭͨ͠ͷΛ ʮޡࠩʯͱఆٛ͢Δ ্هͷ͕ͳΔ͘খ͘͞ͳΔΑ͏ͳf(x)͕ಘΒ ΕΔΑ͏ʹύϥϝʔλΛܾఆ͢Εྑ͍ {f(x1) t1
}2 + {f(x2) t2 }2 + ... + {f(x10) t10 }2 {wm }M m=0 -
ઌ΄ͲͷΛ 1/2ഒͨ͠ͷΛEDͱͯ͠ ఆٛ͢Δɻ͜Ε͕ʮೋޡࠩʯ 1/2ഒ͍ͯ͠Δͷޙʑܭࢉ͍͢͠ ͔Βͱ͍͏ཧ༝͚ͩ ೋޡࠩͷܗʹͪΐͬͱ ม͑Δ ED = 1
2 N X n=1 {f(xn) tn }2 -
w·ͩΘ͔Βͳ͍͚Ͳɺx ͱtτϨʔχϯάηοτͷ ͩ͠ɺNMΘ͔͍ͬͯ ΔͩΑ ೋޡࠩͷࣜʹଟ߲ࣜͷ ࣜΛೖ͢Δ ʮೋޡࠩΛ࠷খʹ͢Δʯͱ͍͏݅Ͱ͑ΛٻΊ Α͏ͱ͍ͯ͠ΔͷͰʮ࠷খೋ๏ʯ ্ͷࣜɺʮޡࠩؔʯͱݺͿ ED
= 1 2 N X n=1 ( M X m=0 wmxm n tn)2 f(x) = w0 + w1x + w2x2 + ... + wM xM = M X m=0 wmxm ED = 1 2 N X n=1 {f(xn) tn }2 -
ύϥϝʔλwΛٻΊΔࣜ ͷղઆ wٻΊΔ͖Λฒͨϕ Ϋτϧ tτϨʔχϯάηοτʹؚ· ΕΔతมΛฒͨϕΫτϧ ΦNݸͷ؍ଌʹ͍ͭͯɺͦ ΕͧΕΛ0ʙMͨ͠Λฒ ͨߦྻ ߦྻʹ͓͚ΔTసஔߦྻΛද
͢ʢର֯ઢͰΛંΓฦͨ͠ ߦྻʣ W = ( T ) 1 T t W = (w0, ..., wM )T t = (t1, ..., tN )T = 0 B B B @ x0 1 x1 1 · · · xM 1 x0 2 x1 2 · · · xM 2 . . . . . . ... . . . x0 N x1 N · · · xM N 1 C C C A T = 0 B B B @ x0 1 x0 2 · · · x0 N x1 1 x1 2 · · · x1 N . . . . . . ... . . . xM 1 xM 2 · · · xM N 1 C C C A -
࠷খೋ๏Ͱܭࢉ͞Εͨ ͷ Table of the coefficients M=0 M=1 M=3 M=9
0 0.39466 0.960706 0.109101 0.219798 1 NaN -1.132092 11.916871 -96.853538 2 NaN NaN -33.286735 2312.552194 3 NaN NaN 21.740843 -20029.415671 4 NaN NaN NaN 89134.138600 5 NaN NaN NaN -227927.456238 6 NaN NaN NaN 347467.085391 7 NaN NaN NaN -311769.354346 8 NaN NaN NaN 151936.364081 9 NaN NaN NaN -31026.909452 f(x) = 0.109101 + 11.916871x + 33.286735x2 + 21.740843x3 ͭ·ΓM=3ͷ߹ɺҎԼͷΑ͏ͳ͕ࣜಘΒΕͨ͜ͱʹͳ Δɻ͜ͷࣜͷxʹɺ͍͵͞ΜͷഎதͷҐஔΛೖ͢ΕͲ Ε͘Β͍تΜͰ͘ΕΔ͔Θ͔ΔΑʂ -
E(RMS)ͷղઆ ೋޡࠩEDΛগ͠खΛՃ͑ͨ࣍ͷΛฏํ ࠜฏۉೋޡࠩʢRoot Mean Square Errorʣ ͱݺͼɺʮଟ߲͔ࣜΒ༧ଌ͞ΕΔͱτ Ϩʔχϯάηοτͷ͕ɺฏۉతʹͲͷఔ ҟͳ͍ͬͯΔ͔ʯΛࣔ͢ ERMS
= r 2ED N ED = 1 2 N X n=1 ( M X m=0 wmxm n tn)2 -
ςετηοτΛ༻ҙ x ʢഎதͷҐஔʣ t ʢتͼʣ 0 0.000000 0.575962 1 0.111111
0.699933 2 0.222222 1.301221 3 0.333333 1.269027 4 0.444444 1.386038 5 0.555556 0.851104 6 0.666667 -0.249711 7 0.777778 -0.318560 8 0.888889 0.116516 9 1.000000 0.496955 x ʢഎதͷҐஔʣ t ʢتͼʣ 0 0.000000 0.659981 1 0.111111 0.849493 2 0.222222 1.853337 3 0.333333 1.500273 4 0.444444 0.297486 5 0.555556 0.101940 6 0.666667 -0.215201 7 0.777778 -0.665270 8 0.888889 0.107402 9 1.000000 0.098598 τϨʔχϯάηοτ ςετηοτ ͬͪ͜Ͱ ଟ߲ࣜͷ Λܾఆ͢ Δ ͬͪ͜ ݕূʹ͔͠ Θͳ͍ ͦΕͧΕʹର͢ΔฏํࠜฏۉೋޡࠩΛܭࢉ͢Δ -
ΫϩεόϦσʔγϣϯʢަ ࠩݕূʣΛ༻͍Δͱྑ͍ ར༻ՄೳͳσʔλΛnݸͷάϧʔϓʹׂ͠ɺͲΕ͔1 ͭΛςετηοτͱͯ͠༻͍Δ ͲΕΛςετηοτͱ͢Δ͔Ͱnछྨͷݕূ͕ߦ͑Δ ύʔτ2 ύʔτ3 ύʔτ1 ֶश݁Ռ1 ݕূ݁Ռ1
ύʔτ1 ύʔτ3 ύʔτ2 ֶश݁Ռ2 ݕূ݁Ռ2 ύʔτ1 ύʔτ2 ύʔτ3 ֶश݁Ռ3 ݕূ݁Ռ3 ݕূ݁ՌΛ૯߹͠ ͯɺ࠷దͳ࣍MΛܾ -
02-square_error.ipynbΛϕʔεʹ ͯ͠՝ʹνϟϨϯδͯ͠ΈΑ͏ɹɹ M=0, 1, 3, 9ͷͱ͖ͷֶशͨ͠ύϥϝʔλΛग़ྗͯ͠ΈΔ ΫϩεόϦσʔγϣϯΛ࣮ͯ͠ΈΔ Boston house-prices (ϘετϯࢢͷॅՁ֨)σʔληοτΛͬͯճ
ؼੳͯ͠ΈΔ https://pythondatascience.plavox.info/scikit-learn/scikit- learn%E3%81%AB%E4%BB%98%E5%B1%9E%E3%81%97%E3 %81%A6%E3%81%84%E3%82%8B%E3%83%87%E3%83%BC %E3%82%BF%E3%82%BB%E3%83%83%E3%83%88 ࠷ٸ߱Լ๏ʢޯ߱Լ๏ʣΛ༻͍ͯ࠷ྑͷύϥϝʔλΛٻΊͯΈΔ ʢޙड़ʣ {wm }M m=0 -
ʢ͓·͚ʣ࠷ٸ߱Լ๏ʢޯ߱Լ ๏ʣΛ༻͍ͯύϥϝʔλΛٻΊΔ ্هͷϞσϧͰEDΛΑΓখ͘͢͞ΔʹɺֶशΛБͱͯ͠ ύϥϝʔλΛҎԼͷΑ͏ʹߋ৽͢Δ ED = 1 2 N X
n=1 {f(xn) tn }2 wm := wm ⌘ @ED @wm f(x) = w0 + w1x + w2x2 + ... + wM xM = M X m=0 wmxm ۩ମతʹҎԼͷΑ͏ʹͳΔɻͱΓ͋͑ͣM=1ɺБ0.001 ͘Β͍ͰԿඦճ͔ߋ৽ͯ͠ΈΑ͏ wm := wm ⌘ N X n=1 (f(xn) tn)xm n -
ࢀߟจݙ தҪ ӻ࢘ʮITΤϯδχΞͷͨΊͷػցֶश ཧೖʯٕज़ධࣾ, 2015 ཱੴݡޗʮֶ͘͞͠Ϳ ػցֶशΛཧղ͢ ΔͨΊͷֶͷ͖΄Μ ʯϚΠφϏग़൛, 2017
ҏ౻ ਅʮPythonͰಈֶ͔ͯ͠Ϳʂ͋ͨΒ͠ ͍ػցֶशͷڭՊॻʯᠳӭࣾ, 2018