Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
An introduction of statistical learning
Search
Nakamura, Ryotaro
June 28, 2017
Science
0
42
An introduction of statistical learning
Nakamura, Ryotaro
June 28, 2017
Tweet
Share
More Decks by Nakamura, Ryotaro
See All by Nakamura, Ryotaro
Duct for beginners.
nryotaro
0
4.1k
Learn Go in 15 minutes
nryotaro
0
36
Seven architectural patterns
nryotaro
1
100
Improving Performance with Parallel Programming
nryotaro
0
51
Other Decks in Science
See All in Science
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
0
120
mathematics of indirect reciprocity
yohm
1
140
CV_3_Keypoints
hachama
0
190
Ignite の1年間の軌跡
ktombow
0
130
Online Feedback Optimization
floriandoerfler
0
2.3k
SpatialBiologyWestCoastUS2024
lcolladotor
0
140
学術講演会中央大学学員会府中支部
tagtag
0
270
academist Prize 4期生 研究トーク延長戦!「美は世界を救う」っていうけど、どうやって?
jimpe_hitsuwari
0
140
Quelles valorisations des logiciels vers le monde socio-économique dans un contexte de Science Ouverte ?
bluehats
1
400
3次元点群を利用した植物の葉の自動セグメンテーションについて
kentaitakura
2
1.3k
地表面抽出の方法であるSMRFについて紹介
kentaitakura
1
740
Collective Predictive Coding Hypothesis and Beyond (@Japanese Association for Philosophy of Science, 26th October 2024)
tanichu
0
140
Featured
See All Featured
VelocityConf: Rendering Performance Case Studies
addyosmani
331
24k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
Automating Front-end Workflow
addyosmani
1370
200k
Scaling GitHub
holman
459
140k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
It's Worth the Effort
3n
185
28k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
331
22k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
281
13k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
Embracing the Ebb and Flow
colly
86
4.7k
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.4k
Transcript
ػցֶशษڧձ ୈ 1 ճ தଜ ྒྷଠ June 13, 2017
Table of contents Supervised Learning 1. Classification 2. Perceptron 3.
Regression Unsupervised Learning 4. Clustering 1
ࠓͷඪ ࣍ճҎ߱ʹֶͿΞϧΰϦζϜͷ֓ཁΛΔ ΞϧΰϦζϜͱద༻ྫ ΞϧΰϦζϜ ద༻ྫ ྨ εύϜϝʔϧఆ ճؼੳ ച্༧ଌ ΫϥελϦϯά
ը૾ͷݮ৭ॲཧ 2
ύϥϝτϦοΫ๏ ϞσϧʢࣜʣΛԾఆ͠ɼϞσϧͷ࠷దͳύϥϝλΛֶश͢Δ ύϥϝτϦοΫ๏ͷखॱ 1. σʔλͷ༧ଌϞσϧΛԾఆ 2. Ϟσϧͷύϥϝλͷ ධՁج४ΛܾΊΔ 3. ύϥϝλΛܾΊΔ
0.0 0.2 0.4 0.6 0.8 1.0 −0.2 0.0 0.2 0.4 0.6 0.8 1.0 Ұ࣍ؔͷϞσϧͷύϥϝλௐ 3
Classification
ྨ Ϋϥεʹྨ͞ΕͨطଘσʔλΛݩʹ৽نσʔλΛྨ͢Δ ΞϧΰϦζϜ • ύʔηϓτϩϯ • ϩδεςΟοΫճؼ 4
Perceptron
ύʔηϓτϩϯ, Ϟσϧ ઢܗͳϞσϧ f Λઃఆ͢Δ f (x, y) = w0
+ w1x + w2y f (x, y) > 0 ⇒ t = +1 f (x, y) < 0 ⇒ t = −1 −20 −10 0 10 20 30 x −30 −20 −10 0 10 20 y t = +1 t = -1 ଐੑ t = ±1 Λͭσʔλ܈ ઢ্ͷ (x′, y′) f (x′, y′) = 0 ΛΈͨ͢ 5
ύʔηϓτϩϯ, ධՁج४ʢޡࠩؔʣ ޡࠩؔ E ͕࠷খʹͳΔ wi ΛٻΊΔ E = N
∑ i=1 {− (w0 + w1x + w2y) ti } = N ∑ i=1 (−f (xi , yi )ti ) • N σʔλ • ޡྨͩͱ −f (xi , yi )ti > 0 −20 −10 0 10 20 30 x −30 −20 −10 0 10 20 y t = +1 t = -1 ଐੑ t = ±1 Λͭσʔλ܈ 6
ϩδεςΟοΫճؼ, Ϟσϧ ύʔηϓτϩϯͱಉ͘͡ઢܗϞσϧ f Λઃఆ͢Δ f (x, y) = w0
+ w1x + w2y f (x, y) > 0 ⇒ t = +1 f (x, y) < 0 ⇒ t = −1 −30 −20 −10 0 10 20 30 x −20 −15 −10 −5 0 5 10 15 20 y t = +1 t = -1 f (x, y) ͕૿Ճ͢Δ͖ 7
ϩδεςΟοΫճؼ, Ϟσϧ ͨͩ͠ɼ|f | ͕େ͖͍΄Ͳ t Ͱ͋Δ͕֬ߴ͍ͱ͢Δ ϩδεςΟοΫؔ σ (α)
= 1 1 + e−α Λಋೖ͠ɼ (x′, y′) ͕ t = 1 Ͱ͋Δ֬Λ 0 < σ ( f ( x′, y′ )) < 1 ͱ͢Δ −4 −3 −2 −1 0 1 2 3 4 α 0.0 0.2 0.4 0.6 0.8 1.0 σ (α) ϩδεςΟοΫؔͷάϥϑ 8
ϩδεςΟοΫճؼ, ධՁج४ʢ࠷ਪఆʣ ܇࿅σʔλ͕ಘΒΕΔ֬ P Λ࠷େʹ͢Δ wi ΛٻΊΔ p(x, y) =
σ(x0 + w1x + w2y) P = N ∏ i p (xi , yi )tn {1 − p (xi , yi )}1−tn ܇࿅σʔλ࠷ൃੜ͕֬ߴ͍σʔλͰ͋ΔͱԾఆ͍ͯ͠Δ 9
Regression
ճؼੳ, ϞσϧͱධՁج४ʢ࠷খೋʣ σʔλ͕ M ࣍ଟ߲ࣜ f ʹै͏ͱͯ͠ɼೋޡࠩ ED Λ࠷খʹ͢Δ ύϥϝλ
wi ΛબͿ f (x) = M ∑ m=0 wmxm ED = 1 2 N ∑ n=1 {f (xn) − tn}2 0 2 4 6 8 10 −15 −10 −5 0 5 ground truth degree 3 degree 4 degree 5 training points M ∈ {3, 4, 5} ͷଟ߲ࣜۙࣅྫ 10
Clustering
k ฏۉ๏ σʔλؒͷڑΛٻΊɼσʔλΛ k ݸͷΫϥελʹ͚Δ −2 −1 0 1 2
3 0 1 2 3 4 5 σʔλू߹ −2 −1 0 1 2 3 0 1 2 3 4 5 cluster 1 cluster 2 cluster 3 centroids k = 3 ͷΫϥελ Ϋϥελ͝ͱʹදσʔλΛܾΊɼදͷۙ͘ͷσʔλू߹Ͱ ΫϥελΛ࡞Δ 11
k ฏۉ๏ͷΞϧΰϦζϜ ೖྗ: σʔλू߹ D = { x(1), x(2), ·
· · , x(|D|) } : Ϋϥελ k ແ࡞ҝʹ m1, m2 · · · , mk ΛܾΊΔ until ऩଋ foreach x(i) ∈ D cmax = arg max c sim ( x(i), mc ) σʔλू߹ͷׂ insert x(i)into cmax end foreach ∀c, mc = 1 |c| ∑ x(i)∈c x(i) දϕΫτϧΛ࠶ܭࢉ end until 12