Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
カーネル関数とは
Search
kichinosukey
January 14, 2019
Science
0
51
カーネル関数とは
kichinosukey
January 14, 2019
Tweet
Share
More Decks by kichinosukey
See All by kichinosukey
Latin Hypercube Sampling
kichinosukey
0
71
Lasso.pdf
kichinosukey
0
52
NSGAII
kichinosukey
0
46
NSGA
kichinosukey
0
52
基底関数回帰の概要について
kichinosukey
0
73
児童虐待の現状
kichinosukey
0
58
イノベーションのジレンマとフィンテック
kichinosukey
0
70
Paxos made simpleを理解しよう
kichinosukey
0
450
Other Decks in Science
See All in Science
統計学入門講座 第3回スライド
techmathproject
0
100
生成検索エンジン最適化に関する研究の紹介
ynakano
2
1.1k
安心・効率的な医療現場の実現へ ~オンプレAI & ノーコードワークフローで進める業務改革~
siyoo
0
250
Hakonwa-Quaternion
hiranabe
1
110
データベース01: データベースを使わない世界
trycycle
PRO
1
650
Lean4による汎化誤差評価の形式化
milano0017
1
240
06_浅井雄一郎_株式会社浅井農園代表取締役社長_紹介資料.pdf
sip3ristex
0
500
データベース02: データベースの概念
trycycle
PRO
2
750
SciPyDataJapan 2025
schwalbe10
0
240
統計的因果探索: 背景知識とデータにより因果仮説を探索する
sshimizu2006
4
920
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
konakalab
0
210
機械学習 - ニューラルネットワーク入門
trycycle
PRO
0
800
Featured
See All Featured
[RailsConf 2023] Rails as a piece of cake
palkan
55
5.6k
How STYLIGHT went responsive
nonsquared
100
5.6k
Typedesign – Prime Four
hannesfritz
42
2.7k
Rails Girls Zürich Keynote
gr2m
94
14k
Practical Orchestrator
shlominoach
188
11k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.5k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
5
230
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
Building an army of robots
kneath
306
45k
How GitHub (no longer) Works
holman
314
140k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Making Projects Easy
brettharned
116
6.3k
Transcript
Χʔωϧؔͱ
ࢀߟॻ੶ w ΄΅ࣸܦ͍͖ͤͯͨͩ͞·͠ ͨ w ͱͯΘ͔Γқ͍༰Ͱײँ Ͱ͢ w IUUQTXXXJXBOBNJDPKQ CPPLCIUNM
ಛநग़ʹ͍ͭͯ ↟ᏣͺͼΝᤎ᷀ᔻṟϧόϰͽͶ͖ວ͚Ν ↟ͥΞᬿᔻ᧣ͼؔΤᬤͶᦉᷯͩ͝ϧόϰặ͟ͼ͖ ↟ΚΜີᮈၞḄᙚΤᑿͥ͘ͺΤວ͚Νͺ ↟EᮈᡯfᓓᙚᑤᔻṟͲ͞fϖϮϦ⑲τ⑲XͽͶ͖ᔻṟ y = wTx f(x) =
d ∑ m=1 wm xm ⋯ (1)
ಛநग़ʹ͍ͭͯ ↟ጽͽYͽ᷁͝ᨷΐ͵ͱᑤᔻṟมỐΤᙇͩີᮈͽࣸᓕͫΝͥͺΤ|ᴰ ᱢᲇ}ͺṺΈ ↟ᴰϞδύϰΤᤎ᷀Κ͘ͽᔉ͡ͺͫΝ ↟ͫΝͺ ᙚᴰϞδύϰᤎ᷀ͺͼΝ ඇઢܗม ೖྗY ಛϕΫτϧП
Y ϕ(x) = (ϕ1 (x), ⋯, ϕd (x))T ϕ(x) = (x, x2, x3, ⋯, xd)T
ಛநग़ʹ͍ͭͯ ↟ᴰᱢᲇͧΞͱ໖ණͽ͖͜fᔻṟϧόϰΤວ͚Νͺ ↟ͥວ͚ፖᔟ͝Λϖτ⑲ϸ᤹ᙣᐠᛯ᤹ᬰͧΞ͟ͱ ↟ᴰᱢᲇϦϯψύΐͺΓΝͺᤎ᷀Ͷ ↟ᏝࡶͼؔؔΤ࣮ḿ͟Ν ↟ᡯ᥍ᅪY࣮͞Ϟδύϰ͔Νᶶ᠓͞ͼ͖ ↟ᴰϞδύϰ࣮͞ϞδύϰͼͱΓY͞የᥙᅾΖεϮϚཋ᪦Δᅔ͖ fw (x) =
wTϕ(x) = d ∑ m=1 wm ϕm (x) ⋯ (2)
Χʔωϧؔͷఆٛ ↟Y Ysͺ͖͘ᤍͶมͽରͩΰ⑲ϒϰؔL Y Ys ͯΞͰΞ ᧤Ẹͺͩᤎ᷀Κ͘ͽᨷᤅͧΞΝ ↟ ᙚĘมၞḄᙚfᓓᙚΤͽᤎ᷀Κ͘ͽဒᘥ͟Ν
k(x, x′) = ϕ(x)Tϕ(x′) = d ∑ m=1 ϕm (x)ϕm (x′) ⋯ (3) k(x, x′) = d ∑ m=1 xm(x′)m ⋯ (4)
֤छͷΧʔωϧಋೖʹ͍ͭͯ ↟᧤ ↟ᩆᨷᲩᕥ ↟ệᖰᐠᵿď࿆ỹᕭᅊĐ
ੵͷΧʔωϧදݱ ↟ȃ Y ͺϖϮϦ⑲τ᧤͔Ν ᙚfᚌᐠၞ͡Y Y hhhΤ᧱ ͽᕅΈͺᤎ᷀ṟ࿄ᑾͫΝͥͺ͟͞Ν ↟ΰ⑲ϒϰؔᴰϞδύϰ᧤fଈͳᤎ᷀ᨷᤅͧΞΝ
↟ͥΞfϖϮϦ⑲τ⑲XΤᤎ᷀ṟͽᷟᨷ͟ΝͥͺΤዳͫΝ f(x) = ∑ i αi k(xi , x) ⋯ (5) f(x) = ∑ i αi ϕ(xi )Tϕ(x) ⋯ (6) w = ∑ i αi ϕ(xi )
ੵͷΧʔωϧදݱ ↟ ᙚ|ᚌᐠၞ͡}ᨨY@Jΰ⑲ϒϰؔᔻṟẸͩ͝ͼ͖ ↟κϸϜϰᨨᔻṟẸṟᔉ͡ͱΓͽĦ ↟͔ΝᴰᎭͼᩆ᳀ặΤḝͥ͘ͺfᤎ᷀Κ͘ͼဒᘥ͞൱ၙͺͼΝ ↟ϯϜϱρϸτ⑲ᨷሑďᕭᅊĐf-ϓϰϥΤᑿ͘ ↟OEᦉᷯfXႚΡΜͽEΤᠭ͖ΝͥͺϖϮϦ⑲τΤවΛͫͥͺ͟͞Ν ↟FY ᮈ༜ṹᥭᠭḄࠐΑၞḄᙚΘ͘ͽᮈᡯ͞ᯭͺͼΝͱΓfޮໝΤൃἿͫΝ
f(x) = n ∑ i=1 αi k(x(i), x) = n ∑ i=1 αi d ∑ m=1 (x(i))mxm ⋯ (7)
ਖ਼ఆੑ͔ΒͷΧʔωϧؔ ಋೖ ↟᧤ᕥ᭳͝Λfΰ⑲ϒϰؔᴰᅗͱͺ͟YͺYsᇮᑾ ႷΤᶡ͖ͩΝͺວ͚ΛΞΝ ↟ჯͪፖḟΤḟ͖͖Νͺ͟ͽႝ͟͡ͼΜfᬿ༜ͫΝͺͽͼΝ ↟ᝂͽYͺYsᇮᑾႷΤᶡͫΚ͘ͼؔL Y Ys ͔͞Νͺ͟ͽfͯΞΤ ΰ⑲ϒϰؔͺͩᑿ͚ͼ͖͝Ħ
↟|ᩆᨷᲩᕥ}ΤຬͱͭZFT
ਖ਼ఆੑ ↟͔ΝؔL Y Ys ͞ᩆᨷᲩ͔Νͺf᥅O෪ᨨY@ hhh Y@O ͝ΛຌᒿͧΞΝᤎ᷀ḝᅾďεϮϥḝᅾĐ͔͞Ν ↟ͥΞͽͶ͖ęᮈṟᙚ͞ᓝͽᑤᐔ͔Νͺ͟fᤎ᷀ᙚ͞᥅O ᮈϞδύϰǯ
ǯ@ hhh ǯ@O ?5ͽͶ͖ᕧΜርͶͥͺ͔Νďᩆͩ ͡ጪᩆᨷᲩᕥĐ K = k(x1 , x1 ) k(x2 , x1 ) ⋯ k(xn , x1 ) k(x1 , x2 ) k(x2 , x2 ) ⋯ k(xn , x2 ) ⋮ ⋮ ⋱ ⋮ k(x1 , xn ) k(x2 , xn ) ⋯ k(xn , xn ) n ∑ i=1 n ∑ j=1 αi αj Kij ≥ 0 ⋯ (8)
ΧʔωϧτϦοΫ ↟طͽᩆᨷᬰᕥΤຬͱͫͥͺ͞Ρ͝͵͖ΝؔΤᑿ͚f᧤ຌᒿ͞Ᏽ᠓ͽͼΝ Ħďᤎ᷀ἦᥥζ⑲ξͽͶ͖Đ ↟ᴰϞδύϰ᧤ͺͩᨷᤅͩͱΰ⑲ϒϰ|ᩆᨷᲩ}͔Ν ↟ᝂͽf᥅ᩧᨷᲩؔL Y Ys ͞ରশ L Y
Ys L Ys Y ͔ΞͯΞ|ᴰϞδύϰ ᧤}͔Ν ↟ͥΞᦉᷯͽΚ͵ᷟᮈᡯᴰϞδύϰ᧤͞ඦ୯ͼؔͽͼΝᦉᷯ͞ ͔Ν ↟ͶΐΜfᩆᨷᲩᕥΤΰ⑲ϒϰᨷᤅͺͫΞຌᒿᅗΤවΛͭΝͥͺ͟͞Ν ↟ͥΞΤ|ΰ⑲ϒϰύϯψδ}ͺ͖͘
ΨεΧʔωϧ ↟༺ମᆚ ↟ᩆྥᐠᵿጓႷؔͺჯͪṟ ↟αΫξΰ⑲ϒϰͺṺΈͥͺΔ͔Ν ↟ͥΞᴰϞδύϰණฌሜ᧤ͺͩᶡḿ͟Ν ↟ᩆᨷᲩᕥΔຬͱͫďᕭᅊĐ k(x, x′) = exp(−β∥x
− x′∥2) ⋯ (9)
ଟ߲ࣜΧʔωϧ ↟αΫξΰ⑲ϒϰͺჯ༷ͽfΚ͡ᑿΡΞΝ ↟Qᥦ D∕ ↟ፖfͥᙚΤᤎ᷀ṟͽ᧾ͫΝͺE?Qί⑲υ⑲ಠርͼḄẸ ͺͩᔉͣΝ k(x, x′) = (xT
x′+ c)P ⋯ (10) k(x, x′) = p ∑ m=0 ( p m) { d ∑ l=1 (xl x′ l ) } m cp−m ⋯ (11)
֤Χʔωϧͷಛ w ϊΠζΛͤͨਖ਼ݭʹର͢ΔϑΟο ςΟϯάΛ֤ΧʔωϧͰ࣮ࢪ w ্ஈͰY< >ͷൣғͷϑΟοςΟ ϯάΛ֬ೝ͍ͯ͠Δ͕େ͖ͳࠩҟ ݟΒΕͳ͍ w
͔͠͠ɺԼஈͰֶशσʔλͷൣ ғ֎Λ༧ଌͤ͞Δͱɺଟ߲ࣜൃ ࢄํɺ3#'ऩଋ͢Δํ ͱ͔͏ w IUUQTHJTUHJUIVCDPN LJDIJOPTVLFZ