Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
カーネル関数とは
Search
kichinosukey
January 14, 2019
Science
0
51
カーネル関数とは
kichinosukey
January 14, 2019
Tweet
Share
More Decks by kichinosukey
See All by kichinosukey
Latin Hypercube Sampling
kichinosukey
0
71
Lasso.pdf
kichinosukey
0
52
NSGAII
kichinosukey
0
46
NSGA
kichinosukey
0
52
基底関数回帰の概要について
kichinosukey
0
73
児童虐待の現状
kichinosukey
0
58
イノベーションのジレンマとフィンテック
kichinosukey
0
70
Paxos made simpleを理解しよう
kichinosukey
0
450
Other Decks in Science
See All in Science
[第62回 CV勉強会@関東] Long-CLIP: Unlocking the Long-Text Capability of CLIP / kantoCV 62th ECCV 2024
lychee1223
1
950
SpatialBiologyWestCoastUS2024
lcolladotor
0
140
Ignite の1年間の軌跡
ktombow
0
130
07_浮世満理子_アイディア高等学院学院長_一般社団法人全国心理業連合会代表理事_紹介資料.pdf
sip3ristex
0
480
IWASAKI Hideo
genomethica
0
110
Online Feedback Optimization
floriandoerfler
0
2.2k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
konakalab
0
210
生成AI による論文執筆サポートの手引き(ワークショップ) / A guide to supporting dissertation writing with generative AI (workshop)
ks91
PRO
0
500
アナログ計算機『計算尺』を愛でる Midosuji Tech #4/Analog Computing Device Slide Rule now and then
quiver
1
190
MCMCのR-hatは分散分析である
moricup
0
370
機械学習 - pandas入門
trycycle
PRO
0
270
06_浅井雄一郎_株式会社浅井農園代表取締役社長_紹介資料.pdf
sip3ristex
0
500
Featured
See All Featured
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
229
22k
Git: the NoSQL Database
bkeepers
PRO
430
65k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
107
19k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.8k
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.4k
Producing Creativity
orderedlist
PRO
346
40k
How to train your dragon (web standard)
notwaldorf
94
6.1k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.4k
Why Our Code Smells
bkeepers
PRO
337
57k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
Building Applications with DynamoDB
mza
95
6.5k
Site-Speed That Sticks
csswizardry
10
670
Transcript
Χʔωϧؔͱ
ࢀߟॻ੶ w ΄΅ࣸܦ͍͖ͤͯͨͩ͞·͠ ͨ w ͱͯΘ͔Γқ͍༰Ͱײँ Ͱ͢ w IUUQTXXXJXBOBNJDPKQ CPPLCIUNM
ಛநग़ʹ͍ͭͯ ↟ᏣͺͼΝᤎ᷀ᔻṟϧόϰͽͶ͖ວ͚Ν ↟ͥΞᬿᔻ᧣ͼؔΤᬤͶᦉᷯͩ͝ϧόϰặ͟ͼ͖ ↟ΚΜີᮈၞḄᙚΤᑿͥ͘ͺΤວ͚Νͺ ↟EᮈᡯfᓓᙚᑤᔻṟͲ͞fϖϮϦ⑲τ⑲XͽͶ͖ᔻṟ y = wTx f(x) =
d ∑ m=1 wm xm ⋯ (1)
ಛநग़ʹ͍ͭͯ ↟ጽͽYͽ᷁͝ᨷΐ͵ͱᑤᔻṟมỐΤᙇͩີᮈͽࣸᓕͫΝͥͺΤ|ᴰ ᱢᲇ}ͺṺΈ ↟ᴰϞδύϰΤᤎ᷀Κ͘ͽᔉ͡ͺͫΝ ↟ͫΝͺ ᙚᴰϞδύϰᤎ᷀ͺͼΝ ඇઢܗม ೖྗY ಛϕΫτϧП
Y ϕ(x) = (ϕ1 (x), ⋯, ϕd (x))T ϕ(x) = (x, x2, x3, ⋯, xd)T
ಛநग़ʹ͍ͭͯ ↟ᴰᱢᲇͧΞͱ໖ණͽ͖͜fᔻṟϧόϰΤວ͚Νͺ ↟ͥວ͚ፖᔟ͝Λϖτ⑲ϸ᤹ᙣᐠᛯ᤹ᬰͧΞ͟ͱ ↟ᴰᱢᲇϦϯψύΐͺΓΝͺᤎ᷀Ͷ ↟ᏝࡶͼؔؔΤ࣮ḿ͟Ν ↟ᡯ᥍ᅪY࣮͞Ϟδύϰ͔Νᶶ᠓͞ͼ͖ ↟ᴰϞδύϰ࣮͞ϞδύϰͼͱΓY͞የᥙᅾΖεϮϚཋ᪦Δᅔ͖ fw (x) =
wTϕ(x) = d ∑ m=1 wm ϕm (x) ⋯ (2)
Χʔωϧؔͷఆٛ ↟Y Ysͺ͖͘ᤍͶมͽରͩΰ⑲ϒϰؔL Y Ys ͯΞͰΞ ᧤Ẹͺͩᤎ᷀Κ͘ͽᨷᤅͧΞΝ ↟ ᙚĘมၞḄᙚfᓓᙚΤͽᤎ᷀Κ͘ͽဒᘥ͟Ν
k(x, x′) = ϕ(x)Tϕ(x′) = d ∑ m=1 ϕm (x)ϕm (x′) ⋯ (3) k(x, x′) = d ∑ m=1 xm(x′)m ⋯ (4)
֤छͷΧʔωϧಋೖʹ͍ͭͯ ↟᧤ ↟ᩆᨷᲩᕥ ↟ệᖰᐠᵿď࿆ỹᕭᅊĐ
ੵͷΧʔωϧදݱ ↟ȃ Y ͺϖϮϦ⑲τ᧤͔Ν ᙚfᚌᐠၞ͡Y Y hhhΤ᧱ ͽᕅΈͺᤎ᷀ṟ࿄ᑾͫΝͥͺ͟͞Ν ↟ΰ⑲ϒϰؔᴰϞδύϰ᧤fଈͳᤎ᷀ᨷᤅͧΞΝ
↟ͥΞfϖϮϦ⑲τ⑲XΤᤎ᷀ṟͽᷟᨷ͟ΝͥͺΤዳͫΝ f(x) = ∑ i αi k(xi , x) ⋯ (5) f(x) = ∑ i αi ϕ(xi )Tϕ(x) ⋯ (6) w = ∑ i αi ϕ(xi )
ੵͷΧʔωϧදݱ ↟ ᙚ|ᚌᐠၞ͡}ᨨY@Jΰ⑲ϒϰؔᔻṟẸͩ͝ͼ͖ ↟κϸϜϰᨨᔻṟẸṟᔉ͡ͱΓͽĦ ↟͔ΝᴰᎭͼᩆ᳀ặΤḝͥ͘ͺfᤎ᷀Κ͘ͼဒᘥ͞൱ၙͺͼΝ ↟ϯϜϱρϸτ⑲ᨷሑďᕭᅊĐf-ϓϰϥΤᑿ͘ ↟OEᦉᷯfXႚΡΜͽEΤᠭ͖ΝͥͺϖϮϦ⑲τΤවΛͫͥͺ͟͞Ν ↟FY ᮈ༜ṹᥭᠭḄࠐΑၞḄᙚΘ͘ͽᮈᡯ͞ᯭͺͼΝͱΓfޮໝΤൃἿͫΝ
f(x) = n ∑ i=1 αi k(x(i), x) = n ∑ i=1 αi d ∑ m=1 (x(i))mxm ⋯ (7)
ਖ਼ఆੑ͔ΒͷΧʔωϧؔ ಋೖ ↟᧤ᕥ᭳͝Λfΰ⑲ϒϰؔᴰᅗͱͺ͟YͺYsᇮᑾ ႷΤᶡ͖ͩΝͺວ͚ΛΞΝ ↟ჯͪፖḟΤḟ͖͖Νͺ͟ͽႝ͟͡ͼΜfᬿ༜ͫΝͺͽͼΝ ↟ᝂͽYͺYsᇮᑾႷΤᶡͫΚ͘ͼؔL Y Ys ͔͞Νͺ͟ͽfͯΞΤ ΰ⑲ϒϰؔͺͩᑿ͚ͼ͖͝Ħ
↟|ᩆᨷᲩᕥ}ΤຬͱͭZFT
ਖ਼ఆੑ ↟͔ΝؔL Y Ys ͞ᩆᨷᲩ͔Νͺf᥅O෪ᨨY@ hhh Y@O ͝ΛຌᒿͧΞΝᤎ᷀ḝᅾďεϮϥḝᅾĐ͔͞Ν ↟ͥΞͽͶ͖ęᮈṟᙚ͞ᓝͽᑤᐔ͔Νͺ͟fᤎ᷀ᙚ͞᥅O ᮈϞδύϰǯ
ǯ@ hhh ǯ@O ?5ͽͶ͖ᕧΜርͶͥͺ͔Νďᩆͩ ͡ጪᩆᨷᲩᕥĐ K = k(x1 , x1 ) k(x2 , x1 ) ⋯ k(xn , x1 ) k(x1 , x2 ) k(x2 , x2 ) ⋯ k(xn , x2 ) ⋮ ⋮ ⋱ ⋮ k(x1 , xn ) k(x2 , xn ) ⋯ k(xn , xn ) n ∑ i=1 n ∑ j=1 αi αj Kij ≥ 0 ⋯ (8)
ΧʔωϧτϦοΫ ↟طͽᩆᨷᬰᕥΤຬͱͫͥͺ͞Ρ͝͵͖ΝؔΤᑿ͚f᧤ຌᒿ͞Ᏽ᠓ͽͼΝ Ħďᤎ᷀ἦᥥζ⑲ξͽͶ͖Đ ↟ᴰϞδύϰ᧤ͺͩᨷᤅͩͱΰ⑲ϒϰ|ᩆᨷᲩ}͔Ν ↟ᝂͽf᥅ᩧᨷᲩؔL Y Ys ͞ରশ L Y
Ys L Ys Y ͔ΞͯΞ|ᴰϞδύϰ ᧤}͔Ν ↟ͥΞᦉᷯͽΚ͵ᷟᮈᡯᴰϞδύϰ᧤͞ඦ୯ͼؔͽͼΝᦉᷯ͞ ͔Ν ↟ͶΐΜfᩆᨷᲩᕥΤΰ⑲ϒϰᨷᤅͺͫΞຌᒿᅗΤවΛͭΝͥͺ͟͞Ν ↟ͥΞΤ|ΰ⑲ϒϰύϯψδ}ͺ͖͘
ΨεΧʔωϧ ↟༺ମᆚ ↟ᩆྥᐠᵿጓႷؔͺჯͪṟ ↟αΫξΰ⑲ϒϰͺṺΈͥͺΔ͔Ν ↟ͥΞᴰϞδύϰණฌሜ᧤ͺͩᶡḿ͟Ν ↟ᩆᨷᲩᕥΔຬͱͫďᕭᅊĐ k(x, x′) = exp(−β∥x
− x′∥2) ⋯ (9)
ଟ߲ࣜΧʔωϧ ↟αΫξΰ⑲ϒϰͺჯ༷ͽfΚ͡ᑿΡΞΝ ↟Qᥦ D∕ ↟ፖfͥᙚΤᤎ᷀ṟͽ᧾ͫΝͺE?Qί⑲υ⑲ಠርͼḄẸ ͺͩᔉͣΝ k(x, x′) = (xT
x′+ c)P ⋯ (10) k(x, x′) = p ∑ m=0 ( p m) { d ∑ l=1 (xl x′ l ) } m cp−m ⋯ (11)
֤Χʔωϧͷಛ w ϊΠζΛͤͨਖ਼ݭʹର͢ΔϑΟο ςΟϯάΛ֤ΧʔωϧͰ࣮ࢪ w ্ஈͰY< >ͷൣғͷϑΟοςΟ ϯάΛ֬ೝ͍ͯ͠Δ͕େ͖ͳࠩҟ ݟΒΕͳ͍ w
͔͠͠ɺԼஈͰֶशσʔλͷൣ ғ֎Λ༧ଌͤ͞Δͱɺଟ߲ࣜൃ ࢄํɺ3#'ऩଋ͢Δํ ͱ͔͏ w IUUQTHJTUHJUIVCDPN LJDIJOPTVLFZ