ଟ༷ମֶश
ଟ༷ମֶशʹͯ͠গ͠ৄ͘͠આ໌͢Δʢݸਓతڵຯʣ
આ໌͢ΔͷҎԼͷτϐοΫɿ
• ͦͦଟ༷ମͱʁʢֶతʹݫີͳ͠ͳ͍ʣ
• ଟ༷ମֶशʹࢸΔϞνϕʔγϣϯ
• Ұͭͷྫͱͯ͠ہॴ࠲ඪ coding ͷվળͷจΛհ
[140] K. Yu, T. Zhang. Improved local coordinate coding using
local tangents. In ICML, 2010.
ʢิʣ࣍ݩͷढ͍
• ಛྔͷ࣍ݩ͕େ͖͗͢Δ߹
Ϟσϧ͕ෳࡶ͗ͯ͢దʹֶशͰ͖ͳ͍
• σʔλۭؒͷ࣍ݩ͕େ͖͗͢Δ߹
ྫͱͯ͠ΫϥελϦϯάΛߟ͑Δ
ٿ໘ूதݱʹΑΓɺҟͳΔؒͷڑ͕͘͠ͳ͍ͬͯ͘
݁Ռͱͯ͠ A ͔Βݟͯ B C ΄΅ಉ͡Ͱ۠ผෆՄ
ʢ࣍ݩͷढ͍ͷ ͡Ίͯͷύλʔϯೝࣝ ͕ৄ͍͠ʣ
Slide 14
Slide 14 text
ଟ༷ମֶशͷྫ
ہॴ࠲ඪ coding Λվળ͢Δ͜ͱΛߟ͑Δ
K. Yu, T. Zhang. Improved local coordinate coding using local
tangents. In ICML, 2010.
࠷ऴతͳඪσʔλ͕͢ଟ༷ମͷࡏతͳ࣍ݩʢPCA Ͱٻ
ΊΔʣΛߟྀ͠ɺͦͷใΛͬͯ coding Λิਖ਼
Slide 15
Slide 15 text
४උ
Slide 16
Slide 16 text
ہॴ࠲ඪ coding ʹΑΔۙࣅ
Slide 17
Slide 17 text
(4.79) ࣜͷূ໌
Slide 18
Slide 18 text
ہॴ࠲ඪ coding ͷֶश๏
Slide 19
Slide 19 text
֦ுہॴ࠲ඪ coding
Slide 20
Slide 20 text
σʔλଟ༷ମͷఆٛ
Slide 21
Slide 21 text
ہॴಛ coding with u
ূ໌ུʢઌ΄Ͳͷূ໌͕͔ͬͯΕ͘͠ͳ͍ʣ
u (local) PCA ͳͲͰٻΊɺm खͰܾΊΔύϥϝλ
c(M) ؔʹ͓͚ΔϦϓγοπఆʹ૬
ॏཁͳͷ c(M) ͕খ͍͞߹ʹ bound ͕Ωπ͘ͳΔͱ͍͏͜ͱ
→ ͜Εখ͞ͳྖҬͰσʔλଟ༷ମ͕ flat ͳߏͰ͋Δ߹
→ “ఆੑత” ͳԾఆͰ flat Ͱͳͯ͘༗ޮͳ߹͋ΓಘΔ
Slide 22
Slide 22 text
ֶशΞϧΰϦζϜ
จͷΞϧΰϦζϜࡌͤΔʢs, m hyperparameterʣ
Slide 23
Slide 23 text
࣮ݧ݁ՌɿMNIST
Cross validation ʹΑΓ s = 0, m = 64
୯७ͳہॴಛ coding ͱൺΔͱ anchor ͕গͳͯ͘ྑ͍
Slide 24
Slide 24 text
࣮ݧ݁ՌɿCIFAR10
Cross validation ʹΑΓ s = 10, m = 256
ͪ͜Β anchor ͕গͳͯ͘ྑ͍݁ՌΛ͍ࣔͯ͠Δ