20190223_nlpaperchallenge_CV_4.3to5.5

by yoppe

Slide 1

Slide 1 text

ୈ2ճ nlpaper.challenge NLP/CV ަྲྀษڧձ ը૾ೝࣝ ୈ4.3ষ~ୈ5.5ষ 20190223 Yohei KIKUTA

Slide 2

Slide 2 text

ࣗݾ঺հ • Twitter ID @yohei_kikuta • Resume • ࠷ۙୀ৬ͯ͠ແ৬ʹͳΓ·ͨ͠  ϒϩάΤϯτϦ  ແ৬ͱ࿩ͯ͠Έ͍ͨਓ͸͓੠͕͚͍ͩ͘͞ʂ  ΫοΫύουྑ͍ձࣾͳͷͰస৬͍ͨ͠ਓ͸ͥͻͲ͏ͧʂ

Slide 3

Slide 3 text

ଟ༷ମֶश͚ͩৄ͘͠΍Γ·͢ • ը૾ೝࣝ ຊͷ 4.3~5.5 Λൃද • ہॴಛ௃ʹؔͯ͠͸͔ͳΓߴີ౓Ͱ࣌ؒ಺ʹ࿩͖͠Εͳ͍  ଟ༷ମֶश  Χʔωϧؔ਺ۙࣅʢಛʹͦͷͨΊͷجૅ஌͕ࣝॏ͍ʣ  ͦͷ΄͔༷ʑͳ࿩୊ • શମͷ·ͱΊͱུ֓Λہॴಛ௃ͷ෦෼Λܰ͘આ໌ͨ͠ޙɺଟ ༷ମֶशΛ΍΍ৄ͘͠આ໌  Q. ͳͥଟ༷ମֶशͳͷ͔ʁ  A. ࣗ෼͕গ͠ਅ໘໨ʹษڧͯ͠Έ͔͔ͨͬͨΒ

Slide 4

Slide 4 text

4.3~4.6 ͷ·ͱΊ ہॴಛ௃ͰࣦΘΕۭͨؒ৘ใΛ෇༩ͨ͠Γ΋͢Δʢ4.6ʣ

Slide 5

Slide 5 text

5.1~5.5 ͷ·ͱΊ ʢ֬཰తʣޯ഑߱Լ๏΍χϡʔτϯ๏Ͱύϥϝλ w Λֶश

Slide 6

Slide 6 text

ہॴಛ௃Λ༻͍ͨ࠶ߏங ͜Ε͸݁ہͲͷล͕ଟ༷ମͳͷ͔ʁ  ͱ͍͏੠͕ฉ͖͑ͯͦ͜͏͕ͩɺͦΕ͸ޙͰগ͠ৄ͘͠આ໌

Slide 7

Slide 7 text

ಛ௃ࣸ૾ʹΑΔΧʔωϧͷۙࣅ ػցֶशʹଌ౓࿦͍Δͷʁͱ͍͏ٙ໰Λ࣋ͭਓ͸  Mercer’s theorem ͱ͔ Bochner’s theorem ͱ͔Λݟ·͠ΐ͏

Slide 8

Slide 8 text

ۭؒ৘ใͷ׆༻ • ϓʔϦϯάʹΑࣦͬͯΘΕΔҐஔ৘ใΛखͰՃ͑Δ • ہॴهड़ࢠͷҐஔ΍εέʔϧΛՃ͑Δ • ہॴهड़ࢠͷࣗݾ૬ؔߦྻͷཁૉΛՃ͑Δ • spatial pyramid ͸ϓʔϦϯάޙͷಛ௃ʹۭؒ৘ใΛ෇༩

Slide 9

Slide 9 text

ଟ༷ମֶश ଟ༷ମֶशʹ஫໨ͯ͠গ͠ৄ͘͠આ໌͢Δʢݸਓతڵຯʣ આ໌͢Δͷ͸ҎԼͷτϐοΫɿ • ͦ΋ͦ΋ଟ༷ମͱ͸ʁʢ਺ֶతʹݫີͳ࿩͸͠ͳ͍ʣ • ଟ༷ମֶशʹࢸΔϞνϕʔγϣϯ • Ұͭͷྫͱͯ͠ہॴ࠲ඪ coding ͷվળͷ࿦จΛ঺հ  [140] K. Yu, T. Zhang. Improved local coordinate coding using local tangents. In ICML, 2010.

Slide 10

Slide 10 text

ଟ༷ମͱ͸ʁ ہॴతʹ Euclid ۭؒͰهड़Ͱ͖Δ஍ਤΛషΓ߹ΘͤͯදͤΔ෺ ྫʣ஍ද໘Λߟ͑Δ  ※ Φ ͱ Θ ͚ͩͰ͸࠲ඪܥ͸షΓ͖Εͳ͍ʢ׬શͳٿͰ͸ͳ͍ʣ  ہॴతʢզʑͷ೔ৗεέʔϧʣʹ͸ Euclid ࠲ඪͰهड़Ͱ͖Δ  ͦͷ࠲ඪΛషΓ߹ΘͤΕ͹஍ද໘શମΛΧόʔͰ͖Δ            ͦͷΑ͏ͳషΓ߹Θͤͷ৘ใͰ 3 ࣍ݩͷ஍ٿͷ৘ใ΋ٞ࿦Մ

Slide 11

Slide 11 text

ଟ༷ମͱ͸ʁ σʔλͷॅΉۭؒ΋ಉ͡Α͏ͳ΋ͷͩͱ૝૾͞ΕΔ ͜ͷΑ͏ͳঢ়گͰ͸ɺྫ͑͹ೋ఺ؒͷڑ཭ΛଌΔͱ͖ʹߴ࣍ݩۭ ؒͰͷ Euclid ڑ཭͸ෆద੾͔΋͠Εͳ͍  → ଟ༷ମʹԊͬͯڑ཭ΛଌΔํ͕ੑ࣭Λଊ͑ΒΕͦ͏ʢଌ஍ઢʣ  → ৘ใزԿʹ͓͚Δࣗવޯ഑๏ͳͲ͸͜ΕΛ࢖͍ͬͯΔ

Slide 12

Slide 12 text

ଟ༷ମֶशʹࢸΔಈػ • ࣍ݩͷढ͍ͷճආ  ྫʣσʔλେྔʹ͋Ε͹ kNN Ͱ͍͍͡ΌΜ → μϝͰ͢ • σʔλͷ༗͢Δಛ௃ΛΑΓྑ͘೺Ѳ  ઌ΄ͲͷྫͷΑ͏ʹ୯ͳΔ Euclid ڑ཭͕ෆద੾͔΋͠Εͳ͍  ྫʣࣗવޯ഑๏ɺt-SNE • ༷ʑͳΞϓϩʔν͔Β৽ͨͳ஌ݟ͕ಘΒΕΔ͔΋  ඍ෼زԿతͳΞϓϩʔνʢہॴతʣˠ େମͷ࿩͸ͬͪ͜  Ґ૬زԿతͳΞϓϩʔνʢେҬతʣˠ ࠓ೔͸৮Εͳ͍

Slide 13

Slide 13 text

ʢิ଍ʣ࣍ݩͷढ͍ • ಛ௃ྔͷ࣍ݩ͕େ͖͗͢Δ৔߹  Ϟσϧ͕ෳࡶ͗ͯ͢ద੾ʹֶशͰ͖ͳ͍ • σʔλۭؒͷ࣍ݩ͕େ͖͗͢Δ৔߹  ྫͱͯ͠ΫϥελϦϯάΛߟ͑Δ  ٿ໘ूதݱ৅ʹΑΓɺҟͳΔ఺ؒͷڑ཭͕౳͘͠ͳ͍ͬͯ͘  ݁Ռͱͯ͠఺ A ͔Βݟͯ఺ B ΋఺ C ΋΄΅ಉ͡Ͱ۠ผෆՄ          ʢ࣍ݩͷढ͍ͷ࿩୊͸ ͸͡Ίͯͷύλʔϯೝࣝ ͕ৄ͍͠ʣ

Slide 14

Slide 14 text

ଟ༷ମֶशͷྫ ہॴ࠲ඪ coding Λվળ͢Δ͜ͱΛߟ͑Δ K. Yu, T. Zhang. Improved local coordinate coding using local tangents. In ICML, 2010. ࠷ऴతͳ໨ඪ͸σʔλ͕੒͢ଟ༷ମͷ಺ࡏతͳ࣍ݩʢPCA Ͱٻ ΊΔʣΛߟྀ͠ɺͦͷ৘ใΛ࢖ͬͯ coding Λิਖ਼

Slide 15

Slide 15 text

४උ

Slide 16

Slide 16 text

ہॴ࠲ඪ coding ʹΑΔۙࣅ

Slide 17

Slide 17 text

(4.79) ࣜͷূ໌

Slide 18

Slide 18 text

ہॴ࠲ඪ coding ͷֶश๏

Slide 19

Slide 19 text

֦ுہॴ࠲ඪ coding

Slide 20

Slide 20 text

σʔλଟ༷ମͷఆٛ

Slide 21

Slide 21 text

ہॴಛ௃ coding with u ূ໌ུʢઌ΄Ͳͷূ໌͕෼͔ͬͯΕ͹೉͘͠ͳ͍ʣ  u ͸ (local) PCA ͳͲͰٻΊɺm ͸खͰܾΊΔύϥϝλ  c(M) ͸ؔ਺ʹ͓͚ΔϦϓγοπఆ਺ʹ૬౰  ॏཁͳͷ͸ c(M) ͕খ͍͞৔߹ʹ bound ͕Ωπ͘ͳΔͱ͍͏͜ͱ  → ͜Ε͸খ͞ͳྖҬͰ͸σʔλଟ༷ମ͕ ﬂat ͳߏ଄Ͱ͋Δ৔߹  → “ఆੑత” ͳԾఆͰ ﬂat Ͱͳͯ͘΋༗ޮͳ৔߹΋͋ΓಘΔ

Slide 22

Slide 22 text

ֶशΞϧΰϦζϜ ࿦จͷΞϧΰϦζϜࡌͤΔʢs, m ͸ hyperparameterʣ

Slide 23

Slide 23 text

࣮ݧ݁ՌɿMNIST Cross validation ʹΑΓ s = 0, m = 64 ୯७ͳہॴಛ௃ coding ͱൺ΂Δͱ anchor ਺͕গͳͯ͘΋ྑ͍

Slide 24

Slide 24 text

࣮ݧ݁ՌɿCIFAR10 Cross validation ʹΑΓ s = 10, m = 256 ͪ͜Β΋ anchor ਺͕গͳͯ͘΋ྑ͍݁ՌΛ͍ࣔͯ͠Δ

Slide 25

Slide 25 text

ଟ༷ମֶश͸໾ʹཱͭ • σʔλͷߏ଄Λ͏·͘ଊ͑ͯ༗༻ͳಛ௃ྔΛ࡞Εͨ • ہॴੑʹ஫໨Λ͠ͳ͕Βߴ࣍ݩ৘ใΛ௿࣍ݩͰۙࣅ • ࣮ࡍʹࣝผੑೳ͕޲্ • σΟʔϓϥʔχϯάͰ΋ଟ༷ମֶश͸ڵຯਂ͍τϐοΫ  ৘ใزԿ  ϦʔϚϯଟ༷ମ্ͰֶशΛఆࣜԽ  …

Slide 26

Slide 26 text

4.3~4.6 ͷ·ͱΊʢ࠶ܝʣ ہॴಛ௃ͰࣦΘΕۭͨؒ৘ใΛ෇༩ͨ͠Γ΋͢Δʢ4.6ʣ