Upgrade to Pro — share decks privately, control downloads, hide ads and more …

20190223_nlpaperchallenge_CV_4.3to5.5

yoppe
February 23, 2019

 20190223_nlpaperchallenge_CV_4.3to5.5

yoppe

February 23, 2019
Tweet

More Decks by yoppe

Other Decks in Science

Transcript

  1. ࣗݾ঺հ • Twitter ID @yohei_kikuta • Resume • ࠷ۙୀ৬ͯ͠ແ৬ʹͳΓ·ͨ͠
 ϒϩάΤϯτϦ


    ແ৬ͱ࿩ͯ͠Έ͍ͨਓ͸͓੠͕͚͍ͩ͘͞ʂ
 ΫοΫύουྑ͍ձࣾͳͷͰస৬͍ͨ͠ਓ͸ͥͻͲ͏ͧʂ
  2. ଟ༷ମֶश͚ͩৄ͘͠΍Γ·͢ • ը૾ೝࣝ ຊͷ 4.3~5.5 Λൃද • ہॴಛ௃ʹؔͯ͠͸͔ͳΓߴີ౓Ͱ࣌ؒ಺ʹ࿩͖͠Εͳ͍
 ଟ༷ମֶश
 Χʔωϧؔ਺ۙࣅʢಛʹͦͷͨΊͷجૅ஌͕ࣝॏ͍ʣ


    ͦͷ΄͔༷ʑͳ࿩୊ • શମͷ·ͱΊͱུ֓Λہॴಛ௃ͷ෦෼Λܰ͘આ໌ͨ͠ޙɺଟ ༷ମֶशΛ΍΍ৄ͘͠આ໌
 Q. ͳͥଟ༷ମֶशͳͷ͔ʁ
 A. ࣗ෼͕গ͠ਅ໘໨ʹษڧͯ͠Έ͔͔ͨͬͨΒ
  3. ଟ༷ମͱ͸ʁ ہॴతʹ Euclid ۭؒͰهड़Ͱ͖Δ஍ਤΛషΓ߹ΘͤͯදͤΔ෺ ྫʣ஍ද໘Λߟ͑Δ
 ※ Φ ͱ Θ ͚ͩͰ͸࠲ඪܥ͸షΓ͖Εͳ͍ʢ׬શͳٿͰ͸ͳ͍ʣ


    ہॴతʢզʑͷ೔ৗεέʔϧʣʹ͸ Euclid ࠲ඪͰهड़Ͱ͖Δ
 ͦͷ࠲ඪΛషΓ߹ΘͤΕ͹஍ද໘શମΛΧόʔͰ͖Δ
 
 
 
 
 
 ͦͷΑ͏ͳషΓ߹Θͤͷ৘ใͰ 3 ࣍ݩͷ஍ٿͷ৘ใ΋ٞ࿦Մ
  4. ଟ༷ମֶशʹࢸΔಈػ • ࣍ݩͷढ͍ͷճආ
 ྫʣσʔλେྔʹ͋Ε͹ kNN Ͱ͍͍͡ΌΜ → μϝͰ͢ • σʔλͷ༗͢Δಛ௃ΛΑΓྑ͘೺Ѳ


    ઌ΄ͲͷྫͷΑ͏ʹ୯ͳΔ Euclid ڑ཭͕ෆద੾͔΋͠Εͳ͍
 ྫʣࣗવޯ഑๏ɺt-SNE • ༷ʑͳΞϓϩʔν͔Β৽ͨͳ஌ݟ͕ಘΒΕΔ͔΋
 ඍ෼زԿతͳΞϓϩʔνʢہॴతʣˠ େମͷ࿩͸ͬͪ͜
 Ґ૬زԿతͳΞϓϩʔνʢେҬతʣˠ ࠓ೔͸৮Εͳ͍
  5. ଟ༷ମֶशͷྫ ہॴ࠲ඪ coding Λվળ͢Δ͜ͱΛߟ͑Δ K. Yu, T. Zhang. Improved local

    coordinate coding using local tangents. In ICML, 2010. ࠷ऴతͳ໨ඪ͸σʔλ͕੒͢ଟ༷ମͷ಺ࡏతͳ࣍ݩʢPCA Ͱٻ ΊΔʣΛߟྀ͠ɺͦͷ৘ใΛ࢖ͬͯ coding Λิਖ਼
  6. ہॴಛ௃ coding with u ূ໌ུʢઌ΄Ͳͷূ໌͕෼͔ͬͯΕ͹೉͘͠ͳ͍ʣ
 u ͸ (local) PCA ͳͲͰٻΊɺm

    ͸खͰܾΊΔύϥϝλ
 c(M) ͸ؔ਺ʹ͓͚ΔϦϓγοπఆ਺ʹ૬౰
 ॏཁͳͷ͸ c(M) ͕খ͍͞৔߹ʹ bound ͕Ωπ͘ͳΔͱ͍͏͜ͱ
 → ͜Ε͸খ͞ͳྖҬͰ͸σʔλଟ༷ମ͕ flat ͳߏ଄Ͱ͋Δ৔߹
 → “ఆੑత” ͳԾఆͰ flat Ͱͳͯ͘΋༗ޮͳ৔߹΋͋ΓಘΔ
  7. ࣮ݧ݁ՌɿMNIST Cross validation ʹΑΓ s = 0, m = 64

    ୯७ͳہॴಛ௃ coding ͱൺ΂Δͱ anchor ਺͕গͳͯ͘΋ྑ͍
  8. ࣮ݧ݁ՌɿCIFAR10 Cross validation ʹΑΓ s = 10, m = 256

    ͪ͜Β΋ anchor ਺͕গͳͯ͘΋ྑ͍݁ՌΛ͍ࣔͯ͠Δ