Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
20190223_nlpaperchallenge_CV_4.3to5.5
Search
yoppe
February 23, 2019
Science
2
820
20190223_nlpaperchallenge_CV_4.3to5.5
Presentation at
https://nlpaper-challenge.connpass.com/event/118557/
.
yoppe
February 23, 2019
Tweet
Share
More Decks by yoppe
See All by yoppe
20211023_recsys2021_paper_reading_YoheiKikuta
diracdiego
2
480
20201121_oldpaperreading_computing_machinery_and_intelligence
diracdiego
0
160
20200906_ACL2020_metric_for_ordinal_classification_YoheiKikuta
diracdiego
1
1.3k
20191102_ACL2019_adversarial_examples_in_NLP_YoheiKIKUTA
diracdiego
2
1.4k
20180701_CVPR2018_reading_YoheiKIKUTA
diracdiego
3
1.2k
20180414_WSDM2018_reading_YoheiKIKUTA
diracdiego
0
710
20180306_NIPS2017_DeepLearning
diracdiego
4
5.9k
20180215_MLKitchen7_YoheiKIKUTA
diracdiego
0
430
20180210_Cookpad_TechConf2018_YoheiKIKUTA
diracdiego
5
1.2k
Other Decks in Science
See All in Science
深層学習を用いた根菜類の個数カウントによる収量推定法の開発
kentaitakura
0
160
高校生就活へのDA導入の提案
shunyanoda
0
380
MoveItを使った産業用ロボット向け動作作成方法の紹介 / Introduction to creating motion for industrial robots using MoveIt
ry0_ka
0
500
05_山中真也_室蘭工業大学大学院工学研究科教授_だてプロの挑戦.pdf
sip3ristex
0
510
IWASAKI Hideo
genomethica
0
110
サイゼミ用因果推論
lw
1
7.3k
データベース01: データベースを使わない世界
trycycle
PRO
1
660
システム数理と応用分野の未来を切り拓くロードマップ・エンターテインメント(スポーツ)への応用 / Applied mathematics for sports entertainment
konakalab
1
340
[第62回 CV勉強会@関東] Long-CLIP: Unlocking the Long-Text Capability of CLIP / kantoCV 62th ECCV 2024
lychee1223
1
950
機械学習 - K-means & 階層的クラスタリング
trycycle
PRO
0
990
07_浮世満理子_アイディア高等学院学院長_一般社団法人全国心理業連合会代表理事_紹介資料.pdf
sip3ristex
0
490
創薬における機械学習技術について
kanojikajino
16
5.3k
Featured
See All Featured
Docker and Python
trallard
44
3.5k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
35
2.4k
Balancing Empowerment & Direction
lara
1
410
StorybookのUI Testing Handbookを読んだ
zakiyama
30
5.9k
Build The Right Thing And Hit Your Dates
maggiecrowley
36
2.8k
Testing 201, or: Great Expectations
jmmastey
42
7.6k
GraphQLとの向き合い方2022年版
quramy
49
14k
Music & Morning Musume
bryan
46
6.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
730
It's Worth the Effort
3n
185
28k
[RailsConf 2023] Rails as a piece of cake
palkan
55
5.6k
Git: the NoSQL Database
bkeepers
PRO
430
65k
Transcript
ୈ2ճ nlpaper.challenge NLP/CV ަྲྀษڧձ ը૾ೝࣝ ୈ4.3ষ~ୈ5.5ষ 20190223 Yohei KIKUTA
ࣗݾհ • Twitter ID @yohei_kikuta • Resume • ࠷ۙୀ৬ͯ͠ແ৬ʹͳΓ·ͨ͠ ϒϩάΤϯτϦ
ແ৬ͱͯ͠Έ͍ͨਓ͓͕͚͍ͩ͘͞ʂ ΫοΫύουྑ͍ձࣾͳͷͰస৬͍ͨ͠ਓͥͻͲ͏ͧʂ
ଟ༷ମֶश͚ͩৄ͘͠Γ·͢ • ը૾ೝࣝ ຊͷ 4.3~5.5 Λൃද • ہॴಛʹ͔ؔͯ͠ͳΓߴີͰ࣌ؒʹ͖͠Εͳ͍ ଟ༷ମֶश ΧʔωϧؔۙࣅʢಛʹͦͷͨΊͷجૅ͕ࣝॏ͍ʣ
ͦͷ΄͔༷ʑͳ • શମͷ·ͱΊͱུ֓Λہॴಛͷ෦Λܰ͘આ໌ͨ͠ޙɺଟ ༷ମֶशΛৄ͘͠આ໌ Q. ͳͥଟ༷ମֶशͳͷ͔ʁ A. ͕ࣗগ͠ਅ໘ʹษڧͯ͠Έ͔͔ͨͬͨΒ
4.3~4.6 ͷ·ͱΊ ہॴಛͰࣦΘΕۭͨؒใΛ༩ͨ͠Γ͢Δʢ4.6ʣ
5.1~5.5 ͷ·ͱΊ ʢ֬తʣޯ߱Լ๏χϡʔτϯ๏Ͱύϥϝλ w Λֶश
ہॴಛΛ༻͍ͨ࠶ߏங ͜Ε݁ہͲͷล͕ଟ༷ମͳͷ͔ʁ ͱ͍͏͕ฉ͖͑ͯͦ͜͏͕ͩɺͦΕޙͰগ͠ৄ͘͠આ໌
ಛࣸ૾ʹΑΔΧʔωϧͷۙࣅ ػցֶशʹଌ͍Δͷʁͱ͍͏ٙΛ࣋ͭਓ Mercer’s theorem ͱ͔ Bochner’s theorem ͱ͔Λݟ·͠ΐ͏
ۭؒใͷ׆༻ • ϓʔϦϯάʹΑࣦͬͯΘΕΔҐஔใΛखͰՃ͑Δ • ہॴهड़ࢠͷҐஔεέʔϧΛՃ͑Δ • ہॴهड़ࢠͷࣗݾ૬ؔߦྻͷཁૉΛՃ͑Δ • spatial pyramid
ϓʔϦϯάޙͷಛʹۭؒใΛ༩
ଟ༷ମֶश ଟ༷ମֶशʹͯ͠গ͠ৄ͘͠આ໌͢Δʢݸਓతڵຯʣ આ໌͢ΔͷҎԼͷτϐοΫɿ • ͦͦଟ༷ମͱʁʢֶతʹݫີͳ͠ͳ͍ʣ • ଟ༷ମֶशʹࢸΔϞνϕʔγϣϯ • Ұͭͷྫͱͯ͠ہॴ࠲ඪ coding
ͷվળͷจΛհ [140] K. Yu, T. Zhang. Improved local coordinate coding using local tangents. In ICML, 2010.
ଟ༷ମͱʁ ہॴతʹ Euclid ۭؒͰهड़Ͱ͖ΔਤΛషΓ߹ΘͤͯදͤΔ ྫʣද໘Λߟ͑Δ ※ Φ ͱ Θ ͚ͩͰ࠲ඪܥషΓ͖Εͳ͍ʢશͳٿͰͳ͍ʣ
ہॴతʢզʑͷৗεέʔϧʣʹ Euclid ࠲ඪͰهड़Ͱ͖Δ ͦͷ࠲ඪΛషΓ߹ΘͤΕද໘શମΛΧόʔͰ͖Δ ͦͷΑ͏ͳషΓ߹ΘͤͷใͰ 3 ࣍ݩͷٿͷใٞՄ
ଟ༷ମͱʁ σʔλͷॅΉۭؒಉ͡Α͏ͳͷͩͱ૾͞ΕΔ ͜ͷΑ͏ͳঢ়گͰɺྫ͑ೋؒͷڑΛଌΔͱ͖ʹߴ࣍ݩۭ ؒͰͷ Euclid ڑෆద͔͠Εͳ͍ → ଟ༷ମʹԊͬͯڑΛଌΔํ͕ੑ࣭Λଊ͑ΒΕͦ͏ʢଌઢʣ → ใزԿʹ͓͚Δࣗવޯ๏ͳͲ͜ΕΛ͍ͬͯΔ
ଟ༷ମֶशʹࢸΔಈػ • ࣍ݩͷढ͍ͷճආ ྫʣσʔλେྔʹ͋Ε kNN Ͱ͍͍͡ΌΜ → μϝͰ͢ • σʔλͷ༗͢ΔಛΛΑΓྑ͘Ѳ
ઌ΄ͲͷྫͷΑ͏ʹ୯ͳΔ Euclid ڑ͕ෆద͔͠Εͳ͍ ྫʣࣗવޯ๏ɺt-SNE • ༷ʑͳΞϓϩʔν͔Β৽ͨͳݟ͕ಘΒΕΔ͔ ඍزԿతͳΞϓϩʔνʢہॴతʣˠ େମͷͬͪ͜ Ґ૬زԿతͳΞϓϩʔνʢେҬతʣˠ ࠓ৮Εͳ͍
ʢิʣ࣍ݩͷढ͍ • ಛྔͷ࣍ݩ͕େ͖͗͢Δ߹ Ϟσϧ͕ෳࡶ͗ͯ͢దʹֶशͰ͖ͳ͍ • σʔλۭؒͷ࣍ݩ͕େ͖͗͢Δ߹ ྫͱͯ͠ΫϥελϦϯάΛߟ͑Δ ٿ໘ूதݱʹΑΓɺҟͳΔؒͷڑ͕͘͠ͳ͍ͬͯ͘ ݁Ռͱͯ͠ A
͔Βݟͯ B C ΄΅ಉ͡Ͱ۠ผෆՄ ʢ࣍ݩͷढ͍ͷ ͡Ίͯͷύλʔϯೝࣝ ͕ৄ͍͠ʣ
ଟ༷ମֶशͷྫ ہॴ࠲ඪ coding Λվળ͢Δ͜ͱΛߟ͑Δ K. Yu, T. Zhang. Improved local
coordinate coding using local tangents. In ICML, 2010. ࠷ऴతͳඪσʔλ͕͢ଟ༷ମͷࡏతͳ࣍ݩʢPCA Ͱٻ ΊΔʣΛߟྀ͠ɺͦͷใΛͬͯ coding Λิਖ਼
४උ
ہॴ࠲ඪ coding ʹΑΔۙࣅ
(4.79) ࣜͷূ໌
ہॴ࠲ඪ coding ͷֶश๏
֦ுہॴ࠲ඪ coding
σʔλଟ༷ମͷఆٛ
ہॴಛ coding with u ূ໌ུʢઌ΄Ͳͷূ໌͕͔ͬͯΕ͘͠ͳ͍ʣ u (local) PCA ͳͲͰٻΊɺm
खͰܾΊΔύϥϝλ c(M) ؔʹ͓͚ΔϦϓγοπఆʹ૬ ॏཁͳͷ c(M) ͕খ͍͞߹ʹ bound ͕Ωπ͘ͳΔͱ͍͏͜ͱ → ͜Εখ͞ͳྖҬͰσʔλଟ༷ମ͕ flat ͳߏͰ͋Δ߹ → “ఆੑత” ͳԾఆͰ flat Ͱͳͯ͘༗ޮͳ߹͋ΓಘΔ
ֶशΞϧΰϦζϜ จͷΞϧΰϦζϜࡌͤΔʢs, m hyperparameterʣ
࣮ݧ݁ՌɿMNIST Cross validation ʹΑΓ s = 0, m = 64
୯७ͳہॴಛ coding ͱൺΔͱ anchor ͕গͳͯ͘ྑ͍
࣮ݧ݁ՌɿCIFAR10 Cross validation ʹΑΓ s = 10, m = 256
ͪ͜Β anchor ͕গͳͯ͘ྑ͍݁ՌΛ͍ࣔͯ͠Δ
ଟ༷ମֶशʹཱͭ • σʔλͷߏΛ͏·͘ଊ͑ͯ༗༻ͳಛྔΛ࡞Εͨ • ہॴੑʹΛ͠ͳ͕Βߴ࣍ݩใΛ࣍ݩͰۙࣅ • ࣮ࡍʹࣝผੑೳ্͕ • σΟʔϓϥʔχϯάͰଟ༷ମֶशڵຯਂ͍τϐοΫ ใزԿ
ϦʔϚϯଟ༷ମ্ͰֶशΛఆࣜԽ …
4.3~4.6 ͷ·ͱΊʢ࠶ܝʣ ہॴಛͰࣦΘΕۭͨؒใΛ༩ͨ͠Γ͢Δʢ4.6ʣ