Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Paper-Survey: Objects as Points
Search
fam_taro
April 19, 2019
Science
0
2.3k
Paper-Survey: Objects as Points
fam_taro
April 19, 2019
Tweet
Share
More Decks by fam_taro
See All by fam_taro
NeRFの概要と 派生系についてのふんわり紹介
fam_taro
3
4.1k
実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)
fam_taro
3
4.5k
Paper:ShapeMask
fam_taro
0
67
Summary: Objects as Points
fam_taro
0
3.2k
Tensorコアを使った PyTorch の高速化について
fam_taro
4
4k
Sequence to Sequence Learning with Neural Networks
fam_taro
1
1.1k
Other Decks in Science
See All in Science
academist Prize 4期生 研究トーク延長戦!「美は世界を救う」っていうけど、どうやって?
jimpe_hitsuwari
0
140
データベース10: 拡張実体関連モデル
trycycle
PRO
0
690
データベース03: 関係データモデル
trycycle
PRO
1
120
03_草原和博_広島大学大学院人間社会科学研究科教授_デジタル_シティズンシップシティで_新たな_学び__をつくる.pdf
sip3ristex
0
470
トラブルがあったコンペに学ぶデータ分析
tereka114
2
1.6k
KH Coderチュートリアル(スライド版)
koichih
1
40k
IWASAKI Hideo
genomethica
0
110
安心・効率的な医療現場の実現へ ~オンプレAI & ノーコードワークフローで進める業務改革~
siyoo
0
230
ウェブ・ソーシャルメディア論文読み会 第25回: Differences in misinformation sharing can lead to politically asymmetric sanctions (Nature, 2024)
hkefka385
0
110
機械学習 - SVM
trycycle
PRO
1
820
Lean4による汎化誤差評価の形式化
milano0017
1
220
生成AI による論文執筆サポートの手引き(ワークショップ) / A guide to supporting dissertation writing with generative AI (workshop)
ks91
PRO
0
500
Featured
See All Featured
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
29
9.5k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
331
22k
Rails Girls Zürich Keynote
gr2m
94
14k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.3k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Done Done
chrislema
184
16k
Building an army of robots
kneath
306
45k
BBQ
matthewcrist
89
9.7k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
281
13k
Git: the NoSQL Database
bkeepers
PRO
430
65k
Transcript
จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
࣍ • ஶऀใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼ •
ͦͷଞײ 2
ஶऀใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) •
Philipp Krähenbühl(UT Aus1n) 3
ಛ • ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... •
ݕग़ͷΈͳΒͣ࢟ɾdepthɾ͖ɾ3d size ʹద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) Hourglass(CornerNet Ͱ ༻) Λ༻ 4
ಛ • bounding box ΛΘͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid
ͷΘΓʹ͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ͷͷ) Λग़ྗ • heatmap ͕ߴ͍ॴ() Λମͷத৺ͱਪఆ • த৺ͱͳΔॴͷ feature ͔Βମͷେ͖͞ɾࢄԽޡࠩΛਪఆ • ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ) 5
ಛ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌࢄԽޡࠩ
• ֶशʹ͏ heatmap ͷ 1ମʹ͖ͭ 1ͭͷΈ • SSD ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ͚ͳ͍ • ෳ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
Πϝʔδਤ 7
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetശͷॏͳΓͰͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ • લܠͱഎܠͷྨʹؔ͢Δखಈͷ͖͍͠ͳ͍(IoU 0.5 > ͱ͔) • ମຖʹϙδςΟϒͳΞϯΧʔ1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetΑΓେ͖ͳग़ྗղ૾Λ͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet )ͱͷҧ͍ •
্ه 2ͭ keypoint ݕग़ޙʹ Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ͘ͳͬͯ͠·͏ • CenterNet ඞཁͱ͠ͳ͍ • ͍ʂ 10
ਫ਼ 11
ਫ਼(M2Det ͷ݁ՌΛࢹͰՃͯ͠Έͨ) 12
ͦͷଞײ • Backbone ͱͯ͠ DLA Λ͑ΔͷΛॳΊͯͬͨ • Ή͠Ζ DLA ॳΊͯΓ·ͨ͠
! • NMS ͕ෆཁʹͳΔͷຯʹخ͍͠ • anchor ͕ফ͑Δͷخ͍͠ • খ͍͞ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13