Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Paper-Survey: Objects as Points
Search
fam_taro
April 19, 2019
Science
0
2.3k
Paper-Survey: Objects as Points
fam_taro
April 19, 2019
Tweet
Share
More Decks by fam_taro
See All by fam_taro
NeRFの概要と 派生系についてのふんわり紹介
fam_taro
3
4k
実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)
fam_taro
3
4.5k
Paper:ShapeMask
fam_taro
0
60
Summary: Objects as Points
fam_taro
0
3.1k
Tensorコアを使った PyTorch の高速化について
fam_taro
4
3.9k
Sequence to Sequence Learning with Neural Networks
fam_taro
1
1.1k
Other Decks in Science
See All in Science
02_西村訓弘_プログラムディレクター_人口減少を機にひらく未来社会.pdf
sip3ristex
0
180
化学におけるAI・シミュレーション活用のトレンドと 汎用原子レベルシミュレーター: Matlantisを使った素材開発
matlantis
0
470
サメのはなし / How Sharks are born
naospon
0
2.5k
butterfly_effect/butterfly_effect_in-house
florets1
1
150
サイゼミ用因果推論
lw
1
3.7k
Factorized Diffusion: Perceptual Illusions by Noise Decomposition
tomoaki0705
0
340
Machine Learning for Materials (Challenge)
aronwalsh
0
200
白金鉱業Meetup Vol.16_数理最適化案件のはじめかた・すすめかた
brainpadpr
3
1.4k
科学で迫る勝敗の法則(名城大学公開講座.2024年10月) / The principle of victory discovered by science (Open lecture in Meijo Univ. 2024)
konakalab
0
270
03_草原和博_広島大学大学院人間社会科学研究科教授_デジタル_シティズンシップシティで_新たな_学び__をつくる.pdf
sip3ristex
0
170
ほたるのひかり/RayTracingCamp10
kugimasa
1
540
インフラだけではない MLOps の話 @事例でわかるMLOps 機械学習の成果をスケールさせる処方箋 発売記念
icoxfog417
PRO
2
720
Featured
See All Featured
KATA
mclloyd
29
14k
It's Worth the Effort
3n
184
28k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
49
2.3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
27
1.9k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
7
660
Designing for humans not robots
tammielis
250
25k
Stop Working from a Prison Cell
hatefulcrawdad
268
20k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
11
1.3k
YesSQL, Process and Tooling at Scale
rocio
172
14k
Building Your Own Lightsaber
phodgson
104
6.2k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
330
21k
Transcript
จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
࣍ • ஶऀใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼ •
ͦͷଞײ 2
ஶऀใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) •
Philipp Krähenbühl(UT Aus1n) 3
ಛ • ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... •
ݕग़ͷΈͳΒͣ࢟ɾdepthɾ͖ɾ3d size ʹద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) Hourglass(CornerNet Ͱ ༻) Λ༻ 4
ಛ • bounding box ΛΘͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid
ͷΘΓʹ͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ͷͷ) Λग़ྗ • heatmap ͕ߴ͍ॴ() Λମͷத৺ͱਪఆ • த৺ͱͳΔॴͷ feature ͔Βମͷେ͖͞ɾࢄԽޡࠩΛਪఆ • ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ) 5
ಛ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌࢄԽޡࠩ
• ֶशʹ͏ heatmap ͷ 1ମʹ͖ͭ 1ͭͷΈ • SSD ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ͚ͳ͍ • ෳ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
Πϝʔδਤ 7
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetശͷॏͳΓͰͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ • લܠͱഎܠͷྨʹؔ͢Δखಈͷ͖͍͠ͳ͍(IoU 0.5 > ͱ͔) • ମຖʹϙδςΟϒͳΞϯΧʔ1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetΑΓେ͖ͳग़ྗղ૾Λ͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet )ͱͷҧ͍ •
্ه 2ͭ keypoint ݕग़ޙʹ Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ͘ͳͬͯ͠·͏ • CenterNet ඞཁͱ͠ͳ͍ • ͍ʂ 10
ਫ਼ 11
ਫ਼(M2Det ͷ݁ՌΛࢹͰՃͯ͠Έͨ) 12
ͦͷଞײ • Backbone ͱͯ͠ DLA Λ͑ΔͷΛॳΊͯͬͨ • Ή͠Ζ DLA ॳΊͯΓ·ͨ͠
! • NMS ͕ෆཁʹͳΔͷຯʹخ͍͠ • anchor ͕ফ͑Δͷخ͍͠ • খ͍͞ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13