Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ABEJA Innovation Meetup NIPS PointNet++
Search
望月紅葉さんと幸せな家庭を築きたい
January 01, 2018
Programming
1
480
ABEJA Innovation Meetup NIPS PointNet++
望月紅葉さんと幸せな家庭を築きたい
January 01, 2018
Tweet
Share
More Decks by 望月紅葉さんと幸せな家庭を築きたい
See All by 望月紅葉さんと幸せな家庭を築きたい
shadow-detection-with-conditional-generative-adversarial-networks
momijifullmoon
0
130
unsupervised-learning-of-depth-and-ego-motion-from-monocular-video-using-3d-geometric-constraints
momijifullmoon
0
320
NIPS2017reading_3Dreconstruction
momijifullmoon
0
1.4k
Other Decks in Programming
See All in Programming
코틀린으로 멀티플랫폼 만들기
pangmoo
0
120
try! Swift Tokyo 2024のLT枠に採択されたプロポーザルを出すときに考えていたこと
ski
0
340
Designing for tomorrow's programming workflows
honnibal
PRO
2
110
オブジェクト指向のリ・オリエンテーション~歴史を振り返り、AI時代に向きなおる~
hanyudaeiiti
10
5.6k
1인 개발자로 행복하게 살기 - GDG 송도 헬로월드 2024
benjaminkim
1
5.6k
スキーマ駆動開発による品質とスピードの両立 - 私達は何故、スキーマを書くのか
kentaroutakeda
0
120
SpringBoot+MyBatisで例外が出たときどこを見るか
syukai
0
110
try! Swift Tokyo 2024 参加報告 / try! Swift Tokyo 2024 Report
hironytic
0
170
Ruby製社内ツールのGo移行
bgpat
2
330
CA.swift19 恋するAIアプリ開発の裏側
oskmr
0
340
デザインシステムで Tailwind CSSとCSS in JSに分散投資をしたら良かった話
fsubal
18
4.8k
受託開発でGitLab CI を活用していく
xiombatsg
1
270
Featured
See All Featured
The Language of Interfaces
destraynor
151
23k
Being A Developer After 40
akosma
56
580k
Bootstrapping a Software Product
garrettdimon
PRO
301
110k
It's Worth the Effort
3n
180
27k
Git: the NoSQL Database
bkeepers
PRO
422
63k
Raft: Consensus for Rubyists
vanstee
132
6.2k
Designing on Purpose - Digital PM Summit 2013
jponch
110
6.4k
Six Lessons from altMBA
skipperchong
20
3k
Making Projects Easy
brettharned
108
5.5k
The Invisible Customer
myddelton
114
12k
Atom: Resistance is Futile
akmur
258
25k
Typedesign – Prime Four
hannesfritz
36
2.1k
Transcript
PointNet++: Deep Hierarchical Feature Learning on Point Sets
in a Metric Space NIPSಡΈձˏABEJA 1
PointNet++ͷ֓ཁ ▸ ஶऀ: Charles R. Qi, Li Yi, Hao Su,
Leonidas J. Guibas ɹɹ ˏελϯϑΥʔυ ▸ ֓ཁ ▸ ܈Λͦͷ··ೖྗ͠ɺͦͷΫϥεྨɺ SegmentationΛߦ͏PointNetͷվྑใࠂ ▸ PointNetͷऑͰ͋ͬͨ܈ີґଘΛࠀɺ ͓Αͼ֊తͳֶशΛͰ͖ΔΑ͏ʹ ʮSampling Layerʯͱ ʮGrouped LayerʯΛఏҊ 2
എܠ ▸ ̏࣍ݩͷधཁ 3 ࣗಈӡస AR ઃܭ
ͷྲྀΕ ▸ എܠ ▸ PointNetʹ͍ͭͯ ▸ ख๏ ▸ ࣮ݧ ▸
·ͱΊ 4
എܠ ▸ ̏࣍ݩͷσʔλ 5 ɹɹ܈ɹɹ ɹɹϝογϡɹɹ Voxel Өɹ RGB-D
എܠ ▸ طଘͷख๏ ▸ ܈Λผͷදݱʹม͍ͯͨ͠ 6 Unstructured, Unordered ͳ܈Λͦͷ··ೖྗ Ͱ͏·͍͘͘Α͏ͳख๏
==> PointNetΛఏҊ@CVPR2017
PointNetͷ͓͞Β͍ ▸ ղ͘λεΫ 7 Classification Segmentation Scene Parsing ೖྗ
PointNetͷ͓͞Β͍ ▸ ઃܭ 8
PointNetͷ͓͞Β͍ ▸ ՝ 9 PointNet֤ʹ͓͍ͯɺlocalͷใ͕ফ͑Δ ֊తಛֶशͰ͖ͳ͍ ෳ֊ͷநԽͰ͖ͳ͍ GlobalͷಛֶशͷΈ ͋Δ͘͠શͯͷ
PointNetͷ͓͞Β͍ ▸ localͷใ͕ফ͑Δͱ 10 globalͷใɺઈର࠲ඪʹґଘͯ͠͠·͏ͷͰɺ segmentationͰະͷͷʹରԠͰ͖ͳ͍
PointNet++Ͱ ▸ ֊తֶश ▸ localͳใΛ͢ 11 ▸ ܈ີʹϩόετʹ
ΞʔΩςΫνϟ 12
֊తͳֶश 13
֊తͳֶश ▸ Sampling layer ▸ Farthest Point Sampling (FPS) 14
https://www.groundai.com/project/parametric-manifold-learning-via-sparse-multidimensional-scaling/
▸ Grouping layer ▸ radius based ball query ֊తͳֶश 15
PointNet layer Convolution layer Input Δԋࢉ ԋࢉͰݟΔ ൣғ Radius ball query ɹ܈ɹ PointNetʢॱ൪ීวʣ ߦྻʢݻఆͷϐΫηϧʣ ΈࠐΈʢॱ൪ґଘʣ ɹີͳߦྻɹ
֊తͳֶश ▸ PointNet layer 16 N1ݸͷʹର͠ C1ݸͷಛ࡞ ॏΈshare
֊తͳֶश ▸ PointNet layer 17 x1,y1,z1,ΫΤϦ1,ಛ1 x2,y2,z2,ΫΤϦ2,ಛ2 x3,y3,z3,ΫΤϦ3,ಛ3 xN1,yN1,zN1,ΫΤϦN1ಛN1 MLP
MLP MLP MLP x1,y1,z1,ಛ1 x2,y2,z2,ಛ2 x3,y3,z3,ಛ3 xN1,yN1,zN1,ಛN1 ॏΈShare
ີґଘࠀख๏ ▸ ̏࣍ݩͷଌఆͰ܈ີ͕Ұൠతͳ՝ 18 ==> ܈ີʹϩόετʹ͍ͨ͠
ີґଘࠀख๏ ▸ SamplingͱGroupingΛෳ༻ҙ 19 MRGͷํ͕࣍ͰपลͱͷಛΛर͑Δ
Classification ࣮ݧ 20
▸ ModelNet40ʹରͯ͠ Classification ࣮ݧ 21 PointNetʹൺɺPointNet++ྨਫ਼্ CNNϕʔεͷख๏ʹউར
ີґଘ࣮ݧ 22 ಛʹ܈͕গͳ͍ͱɺMRG͕༗ޮ
Segmentation ࣮ݧ 23 ૠɿɹIDW (ٯڑՃॏ) Unitpointnet: ֤ͰMLP
Segmentation ࣮ݧ ▸ ݁Ռ 24 MSGΛೖΕΔ͜ͱͰɺෆۉҰͳ܈Ͱ͏·͍͘͘
Segmentation ࣮ݧ ▸ ݁Ռ 25 PointNetΑΓՈ۩ͷsegmentation্͕ख͍͘͘
ඇϢʔΫϦου ڑۭؒͰͷ࣮ݧ 26 WKS , HKS, multi-scale Gaussian curvature
Feature Visualization ▸ ࠷ॳͷͷॏΈΛՄࢹԽ 27 ฏ໘ɺίʔφʔͱ͔Λֶश
·ͱΊ ▸ PointNetΛ֦ுͨ͠ख๏PointNet++Λൃද ▸ CVPR2017=>NIPS2017ʹ̍ຊ௨͍ͯ͠Δɻɻɻ ▸ Sampling layerɺGrouped layerΛऔΓೖΕ֊తͳֶश ▸
MRGɺMSGΛఏҊ͠ɺ܈ີʹґଘ͠ͳֶ͍श ▸ ̏࣍ݩ܈ͷσʔληοτʹରͯ͠ɺSoTAୡ ▸ ݱʹߦͬͨײ ▸ ஶऀͱ͢͜ͱͰࡉ͔ͳใΛर͑Δ 28