Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Watch Ricoh THETA and Applications of 360 Imaging

hirochika-f
September 29, 2022

Watch Ricoh THETA and Applications of 360 Imaging

@CVPR2020 OmniCV Workshop
Invited Talk
https://sites.google.com/view/omnicv-cvpr2020/home

hirochika-f

September 29, 2022
Tweet

More Decks by hirochika-f

Other Decks in Research

Transcript

  1. 8BUDI3JDPI5)&5"BOE "QQMJDBUJPOTPG*NBHJOH 3*$0)$0.1"/: -5% )JSPDIJLB 'VKJLJ

  2.  • ͔͑͞͠ ˜+"9"3*$0) 5)&5"PO*44

  3. )JTUPSZPGDBNFSBT Nayar, Shree K. "Catadioptric omnidirectional camera." Proceedings of IEEE

    computer society conference on computer vision and pattern recognition. IEEE, 1997. http://www.cs.columbia.edu/CAVE/projects/cat_cam_360/ Swaminathan, Rahul, and Shree K. Nayar. Polycameras: Camera clusters for wide angle imaging. No. CUCS-013-99. COLUMBIA UNIV NEW YORK DEPT OF COMPUTER SCIENCE, 2005. 
  4. 

  5. 3*$0)5)&5" • 4JNQMFEFTJHOGPSTIPPUJOHUIFFOUJSF XPSMEJOPOFTIPU • 5IFXPSME`TGJSTUDPOTVNFSDBNFSB 

  6. )JTUPSZPG5)&5"      5)&5" 5)&5" N 5)&5"4

    5)&5"4$ 5)&5"7 LTUJMM LTUJMM LWJEFP !GQT LTUJMM LWJEFP !GQT LTUJMM LWJEFP !GQT LTUJMM LWJEFP !GQT LMJWF TUSFBNJOH 4QBDJBM BVEJP "OESPJE04   5)&5"; 5)&5" 4$ LTUJMM LWJEFP !GQT LMJWF TUSFBNJOH 4QBDJBM BVEJP "OESPJE04 LTUJMM LWJEFP !GQT 
  7. 4QSFBEPGJNBHF • $POTVNFS • 'BDFCPPL :PV5VCF BOEPUIFS4/4T TVQQPSUJNBHF • #VTJOFTT

    • 3FBMFTUBUF • $POTUSVDUJPO • "DBEFNJD • $PNQVUFSWJTJPO • 3PCPUJDT 
  8. $POTVNFS 

  9. 3FBMFTUBUFNBSLFU 'MPPSQMBO 4VCUJUMFT "OOPUBUJPO -PDBUJPO 7JFX"OHMF /BWJHBUJPO BSSPX • 7JSUVBMUPVS

    • 6TFSTDBOSFNPUFMZJOUFSBDU XJUIQSPQFSUJFTJOXBZTOPU QPTTJCMFXJUIDPOWFOUJPOBM QIPUPHSBQIZ • "QSPQFSUZNBOBHFSDBO PWFSMBZUIFWJSUVBMUPVSXJUI TVQQMFNFOUBMJOGPSNBUJPO 
  10. $POTUSVDUJPO • JNBHFTBMMPXFOHJOFFSTBOENBOBHFSTUPCFUUFS NBOBHFDPOTUSVDUJPOQSPKFDUT • 8FDBOWJTVBMMZJOTQFDUFEDPVOUMFTTEFUBJMT 

  11. "DBEFNJB Zou, Chuhang, et al. "Layoutnet: Reconstructing the 3d room

    layout from a single rgb image." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018. Wang, Ning-Hsu, et al. "360SD-Net: 360› Stereo Depth Estimation with Learnable Cost Volume.” arXiv preprint arXiv:1911.04460 (2019). 
  12. "DBEFNJB Guerrero-Viu, Julia, et al. "What's in my Room? Object

    Recognition on Indoor Panoramic Images." arXiv preprint arXiv:1910.06138 (2019). Zhang, Chao, et al. "Orientation- aware semantic segmentation on icosahedron spheres.” Proceedings of the IEEE International Conference on Computer Vision. 2019. Eder, Marc, et al. "Tangent Images for Mitigating Spherical Distortion." arXiv preprint arXiv:1912.09390 (2019). 
  13. %BUBTFU Armeni, Iro, et al. "Joint 2d-3d-semantic data for indoor

    scene understanding." arXiv preprint arXiv:1702.01105 (2017). Chang, Angel, et al. "Matterport3d: Learning from rgb-d data in indoor environments." arXiv preprint arXiv:1709.06158 (2017). Xiao, Jianxiong, et al. "Recognizing scene viewpoint using panoramic place representation." 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2012. 
  14. 0VSQSPEVDUT UFDIOPMPHJFT

  15. 0VSWJTJPO • $BQUVSFXPSMEJOTUFBEPGlTDFOFz • 5IJTDPODFQUJTWFSZJNQPSUBOUGPSVTBOEESJWFTPVS EFWFMPQNFOUPGDBNFSBT 

  16. IUUQTXXXSJDPIUPVSTDPN 

  17. 3FBMXPSMEJNBHFEBUBTFU • 8FIBWFBDDFTTUP NJMMJPOTPGJNBHFT • 8FUSBJOEFFQMFBSOJOH NPEFMTPOUIJTEBUB • UPTPMWFSFBMXPSME QSPCMFNT

    • UPCSJOHNPSFWBMVFTUP DVTUPNFST  3*$0)5PVST
  18. 'FBUVSFTPG3*$0)5PVST  7JSUVBM5PVS "VUPDSPQQJOH *NBHFFOIBODFNFOU

  19. "VUPDSPQQJOH • $SFBUJOHTUJMMJNBHFTGPSQSPQFSUZBEWFSUJTJOHGSPNBTJOHMF QIPUP • $PNCJOBUJPOPGMBZPVUFTUJNBUJPO TBMJFODZEFUFDUJPO BOE PCKFDUEFUFDUJPO 

  20. 3FRVJSFNFOUTPGBEWFSUJTFNFOUT • *EFGJOFEUXPSFRVJSFNFOUTGPSDSPQQFEJNBHFTCBTFEPO NFUIPEPMPHZGPSQSPQFSUZQIPUPHSBQIZ   "DSPQQFEJNBHFIBTHPPE DPNQPTJUJPO CZVTJOHMBZPVUFTUJNBUJPO 

    "DSPQQFEJNBHFDPOUBJOTJNQPSUBOU QSPQFSUZFMFNFOUT CZVTJOHTBMJFODZEFUFDUJPOBOEPCKFDU EFUFDUJPO
  21. (PPEDPNQPTJUJPO • 5IFJNBHFTIPVMEDPOUBJOBNJYUVSFPGXBMMT DFJMJOH BOE GMPPS 8BMM 8BMM 'MPPS $FJMJOH

    8BMM 8BMM 'MPPS $FJMJOH 8BMM 
  22. $PNQPTJUJPOGSPNMBZPVU 8BMM 8BMM 'MPPS $FJMJOH 3FTVMUPGMBZPVUFTUJNBUJPO 

  23. $PNQPTJUJPOGSPNMBZPVU 8BMM 8BMM 'MPPS $FJMJOH 8BMM 3FTVMUPGMBZPVUFTUJNBUJPO 

  24. 5BLFJNQPSUBOUUIJOHT 4BMJFODZEFUFDUJPO 0CKFDUEFUFDUJPO 

  25. *NBHFFOIBODFNFOU • &OIBODJOHBJNBHF • *UXPSLTBTTVQFSSFTPMVUJPO EFOPJTJOH BOESFNPWJOHDPMPS BCCSFWJBUJPO  $SPQQFEGSPNBJNBHF

  26. %BUBTFUBOEOFUXPSL • 1BOP)JEBUBTFUGPS QBOPSBNJDJNBHF FOIBODFNFOU • JNBHFTBOOPUBUFEXJUI %4-3JNBHFT • $PNQBDUOFUXPSL

    BSDIJUFDUVSF XIJDIJTCBTFE PO&43("/XJUITFWFSBM NPEJGJDBUJPOT  "QBSUPG BFRVJSFDUBOHVMBSJNBHF "14$DBNFSB JNBHF
  27. 'VUVSFSFTFBSDIUPQJDT • 4QBUJBMDPNQVUJOHXJUIJNBHFT • %FOTFEFQUIFTUJNBUJPOGSPNBTJOHMFJNBHF • %SFDPOTUSVDUJPOGSPNNVMUJQMFJNBHFT • -PDBMJ[BUJPOVTJOHJNBHFT •

    (B[FHVJEBODFGPS93