Upgrade to Pro — share decks privately, control downloads, hide ads and more …

이 세상 모든 물체를 검출할 수 있는 AI 기술을 만들 수 있을까요?

kakao
December 09, 2022

이 세상 모든 물체를 검출할 수 있는 AI 기술을 만들 수 있을까요?

#Large-scale #ObjectDetection #MultiModal

딥러닝 기반 물체 검출 기술의 과거, 현재 기술을 소개하고 물체 검출 기술이 나아가야 할 방향, 그리고 카카오브레인에서 개발하고 있는 물체 검출 기술에 대한 내용을 공유합니다.

발표자 : peter.roh
카카오브레인 Large-Scale AI Studio의 Peter입니다. 딥러닝 기반 물체 검출 기술에 관심이 많고, large-scale AI 시대에는 기술이 어떻게 발전해야 하는지 고민하고 있습니다.

kakao

December 09, 2022
Tweet

More Decks by kakao

Other Decks in Programming

Transcript

  1. ޛ୓ Ѩ୹ ӝࣿ੄ җѢ അ੤ ӒܻҊ ޷ې $PQZSJHIU,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP ੉

    ࣁ࢚ ݽٚ ޛ୓ܳ Ѩ୹ೡ ࣻ ੓ח "* ӝࣿਸ ٜ݅ ࣻ ੓ਸөਃ ֢߽ࢳ QFUFSSPI ஠஠য়࠳ۨੋ JG LBLBP 
  2. %&53  j j TFMGBUUO FODPEFS FODPEFS j FODPEFS NPEVMF

    QPTFNCFE EFDPEFS TFMGBUUO DSPTTBUUO EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j  /$BSJPO FUBM &OEUP&OE0CKFDU%FUFDUJPOXJUI5SBOTGPSNFST &$$7s JOQVUJNBHF PVUQVU
  3. %&53  j j TFMGBUUO FODPEFS FODPEFS j FODPEFS NPEVMF

    QPTFNCFE EFDPEFS TFMGBUUO DSPTTBUUO EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j  /$BSJPO FUBM &OEUP&OE0CKFDU%FUFDUJPOXJUI5SBOTGPSNFST &$$7s JOQVUJNBHF PVUQVU RVBESBUJD DPNQMFYJUZ
  4. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU MJOFBS DPNQMFYJUZ %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO
  5. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU MJOFBS DPNQMFYJUZ %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO NVMUJTDBMFGFBUVSF
  6. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU MJOFBS DPNQMFYJUZ %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO NVMUJTDBMFGFBUVSF
  7. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU MJOFBS DPNQMFYJUZ %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO NVMUJTDBMFGFBUVSF
  8. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU MJOFBS DPNQMFYJUZ %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO NVMUJTDBMFGFBUVSF
  9. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO %PXFOFFEUPDPNQVUFUIFFOUJSFUPLFO JOUIFFODPEFSCMPDL
  10. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU %FGPSNBCMF%&53  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s EFGTFMGBUUO EFGDSPTTBUUO
  11. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU EFGTFMGBUUO EFGDSPTTBUUO 4QBSTF%&53  #3PI FUBM 4QBSTF%&53&GGJDJFOU&OEUP&OE0CKFDU%FUFDUJPOXJUI-FBSOBCMF4QBSTJUZ *$-3r ,BLBP#SBJO TFMFDUUPQǿUPLFOT
  12. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU EFGTFMGBUUO EFGDSPTTBUUO 4QBSTF%&53  #3PI FUBM 4QBSTF%&53&GGJDJFOU&OEUP&OE0CKFDU%FUFDUJPOXJUI-FBSOBCMF4QBSTJUZ *$-3r ,BLBP#SBJO TFMFDUUPQǿUPLFOT TFMFDUUPQL UPLFOT
  13. j j FODPEFS FODPEFS j FODPEFS NPEVMF QPTFNCFE EFDPEFS TFMGBUUO

    EFDPEFS j EFDPEFS NPEVMF MFBSOBCMFRVFSJFT CJQBSUJUFNBUDIJOH DMT SFHMPTT j JOQVUJNBHF PVUQVU EFGTFMGBUUO EFGDSPTTBUUO 4QBSTF%&53  #3PI FUBM 4QBSTF%&53&GGJDJFOU&OEUP&OE0CKFDU%FUFDUJPOXJUI-FBSOBCMF4QBSTJUZ *$-3r ,BLBP#SBJO TFMFDUUPQǿUPLFOT TFMFDUUPQL UPLFOT %&53 %FGPSN%&53 4QBSTF%&53  ('-01T ('-01T  ('-01T #BDLCPOF4XJO5
  14. 4QBSTF%&533FTVMUT 4XJO5 .FUIPE &QPDIT ǿ "1 "1 "1 QBSBNT '-01T

    '14 %&53      . (  %FGPSNBCMF%&53      . (  4QBSTF%&53      . (       . (       . (  *$-3r ,BLBP#SBJO <&WBMVBUJPOPG .4$0$0WBMJEBUJPOTFU>
  15. 4QBSTF%&533FTVMUT 4XJO5 .FUIPE &QPDIT ǿ "1 "1 "1 QBSBNT '-01T

    '14 %&53      . (  %FGPSNBCMF%&53      . (  4QBSTF%&53      . (       . (       . (  *$-3r ,BLBP#SBJO    <&WBMVBUJPOPG .4$0$0WBMJEBUJPOTFU>
  16. 4QBSTF%&533FTVMUT 4XJO5 .FUIPE &QPDIT ǿ "1 "1 "1 QBSBNT '-01T

    '14 %&53      . (  %FGPSNBCMF%&53      . (  4QBSTF%&53      . (       . (       . (  *$-3r ,BLBP#SBJO    <&WBMVBUJPOPG .4$0$0WBMJEBUJPOTFU>
  17. 4QBSTF%&533FTVMUT 3FT/FU .FUIPE &QPDIT ǿ "1 "1 "1 QBSBNT '-01T

    '14 %&53      . (  %FGPSNBCMF%&53      . (  4QBSTF%&53      . (       . (       . (  *$-3r ,BLBP#SBJO    <&WBMVBUJPOPG .4$0$0WBMJEBUJPOTFU>
  18. 4QBSTF%&533FTVMUT 3FT/FU .FUIPE &QPDIT ǿ "1 "1 "1 QBSBNT '-01T

    '14 %&53      . (  %FGPSNBCMF%&53      . (  4QBSTF%&53      . (       . (  4QBSTF%&53 4$3- JOJU      . (       . (  *$-3r ,BLBP#SBJO    #3PI FUBM 4QBUJBMMZ$POTJTUFOU3FQSFTFOUBUJPO-FBSOJOH $713s ,BLBP#SBJO <&WBMVBUJPOPG .4$0$0WBMJEBUJPOTFU>
  19. 0OMZBCMFUPEFUFDUQSFEFGJOFEDMBTT PCKFDUT     QFSTPO   

     SBDLFU     DBS     CBMM QFSTPO DBS SBDLFU CBMM -JNJUBUJPOPG$POWFOUJPOBM0CKFDU%FUFDUPS
  20. 0OMZBCMFUPEFUFDUQSFEFGJOFEDMBTT PCKFDUT     QFSTPO   

     SBDLFU     DBS     CBMM      SVCCFSEVDL -JNJUBUJPOPG$POWFOUJPOBM0CKFDU%FUFDUPS
  21. 0QFO7PDBCVMBSZ0CKFDU%FUFDUJPO     QFSTPO    

    SBDLFU $-*1 UFYU FODPEFS QFSTPO SBDLFU j
  22. 0QFO7PDBCVMBSZ0CKFDU%FUFDUJPO     QFSTPO    

    SBDLFU $-*1 UFYU FODPEFS QFSTPO SBDLFU         QFSTPO SBDLFU     XPNBO     NBO j
  23. 0QFO7PDBCVMBSZ0CKFDU%FUFDUJPO     QFSTPO    

    SBDLFU $-*1 UFYU FODPEFS QFSTPO SBDLFU         QFSTPO SBDLFU     XPNBO     NBO j UFYUFNCFEEJOHTQBDF
  24. "SDIJUFDUVSFPG0QFO7PDBCVMBSZ0CKFDU%FUFDUJPO #BDLCPOF &ODPEFS j ''/ 1SPK %FDPEFS EPH DBU QFSTPO

    SBDLFU "QIPUPPGB\DBUFHPSZ^ "OJNBHFPGB\DBUFHPSZ^ "TLFUDIPGB\DBUFHPSZ^ j $-*1 UFYU FODPEFS CJQBUJUF NBUDIJOH (5CCPY SFHMPTT (5DMBTT DMTMPTT
  25. 3FTVMUTPG6OSFTUSJDUFE0QFO7PDBCVMBSZ5SBJOJOH .FUIPE #BDLCPOF %BUBTFUT "1 "1S '-01T ( %FGPSNBCMF%&53 3FT/FU

    -7*4    08-7J5 7J5# 0 7(    7J5- 0 7(    0VST 4XJO# 0* 7( -7*4 3FG&YQ    4XJO# 0 0* 7( -7*4 3FG&YQ        ..JOEFSFS FUBM 4JNQMF0QFO7PDBCVMBSZ0CKFDU%FUFDUJPOXJUI7JTJPO5SBOTGPSNFST &$$7s <&WBMVBUJPOPG -7*4WBMJEBUJPOTFU>
  26. 3FGFSFODFT  /$BSJPO FUBM &OEUP&OE0CKFDU%FUFDUJPOXJUI5SBOTGPSNFST &$$7s  9;IVFUBM %FGPSNBCMF%&53%FGPSNBCMF5SBOTGPSNFSTGPS&OEUP&OE0CKFDU%FUFDUJPO *$-3s

     #3PI FUBM 4QBSTF%&53&GGJDJFOU&OEUP&OE0CKFDU%FUFDUJPOXJUI-FBSOBCMF4QBSTJUZ *$-3r  #3PI FUBM 4QBUJBMMZ$POTJTUFOU3FQSFTFOUBUJPO-FBSOJOH $713s  ..JOEFSFS FUBM 4JNQMF0QFO7PDBCVMBSZ0CKFDU%FUFDUJPOXJUI7JTJPO5SBOTGPSNFST &$$7s