YOLACT real-time instance segmentation

CV勉強会@関東発表資料
YOLACT real-time instance segmentation, ICCV2019

Transcript

1. :0-"$5
   3FBMUJNF*OTUBODF4FHNFOUBUJPO
   "VUIPS%#PMZB $;IPV '9JBP :+-FF
   QSFTFOUFS!QFJTVLF
   痥㔐 ؝ٝؾُ٦ةؽآّٝ⹈䓼⠓ꟼ匌 涪邌项俱
   

   View Slide

2. 荈䊹稱➜
   せ⵸谏劤 価➜
   䨽㾩"#&+"
   灇瑔؝ٝؾُ٦ةؽآّٝծٗنحز
   崞⹛
   5XJUUFS!QFJTVLF
   (JUIVC IUUQTHJUIVCDPNQFJTVLF
   2JJUB IUUQTRJJUBDPNQFJTVLF
   4MJEF4IBSF IUUQTXXXTMJEFTIBSFOFU'VKJNPUP,FJTVLF
   

   View Slide

3. 嚊銲
   • ة؎زٕ
   • :0-"$53FBMUJNF*OTUBODF4FHNFOUBUJPO
   • ו׿ז锷俑
   • POFTUBHFדך넝鸞זJOTUBODFTFHNFOUBUJPO׾㹋植
   • 䊨㣗挿כ
   • 䖞勻ךPOFTUBHFדך暟⡤嗚⳿ٌآُ٦ٕח⸇ִծJOTUBODFNBTL׾鎘皾ׅ׷
   ׋׭ծ⚥꟦邌植ד֮׷QSPUPUZQFNBTL׾䱿㹀ׅ׷ٌآُ٦ٕ׾䲿周
   • L⦐ךQSPUPUZQFNBTLך简䕎ㄤדJOTUBODFך걄㚖׾䱿㹀
   

   View Slide

4. *OTUBODFTFHNFOUBUJPOהכ
   • ؾؙإٕ׀החؙٓأ׾䱿㹀ׅ׷הה׮חծずؙׄٓأⰻדך
   *OTUBODFぐ⦐⡤׾䱿㹀ׅ׷ةأؙ
   

   View Slide

5. 䖞勻ך*OTUBODFTFHNFOUBUJPO
   • .BTL3$//
   • 暟⡤ך瀂䕎׾嗚⳿׃ծ瀂䕎ⰻך暟⡤걄㚖׾䱿锷ׅ׷媮ꥡך䩛岀
   • ぐ瀂䕎ח㼎׃ג3P*"MJHO⿹ן䖓媮ךⳢ椚׾遤ֲ׋׭鹼ְ
   

   View Slide

6. 媮ꥡⳢ椚חׅ׷ꥷך铬겗
   • 暟⡤嗚⳿ה4FNBOUJDTFHNFOUBUJPO׾ֻ׏➰ֽ׸ל葺ְ
   㞮歲כⴓַ׵זְ
   • *%䞔㜠׾⢪ְծⴽך暟⡤ה׃ג侄ִ׸ל葺ְ
   *%ך寸㹀倯岀ח♧䠐䚍ָ
   搀ְךד㷕统דֹזְ
   

   View Slide

7. 㛇劤،؎ر،
   • QSPUPUZQFNBTLהְֲ嚊䙀׾㼪Ⰵ
   • *OTUBODFNBTL׾圓䧭ׅ׷׋׭ך鳤剅הז׷وأؙ
   • ⟣䠐ך暟⡤ךوأؙ׾QSPUPUZQFNBTLך穈׫さ׻ׇדⱄ植דֹ׷״ֲח㷕统
   QSPUPUZQFNBTL
   QSPUPUZQFNBTLך简䕎ㄤ $SPQ
   

   View Slide

8. *OTUBODFNBTLךⰧ⡤涸ז鎘皾倯岀
   • 歗⫷ַ׵QSPUPUZQFNBTL׾鎘皾
   • 暟⡤嗚⳿ד䖤׵׸׋CPVOEJOHCPY嫣חծCPYⰻך*OTUBODF걄㚖׾実׭
   ׷׋׭חוךQSPUPUZQFNBTL׾⢪ִל葺ְַ׾䱿锷
   

   View Slide

9. طحزٙ٦ؙ圓䧭
   • 暟⡤嗚⳿ה1SPUPUZQF׾鎘皾ׅ׷طحزٙ٦ؙ׾䭯׍ծֿ׸׵ַ׵و
   أؙ׾鎘皾ׅ׷
   

   View Slide

10. طحزٙ٦ؙ圓䧭
    • 暟⡤嗚⳿ה1SPUPUZQF׾鎘皾ׅ׷طحزٙ٦ؙ׾䭯׍ծֿ׸׵ַ׵و
    أؙ׾鎘皾ׅ׷
    

    View Slide

11. 1SPUPOFU
    • 歗⫷ַ׵䬄⳿׃׋暴䗙ꆀ׾Ⰵ⸂ה׃גծL嫣ךQSPUPUZQFNBTL׾⳿⸂
    • 1SPUPOFU荈⡤חכٗأכ♷ִ׆JNQMJDJUח㷕统ׁ׸׷
    • CPVOEJOHCPY嫣ךJOTUBODFNBTL׾圓䧭דֹ׷״ֲז⡦׵ַךوأؙ
    ׾荈⹛涸ח㷕统
    • 瑞꟦涸ז⡘縧٥㣐ֹׁ׌׏׋׶ծ⵸兝٥胜兝ד֮׏׋׶ծوأؙ嫣ח⡦׵ַך
    䕵ⶴ׾䬐ֲ
    

    View Slide

12. طحزٙ٦ؙ圓䧭
    • 暟⡤嗚⳿ה1SPUPUZQF׾鎘皾ׅ׷طحزٙ٦ؙ׾䭯׍ծֿ׸׵ַ׵و
    أؙ׾鎘皾ׅ׷
    

    View Slide

13. 1SFEJDUJPOIFBE
    • 鸐䌢ך暟⡤嗚⳿ח⸇ִծ
    QSPUPUZQFNBTLך⤘侧׾⳿⸂
    • ؙٓأ侧 D如⯋
    • 瀂䕎ך䏟垥 如⯋
    • QSPUZQFNBTLL如⯋
    

    View Slide

14. -PTTך鏣鎘
    • 暟⡤嗚⳿ךٗأぐCPVOEJOHCPYךؙٓأה瀂䕎䏟垥ח⸇ִծ穠
    さ䖓ךوأؙחꟼׅ׷#JOBSZ$SPTT&OUSPQZ׾鎘皾
    *OQVU (5
    #PVOEJOHCPY-PTT
    #$&-PTT
    1SPUPUZQF
    NBTLT
    *OTUBODF
    NBTL
    

    View Slide

15. 'BTU/.4
    • (16ד⚛⴨鎘皾דֹ׷'BTU/.4׾䲿周
    • 䩛갫
    • $POGJEFODFדا٦ز׃גֶֻ
    • Ⰻ瀂䕎꟦ך*P6׾鎘皾׃ג♳♲錬遤⴨ח䯏Ⰵ
    • ꠬⦼U⟃♳ַאծ簚倯ぢחאְגךNBY׾《׷
    *P6
    *P6
    *P6
    *P6
    *P6
    *P6
    *P6
    *P6
    *P6
    *P6
    
    
    
    ֿך㜥さծ׾ח窟さծ׾ח窟さׅ׷
    

    View Slide

16. ׉ך➭
    • #BDLCPOF/FUXPSL
    • 3FT/FU⿹ן'1/׾ⵃ欽
    • 4FNBOUJDTFHNFOUBUJPOךٗأ׾鷄⸇
    

    View Slide

17. 㷕统ׁ׸׷1SPUPUZQFך⫘ぢחאְג
    • QSPUPUZQF嫣ח⿾䘔ׅ׷걄㚖ָ殯ז׷
    • 䊩♳ךوأؙכ歗꬗䊩⩎
    • 䊩♴ךوأؙכ歗꬗䊩♴
    • ⚥㣛♴כ歗꬗♴⩎
    • 〸♳כ胜兝ծ〸♴כ㖑꬗ח⿾䘔
    

    View Slide

18. 㹋꿀*OTUBODFTFHNFOUBUJPOSFTVMUT
    • 䖞勻䩛岀ח嫰ץגַז׶넝鸞
    • 䖞勻GQTח㼎׃גծGQTקוך鸞䏝
    • 礵䏝כ⡚♴
    • 䖞勻כN"1ָ⡘׌׏׋ךח㼎׃ג⵸䖓ח⡚♴
    

    View Slide

19. 㹋꿀.BTL2VBMJUZ
    • وأؙך礵䏝כⰋ⡤涸חぢ♳׃גְ׷
    • 傀㶷䩛岀כ㣐ֹז㼎韋ח㼎׃גծ1PPMJOH׾׃ג鍑⫷䏝׾衅הֿׅה
    ח饯㔓׃ծوأָؙ虠ְ
    

    View Slide

20. 㹋꿀'BJMVSF$BTFT
    • -PDBMJ[BUJPO'BJMVSF
    • ♧皘䨽ח㢳ֻך暟⡤ָ꧊ת׏גְ׷؛٦أדכ♳䩛ְַֻזְ
    • QSPUPUZQFNBTLך邌植⸂ָ駈׶זְַ׵
    • -FBLBHF
    • 䱿锷׃׋瀂䕎ָ♶姻然ך㜥さծ➭ך*OTUBODFNBTLך穠卓ָⰅ׶鴥׬
    

    View Slide

21. תה׭
    • 0OFTUBHFדך*OTUBODFTFHNFOUBUJPOך䲿周
    • QSPUPUZQFNBTL׾ⵃ欽ׅ׷ֿהדծ*OTUBODFNBTLך䱿锷ָ〳腉
    • 䖞勻ך䩛岀ח㼎׃גծ⦓玎ך넝鸞⻉׾㹋植
    

    View Slide