Upgrade to Pro — share decks privately, control downloads, hide ads and more …

[ECCV2020 論文読み会] MotionSqueeze: Neural Motion Feature Learning for Video Understanding

tomoyukun
December 12, 2020

[ECCV2020 論文読み会] MotionSqueeze: Neural Motion Feature Learning for Video Understanding

tomoyukun

December 12, 2020
Tweet

Other Decks in Science

Transcript

  1. 7JEFPSFDPHOJUJPOVOEFSTUBOEJOH ˙ ಈը͔Βಛఆͷ৘ใΛநग़͢Δ໰୊શൠ ˙ ൚༻తͳಈըೝࣝϞσϧͱͯ͠ͷධՁ͸5SJNNFEBDUJPOSFDPHOJUJPOʹ͓͍ ͯߦΘΕΔ͜ͱ͕ଟ͍ 4 "DUJPOSFDPHOJUJPO ಈըதʹؚ·ΕΔߦಈΫϥεͷ෼ྨ໰୊ "DUJPOMPDBMJ[BUJPO

    7JEFPDBQUJPOJOH 7JEFPTVNNBSJ[BUJPO ʜ ˙ 5SJNNFEɿ ಈըதʹ୯ҰͷಈըͷΈ ؚ·ΕΔ ˙ 6OUSJNNFEɿ ೖྗಈըதʹෳ਺ͷߦಈؚ͕ ·Ε͍ͯͨΓɺCBDLHSPVOE DMBTTؚ͕·ΕΔ <> <> <> <>
  2. 5XP4USFBN$// 4JNPOZBO /*14` <> 3(#ೖྗͷ%$//ͱ0QUJDBMqPXTೖྗͷ%$//ͷΞϯαϯϒϧ ˙ ೖྗ࣌఺Ͱݟ͑৘ใ BQQFBSBODF ͱಈ͖৘ใ NPUJPO

    ʹ໌ࣔతʹ෼ׂ ˙ )BOEDSBGUFEGFBUVSFΛ௒͑Δਫ਼౓Λୡ੒ 7 0QUJDBMqPXɿ ϑϨʔϜؒͷϐΫηϧͷҠಈϕΫτϧ ˙ ݩͷً౓஋ͱҠಈઌͷً౓஋͕Ұக͢Δͱ͍͏੍໿ͱ ਖ਼ଇԽ߲Λݩʹ࠷దԽ໰୊Λղ͘͜ͱͰಘΒΕΔ ˙ ܭࢉίετ͕େ͖͍ͷ͕೉఺
  3. %$// UFNQPSBMDPOW ը૾ೝࣝͰ੒ޭͨ͠%DPOWΛ࣌ؒํ޲ʹ֦ு 8 $% 5SBO *$$7` <> 4MPX'BTU 'FJDIUFOIPGFS

    *$$7` <> 54. -JO *$$7` <> % YZ DPOWΛ % YZU DPOWʹ֦ு %DPOWΛ% %DPOWͰ දݱ͠ɺύϥϝʔλΛޮ཰Խ ۭؒతղ૾౓ॏࢹͷ4MPXQBUIXBZͱ ࣌ؒతղ૾౓ॏࢹͷ'BTUQBUIXBZʹ෼ׂ ຊ࿦จͷϕʔεϥΠϯ ˙ %$//ͷҰ෦ͷಛ௃ϚοϓΛ࣌ؒํ޲ ʹγϑτ ˙ γϑτޙͷ%DPOW͕νϟωϧ਺ͷ গͳ͍%DPOWʹରԠ͓ͯ͠Γɺ ࿦จதͰ΋l1TFVEP%NPEFMzͱݺশ ˙ %$//ͱಉ౳ͷύϥϝʔλ਺Ͱޮ཰త ʹۭ࣌ؒಛ௃Λநग़ ΞʔΩςΫνϟ؍఺Ͱͷ ༷ʑͳվྑͷऔΓ૊Έ 3   % 5SBO $713` <>
  4. 5XP4USFBN%$// $BSSFJSB $713` <> 3(#ೖྗͷ%$//ͱ0QUJDBMqPXTೖྗͷ%$//ͷΞϯαϯϒϧ 10 5XPTUSFBN%$// ˙ %$//Λ࢖༻ͯ͠΋σʔληοτʹΑͬͯ͸'MPX3(# ˙

    3(# 'MPXͷΞϯαϯϒϧͰେ෯ʹਫ਼౓্͕͕Δ BDDVSBDZPOBDUJPOSFDPHOJUJPO 0QUJDBMqPX͕༗ޮͳΒ ྡ઀͢Δ3(#ϑϨʔϜը૾͔ΒܭࢉՄೳͳ ͷͰ FFʹ%$//Λֶश͢ΔதͰͦ͏͍ͬͨಛ௃Λ௫ΜͰཉ͍͠ %DPOWͷදݱೳྗ͸NPUJPOΛଊ͑Δͷʹෆे෼ͳͷͰ͸ʁ % %
  5. .PUJPO4RVFF[Fc$PSSFMBUJPODPNQVUBUJPO ˙ ྡ઀ϑϨʔϜͷ࠲ඪରͷ૬ؔ஋ͱͯ͠ ಛ௃Ϛοϓͷ஋ͷ಺ੵΛܭࢉ ˙ ஫໨࠲ඪ ͔ΒͷมҐ ͸ Λ த৺ͱͨ͠

    ͷۙ๣ύονͷൣғʹ੍ݶ ˙ ԋࢉ਺ '-01T ͸ x p x P × P H × W × C × P2 15 P × P ʜ ஫໨࠲ඪ ஫໨࠲ඪ͔Βͷมҟ ࣌ࠁ
  6. &YQFSJNFOUT ˙ %BUBTFUT w4PNFUIJOH4PNFUIJOH77ɿ  DMBTTFTXJUI WJEFPT  TFDPOET w,JOFUJDTɿ

     DMBTTFTXJUIPWFS WJEFPT  BSPVOETFDPOET ˙ %BUBQSPDFTT w5SBJO  SBOEPNDMJQTBNQMF SBOEPNDSPQͰݻఆ௕ͷDMJQΛநग़͠DMJQ୯ҐͰֶश w5FTU  TJOHMFDMJQQSFEJDUJPOɿ ڪΒ͘DFOUFS DMJQTBNQMF DFOUFSDSPQͰݻఆ௕ͷDMJQΛநग़͠ਪ࿦  BWFSBHFQSFEJDUJPOɿ ,JOFUJDTɿSBOEPNɺ44ɿVOJGPSN SBOEPNDMJQTTBNQMF DFOUFSDSPQ Ͱݻఆ௕ͷDMJQTΛநग़͠ɺͦΕΒͷਪ࿦஋ͷฏۉΛWJEFP୯Ґͷਪ࿦ͱ͢Δ 20 IUUQTXXXTMJEFTIBSFOFUYBWJHJSPEFFQMFBSOJOHGPS WJEFPBDUJPOSFDPHOJUJPOVQD GSPN@BDUJPOTBWF ,JOFUJDT<> 4PNFUIJOH4PNFUIJOH<> IUUQTCODPNEBUBTFUTTPNFUIJOHTPNFUIJOH
  7. ·ͱΊ FOEUPFOEʹֶशՄೳͳNPUJPOநग़ϞδϡʔϧͷఏҊ ˙ ߦಈೝࣝʹ͓͚Δਫ਼౓ͱܭࢉίετͷτϨʔυΦϑΛେ͖͘վળ ˙ நग़͞ΕΔಛ௃͸ϐΫηϧͷҠಈʹରԠ͓ͯ͠Γɺ௚઀తͳڭࢣΛඞཁͱͤͣʹ NPUJPOΛநग़Ͱ͖͍ͯΔ͜ͱΛ֬ೝ ݸਓతײ૝ɿ ˙ ࣗવಈըͷಛੑ΍աڈͷݚڀͷྲྀΕ͔Βग़ͯ͘Δ՝୊ײʹج͍ͮͨఏҊख๏Ͱ

    ೲಘײ͕͋ͬͨ ˙ ͍͔ʹNPUJPOΛநग़͠΍͍͢ܭࢉߏ଄ʹͰ͖Δ͔ͱ͍͏ҙຯͰ͸ɺPQUJDBM qPXਪఆʹ͓͍ͯ༗ޮͳΞʔΩςΫνϟͱ྆ྠͰࠓޙͷվળ͕ظ଴Ͱ͖ͦ͏ ˙ 7JEFPVOEFSTUBOEJOH͕͍ͩͿl"DUJPOSFDPHOJUJPOzʹಛԽ͖ͯͯ͠Δײ͡ ͕͋ΔɻଞͷυϝΠϯ΍λεΫͰ΋༗ޮͳϞσϧ͸มΘΒͳ͍ͩΖ͏͔ʁ 28
  8. 3FGFSFODFT <>,4PPNSP FUBM l6$'"EBUBTFUPGIVNBOBDUJPOTDMBTTFTGSPNWJEFPTJOUIFXJME zJO$P33 <>$(V FUBM z"7""WJEFPEBUBTFUPGTQBUJPUFNQPSBMMZMPDBMJ[FEBUPNJDWJTVBMBDUJPOT zJO$713 <>.(ZHMJ

    FUBM l$SFBUJOHTVNNBSJFTGSPNVTFSWJEFPT zJO&$$7 <>3,SJTIOB FUBM l%FOTF$BQUJPOJOH&WFOUTJO7JEFPT JO*$$7 <>%5SBO FUBM l-FBSOJOHTQBUJPUFNQPSBMGFBUVSFTXJUIEDPOWPMVUJPOBMOFUXPSLT zJO*$$7 <>,4JNPOZBO FUBM l5XPTUSFBNDPOWPMVUJPOBMOFUXPSLTGPSBDUJPOSFDPHOJUJPOJOWJEFPT zJO/*14 <>%5SBO FUBM l"DMPTFSMPPLBUTQBUJPUFNQPSBMDPOWPMVUJPOTGPSBDUJPOSFDPHOJUJPO zJO*$$7 <>$'FJDIUFOIPGFS FUBM l4MPX'BTU/FUXPSLTGPS7JEFP3FDPHOJUJPO zJO*$$7 <>+-JO FUBM l54.5FNQPSBM4IJGU.PEVMFGPS&⒏DJFOU7JEFP6OEFSTUBOEJOH zJO*$$7 <>+$BSSFJSB FUBM l2VPWBEJT BDUJPOSFDPHOJUJPO BOFXNPEFMBOEUIFLJOFUJDTEBUBTFU zJO*$$7 <>+:VF)FJ/H FUBM l"DUJPOqPXOFU-FBSOJOHNPUJPOSFQSFTFOUBUJPOGPSBDUJPOSFDPHOJUJPO zJO8"$7 <>/$SBTUP FUBM l."34.PUJPO"VHNFOUFE3(#4USFBNGPS"DUJPO3FDPHOJUJPO zJO$713 <>"1JFSHJPWBOOJ FUBM l3FQSFTFOUBUJPOqPXGPSBDUJPOSFDPHOJUJPO zJO$713 <>8,BZ FUBM l5IFLJOFUJDTIVNBOBDUJPOWJEFPEBUBTFU zJOBS9JWQSFQSJOU <>3(PZBM FUBM l5IFTPNFUIJOHTPNFUIJOHWJEFPEBUBCBTFGPSMFBSOJOHBOEFWBMVBUJOHWJTVBMDPNNPOTFOTF zJO*$$7 29