Slide 1

Slide 1 text

ୈճશ೔ຊίϯϐϡʔλϏδϣϯษڧձ$713ಡΈձ ޙฤ  "4FMG4VQFSWJTFE%FTDSJQUPS GPS*NBHF$PQZ%FUFDUJPO 2022/08/21 Yamato OKAMOTO

Slide 2

Slide 2 text

Ԭຊେ࿨ʢ:BNBUP0,".050ʣ w ژେʢඒೱݚʣˠΦϜϩϯˠ-*/& w ݚڀ։ൃ͔Βࣄۀ૑଄·Ͱखֻ͚ͯ·ͨ͠ w $PNQVUFS7JTJPO-BCͷ্ཱͪ͛ਓͱͯ͠-*/&ʹస৬ w ͓͔͛͞·Ͱ$7-͸प೥Λܴ͑·ͨ͠ʙ🎉🎉🎉 w ಌΕΒΕΔݚڀڌ఺Λ࡞Δ΂͘ɺژ౎͔Βຖ೔ָ͘͠ฃಆͯ͠·͢ʂʂ

Slide 3

Slide 3 text

ຊ೔ͷτϐοΫ Image Copy Detection

Slide 4

Slide 4 text

ಥવͰ͕͢ɺ͜Μͳܦݧ͋Γ·ͤΜ͔ʁʁ 4/4ʹ౤ߘͨࣸ͠ਅ͕ແஅͰ࢖ΘΕ͍ͯͨʂʂ Αͬ͠Όɺࣸਅࡱͬͯ΋Ζͨ͠ɺ 4/4ʹ౤ߘͨ͠Ζͬʂ Μʜʁ͋ͷը૾ɺΘ͠ͷͪΌ͏͔ʂʁ ແஅͰ޿ࠂૉࡐͱͯ͠࢖ΘΕͯΔ΍Μʂʂ ˞ϑΟΫγϣϯͰ͢ >∩( ^ ω ^)∩< 📲 Σ ƅЧƅ|||) ઌண໊ʹ ͚ͩڭ͑·͢ ͍·͙͢ສԁՔ͙ํ๏ ͙͢ΫϦοΫ ޙ೔ ͜͜·Ͱώυ͍ྫͰ͸ͳ͘ͱ΋ɺࢲ͸෦׆ಈͰࡱӨͨ͠ϥάϏʔͷࢼ߹ࣸਅΛɺ νϥγͷഎܠը૾ͱͯ͠ແஅར༻͞Εͨܦݧ͕͋Γ·͢😱

Slide 5

Slide 5 text

.PUJWBUJPOɿίϐʔը૾Λݟ͚ͭग़͍ͨ͠ ແஅͷը૾ར༻͸͝๏౓ʹ΋͔͔ΘΒͣɺͦͷΑ͏ͳ໰୊͸ઈ͑ͳ͍ɻ ྫ͑͹ԼਤͷΑ͏ʹɺ৽ن౤ߘ͞Εͨը૾͕ίϐʔը૾ͳͷ͔Ͳ͏͔ϞχλϦϯά͢Δػೳ͕ٻΊΒΕΔɻ ৽ن౤ߘʢ2VFSZʣ DB ίϐʔݩͱࢥΘ͖͠ը૾͕ଘࡏ ݕࡧ DB ෆਖ਼ར༻͞Ε͔ͨ΋ ໰୊ͳ͍ͱ൑அ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html ৽ن౤ߘʢ2VFSZʣ )JUͳ͠ ݕࡧ

Slide 6

Slide 6 text

Ͳ͏΍ͬͯίϐʔը૾ݕग़Λ࣮ݱ͢Δ͔ʁʁ ίϐʔը૾ͱίϐʔݩը૾͔Β͸ɺྨࣅͨ͠ಛ௃ྔΛநग़Մೳͳ͸ͣʂʂ ΠέͯΔಛ௃ྔදݱΛֶश͢Ε͹ɺಛ௃ྔۭؒͰίϐʔݩͷը૾͕ۙ๣ͱͳΓݕग़Ͱ͖ΔʂʂʢԾઆʣ https://github.com/google-research/simclr https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html 45&1ɿΠέͯΔಛ௃ྔදݱΛֶश͢Δ 45&1ɿը૾Λಛ௃ྔۭؒʹࣹӨ͢Δ 45&1ɿۙ๣ʹσʔλ͕ଘࡏ͢Ε͹2VFSZΛίϐʔͩͱ൑ఆ͢Δ ྫ͑͹ɺ4JN$-3ͰେྔͷࣗݾڭࢣֶशΛ͢Δ DMPTF

Slide 7

Slide 7 text

݁ՌɿͦΕ͚ͩͰ͸μϝͰͨ͠ʢɾТɾʆʣ • ͳͥίϐʔը૾ͱݩը૾͕࠷ۙ๪ʹͳΒͳ͔͔ͬͨʁ - ॻ͖ࠐΈจࣈɺ഑৭ɺղ૾౓ͳͲͷཁૉ͕ྨࣅ͢Δ ଞͷը૾͕࠷ۙ๣ʹͳͬͯ͠·ͬͨ • *NBHF$PQZ%FUFDUJPOͷ೉͠͞ - Ճ޻͞Εͯ΋ݩը૾͕ಉ͡ͳΒಛ௃ྔ͕ྨࣅ͢ΔΑ ͏ʹ͍ͨ͠ - ͍͔ʹɺͦͷΑ͏ͳಛ௃ྔදݱΛֶश͢Δ͔ʁ ࣮ࡍʹ4JN$-3Ͱಛ௃ྔදݱΛֶशͯ͠ɺίαΠϯྨࣅ౓Ͱۙ๣ը૾Λநग़ͨ݁͠Ռ͕ӈԼɻ ը૾Ճ޻Ͱಛ௃ྔ͕एׯԕ͔ͬͨ͟෼ɺଞͷը૾͕࠷ۙ๣ʹͳͬͯ͠·ͬͨͱਪ࡯͞ΕΔɻ ͜ΕΛݕग़͔ͨͬͨ͠ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 8

Slide 8 text

ͦ͜Ͱɺ4JN$-3Λϕʔεʹ%FTDSJQUPSͷֶशख๏ΛఏҊʂʂ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 9

Slide 9 text

ิ଍ɿࠓ೔ͷൃදͰ͸%FTDSJQUPSΛGFBUVSFWFDUPSͷҰछͱͯ͠ղऍ͠·͢ɻ ʢwebliࣙॻΑΓҾ༻ʣ هड़ࢠʢಡΈํɿ͖͡Ύͭ͠ʣ ʲӳʳdescriptor هड़ࢠͱ͸ɺϓϩηε͕OSΛ௨ͯ͡ೖग़ྗૢ࡞Λ ߦ͏ࡍʹࢀর͞ΕΔɺϑΝΠϧͷߏ଄΍಺༰ͷཁ ໿ɺϑΝΠϧଐੑͳͲ͕ه͞Εͨ੔਺ͷ͜ͱͰ͋ ΔɻϓϩάϥϜͷߏ଄͕ه͞ΕΔ৔߹΋͋Δɻ ༗ࣝऀίϝϯτʢ˞ҹ৅ͷ࿩Ͱ͢ʣ ࿦จͷΞϒετ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 10

Slide 10 text

ิ଍ɿ4JN$-3ͱ͸ಛ௃ྔදݱΛ֫ಘ͢ΔͨΊͷରরֶशͷ̍ͭ https://github.com/google-research/simclr 4JN$-3Ͱ͸ɺಉ͡ը૾ʹҟͳΔม׵Λࢪͯ͠΋ྨࣅͨ͠ಛ௃ྔ͕நग़Ͱ͖ΔΑ͏ʹֶश͢Δɻ ͦΕͱಉ࣌ʹɺҟͳΔը૾͔Β͸ҟͳΔಛ௃ྔ͕நग़Ͱ͖ΔΑ͏ʹֶश͢Δɻ ͳ͓ɺม׵ʹ͸$301΍৭ม׵΍#MVS͕Α͘࢖ΘΕΔɻ ಉ͡ը૾͔Β͸ಉ͡ಛ௃ྔΛ֫ಘ͍ͨ͠ ҟͳΔը૾͔Β͸ҟͳΔಛ௃ྔΛ֫ಘ͍ͨ͠ 4JN$-3ͷଛࣦؔ਺͸*OGP/$& ɾT͸ίαΠϯྨࣅ౓ ɾ1͸1PTJUJWF1BSFͷू߹ QPTJUJWFQBSF OFHBUJWFQBSF

Slide 11

Slide 11 text

ఏҊख๏ͷશମ૾ "Self Supervised Copy Detection (SSCD) "

Slide 12

Slide 12 text

"Self Supervised Copy Detection (SSCD)"ͷશମ૾ 4JN$-3Λϕʔεʹෳ਺ͷվྑΛࢪͯ͠ɺ$PQZ%FUFDUJPOʹಛԽͨ͠ಛ௃ྔදݱΛֶशͨ͠ɻ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html &OUSPQZ-PTTΛ௥Ճͨ͠ 4JNJMBSJUZ/PSNBMJ[BUJPOΛ௥Ճͨ͠ "WFSBHF1PPMJOHͰ͸ͳ͘ (F.1PPMJOHΛ࠾༻ $//ޙͷ.-1Λઢܗม׵ʹஔ͖׵͑ͨ ന৭ԽΛಋೖ ը૾ม׵ͷύλʔϯΛ௥Ճͨ͠

Slide 13

Slide 13 text

޻෉͕ͯΜ͜੝ΓͳͷͰɺ ʮ͕͜͜ϙΠϯτͩʂʯͱࢥͬͨՕॴͷΈൈਮ͠·͢

Slide 14

Slide 14 text

&OUSPQZ-PTTʹΑΓෛྫΛԕ͚͟Δ੍໿ΛڧΊͨ &OUSPQZ-PTTʹΑͬͯɺ࠷΋ۙ͘ʹ͋ΔෛྫαϯϓϧΛԕ͚͟ΔΑ͏ʹֶशͤ͞Δɻ ͜ΕʹΑΓɺਖ਼ྫಉ࢜ͷڑ཭෼෍͸ͦͷ··ʹɺෛྫͱͷڑ཭෼෍Λԕ͚͟Δ͜ͱʹ੒ޭͨ͠ɻ ɾ[͸ಛ௃ྔ ɾ1͸ਖ਼ྫϖΞͷू߹ ੨͕ਖ਼ྫͱͷڑ཭෼෍ɺ੺͕ෛྫͱͷڑ཭෼෍ &OUSPQZ-PTTಋೖલʢ্ʣʹൺ΂ͯɺಋೖޙʢԼʣ͸ෛྫ͕ԕ͔͍ͬͯ͟Δ *OGP/$&ͱ߹Θͤͯ࢖༻͢Δͱɺ ͓ؾ࣋ͪతʹ͸USJQMFUMPTTʹ͍͔ۙ΋ʁ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 15

Slide 15 text

ิ଍ɿ&OUSPQZ-PTTͱλεΫͷ૬ੑ &OUSPQZ-PTTʹΑͬͯෛྫͱͷڑ཭෼෍Λԕ͚͟Δͱɺ$PQZ%FUFDUJPOͰ͸͝རӹ͕͋ͬͨɻ ͔͠͠ɺྫ͑͹$MBTTJGJDBUJPOͰ͸ٯޮՌͩͬͨͱใࠂ͞Ε͍ͯΔɻ ԣ࣠Е͸&OUSPQZ-PTTΛͲΕ͚ͩڧ͘͢Δ͔ɻ ੨͸*NBHF/FUͷ$MBTTJGJDBUJPOͷਫ਼౓ˠԼ͕͍ͬͯΔ ྘ͱԫ͸$PQZ%FUFDUJPOͷਫ਼౓ˠ্͕͍ͬͯΔ &OUSPQZ-PTT͸$PQZ%FUFDUJPOʹ͸༗ޮ͕ͩɺ $MBTTJGJDBUJPOʹ͸ٯޮՌͱͳͬͨɻ (FOFSBMͳಛ௃ྔΛ֫ಘͨ͠ͱ͍͏ΑΓɺ ಉҰੜ൑ఆʹಛԽͨ͠ͷ͔΋ʁ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 16

Slide 16 text

$//ޙͷ.-1Λઢܗม׵ʹஔ͖׵͑ͨ .-1Λઢܗม׵ʹஔ͖׵͑Δͱɺ ҟͳΔը૾ม׵Λͯ͠΋ݩը૾͕ಉ͡ͳΒ͹ɺ$//͕ಉ͡ಛ௃ྔΛநग़͠Α͏ͱͯ͘͠ΕΔɻ w .-1Ͱ͸USBOTGPSNBUJPODPWBSJBOUGFBUVSFͷ֫ಘ͕ظ଴͞ΕΔɻ w ͜ΕʹΑΓɺಉ͡ը૾ʹҟͳΔը૾ม׵Λͨ͠ͱ͖ɺԾʹ$//͕ҟͳΔಛ௃ྔΛந ग़ͯ͠΋ɺ.-1ͷ͓͔͛Ͱ࠷ऴతʹಉ͡Α͏ͳಛ௃ྔ͕நग़Ͱ͖Δɻ w ݴ͍׵͑Δͱɺ.-1͕Χόʔͯ͘͠ΕΔͷͰɺಉ͡ը૾ʹҟͳΔը૾ม׵Λͨ͠ͱ ͖ɺ$//͸ҟͳΔಛ௃ྔΛநग़͍ͯ͠ΔՄೳੑ͕͋Δɻ w ීஈͳΒͦΕͰ΋͍͍͕ɺࠓճͷλεΫͰ͸JOWBSJBOU͕๬·͍͠ɻ w ಉ͡ը૾ʹҟͳΔը૾ม׵Λͯ͠΋ಉ͡ಛ௃ྔΛநग़͍ͨ͠ɻ w ͦ͜ͰɺࠓճͷλεΫͰ͸.-1Λઢܗม׵ʹஔ͖׵͑Δɻ w ಉ͡ը૾ʹҟͳΔը૾ม׵Λͯ͠΋ɺಉ͡ಛ௃ྔΛநग़ͤ͞Δૂ͍ɻ w $//͸ը૾ม׵͕͞Εͯ΋ɺݩ͕ಉ͡ը૾ͳΒಉ͡ಛ௃ྔΛநग़͠ͳ͍ͱ͍͚ͳ͘ ͳΔɻʢ.-1͸$//Λ؁΍͔͔ͨ͠΋͠Εͳ͍͕ɺઢܗม׵͸༰ࣻͤΜŕʂʣ w ࠷ऴతʹར༻͢Δಛ௃ྔʹ͸ީิ͕͋ΓɺఏҊख๏44$%Ͱ͸ᶄΛར༻ͨ͠ɻ w ᶃ$//ग़ྗʢUSVOLGFBUVSFʣ w ᶄઢܗม׵ͨ͠΋ͷʢQSPKFDUJPOGFBUVSFʣ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 17

Slide 17 text

ิ଍ɿDPWBSJBOUͱJOWBSJBOU 5XJUFSͰरͬͨਤ͕Θ͔Γ΍͔ͬͨ͢ͷͰܝࡌ͓͖ͯ͠·͢ IUUQTUXJUUFSDPN"LJP5PNJZBTUBUVT TUI00);8,1HH4KD"$BC@Y2 https://twitter.com/AkioTomiya/status/1404844708099198982?s=20&t=hOOHZWK7Pg8gSjcACab_xQ

Slide 18

Slide 18 text

4DPSF4JNJMBSJUZ/PSNBMJ[BUJPOΛಋೖͨ͠ ಛ௃ྔۭؒʹࣹӨͨ͠ͱ͖ɺͲΕ͘Β͍ͷڑ཭ͳΒ͹ʮ͍ۙʯͱݴ͑Δͷ͔ʁ ͜ͷई౓͕σʔλʹґଘͤͣɺҰ؏ੑΛ࣋ͭΑ͏ʹਖ਼نԽͯ͠΍Δɻ w Ͳ͏΍ͬͯਖ਼نԽ͢Δͷ͔ʁʁ 
 ɹˠैདྷͷίαΠϯྨࣅ౓ʹόΠΞεΛ଍͢ w όΠΞε͸ۙ๣αϯϓϧͱͷڑ཭ฏۉʹΑͬͯࢉग़͢Δ w ࠓճ͸όΠΞεࢉग़ઐ༻ͷCBDLHSPVOEEBUBTFUΛ༻ҙͨ͠ʢόΠΞεࢉग़ʹSFGFSFODFը૾͸࢖Θͳ͍ʣ w R͸ΫΤϦʢྫ͑͹৽ن౤ߘ͞Εͨը૾ʣ w S͸ϦϑΝϨϯεʢྫ͑͹౤ߘࡁΈͷը૾ʣ w T͸ίαΠϯྨࣅ౓ w ࠷ۙ๪ͷOdOFOE൪໨·ͰͷαϯϓϧΛར༻ w ЌͰOPNBMJ[BUJPOͷ͔͔Γ۩߹Λௐ੔ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 19

Slide 19 text

ը૾ม׵ͷύλʔϯΛ௥Ճͨ͠ 4JN$-3Ͱѻ͍ͬͯͨύλʔϯʹɺ͞Βʹ4USPOH#MVSɺ3PUBUJPOͳͲͷύλʔϯΛ௥Ճͨ͠ɻ UFYUॲཧͷ௥Ճ͸ɺσʔληοτ%*4$ʹ ߹Θͤʹߦ͍ͬͯΔΑ͏ͳؾ΋͢Δ͕ɺɺɺ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 20

Slide 20 text

࣮ݧͱ݁Ռ

Slide 21

Slide 21 text

࣮ݧͷ֓ཁ σʔληοτɿ%*4$ w ֶश༻ʹສຕɺධՁ༻ʹສຕʢRVFSZʣʴສຕʢSFGFSFODFʣ w RVFSZը૾ͷ͏ͪສຕ͸SFGFSFODFը૾Λฤूͯ͠࡞੒ͨ͠DPQZͰ͋Δɻ λεΫ w SFGFSFODFը૾Λࢀরͯ͠ɺRVFSZը૾͕DPQZ͔൱͔Λ൑ఆ͢ΔλεΫɻ ධՁࢦඪɿNJDSPBWFSBHFQSFDJTJPO Ÿ"1  w αϯϓϧ୯ҐͰ"WFSBHF1SFDJTJPOͷฏۉΛࢉग़ͨ͠΋ͷɻ RVFSZ SFGFSFODF https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 22

Slide 22 text

࣮ݧ݁Ռɿ·ͣ͸4P5" https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 23

Slide 23 text

ߟ࡯ɿ&OUSPQZ-PTTͱ4DPSF/PSNBMJ[BUJPO͕ಛʹޮ͍͍ͯΔ༷ࢠ w4JN$-3͕ϕʔεϥΠϯ wUSVOL͸$//ͷग़ྗΛར༻ wQSPK͸ઢܗม׵ͨ͠΋ͷΛར༻ wϕʔεϥΠϯͱఏҊख๏ͷதؒతଘࡏͱͯ͠ 4JN$-3$%΋ධՁ w͜Ε͸ɺ&OUSPQZ-PTTҎ֎ͷఏҊख๏Λ 
 ద༻ͨ͠΋ͷʢ˞.-1ஔ͖׵͑΍(F.1PPMʣ w4JN$-3$%ˠ44$%΁ͷมԽɺ 
 ͭ·Γ&OUSPQZ-PTTಋೖ͚ͩͰ 
 Ж"1͕໿޲্ʢˠʣ wЖ"14/͸4DPSF/PNBSJ[BUJPOΛ 
 ಋೖͨ͠৔߹ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Slide 24

Slide 24 text

"CMBUJPOT (F.1PPMJOH΍4USPOH#MVSͳͲɺ͍ͣΕͷ޻෉΋ޮՌ͕͋ͬͨ͜ͱΛ֬ೝͰ͖͍ͯΔɻ ಛච͢΂͖͸ɺQSPKFDUJPOGFBUVSF͸&OUSPQZ-PTTͱηοτͰಛʹ༗ޮͱͳΔ఺ɻ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html DPWBSJBOUͱJOWBSJBOUͷٞ࿦Λ౿·͑Δͱɺ 4JN$-3ͰUSVOLͷํ͕ߴੑೳͳͷ͸Կނʁ🤔

Slide 25

Slide 25 text

·ͱΊ w RVFSZը૾͕༩͑ΒΕͨͱ͖ɺSFGFSFODFը૾Λࢀরͯ͠ίϐʔ͔൱͔൑ఆ͢Δ *NBHF$PQZ%FUFDUJPOʹ௅ઓ w 4JN$-3Λϕʔεʹɺ&OUSPQZ-PTTͱ͍ͬͨ޻෉Λಋೖͯ͠ੑೳվળͨ͠ ߟ࡯ w ఏҊख๏͸ޮՌత͕ͩͬͨʮͦΕ͸Կނʁʯͱ͍͏ղ໌͕΋ͬͱਐΉͱخ͍͠