Ideas for defeating Anti-Deep-Fakes

AVTOKYO@2024.11.14

Transcript

1. Ideas for defeating Anti-Deep-Fakes Ren Kimura (@RKX1209) AVTOKYO 2024.11.14 Prepare for the next cyber threat
2. 2 whoami Founder & CEO of Ricerca Security, Inc. Product Manager (PdM) Ren Kimura (X: @RKX1209) Interested in : Bizdev and Vulnerability Research (VR)
3. Face Synthesis 3 What is the “Deep Fake” = Techniques to generate fake media (video, image, voice…) Face manipulation techniques for generating fake videos/images. Face Swap Attribute Manipulation Expression Swap
4. Name cosine dist login Admin’s voice 0.0 N/A Text to Speach 0.08 ✔ Another person’s voice 0.69 ☓ 4 DeepFake demo Login_With_Voice_Verification Voice Cloning
5. 5 Any perfect verifier exists? Media data movie.mp4 image.jpg voice.wav verifier “Real” “Fake”
6. 6 Verification methods Detection Science & Tech Spotlight: Combating Deepfakes (GAO-24-107292) Authentication • Bit patterns • Color abnormalities • Facial/Vocal inconsistencies “Recorded by camera.”
7. 7 C2PA (Coalition for Content Provenance and Authenticity) original.jpg • 2024-09-04 21:00 • Created: Canon EOS R1 … C2PA meta data c2pa.actions hash function encrypt function encrypted hash Private key in EOS R1
8. 8 edited.jpg C2PA meta data c2pa.actions c2pa.ingredients • original.jpg hash function encrypt function encrypted hash Private key in Adobes account • 2024-09-10 12:54 • Edited: Adobe Photoshop • Actions: Crop, Frame… … Chain of metadata
9. 9 Chain of trust original.jpg edited.jpg C2PA metadata “Recorded by Canon EOS R1“ X.509 certificate chain “Edited by Adobe Photoshop“ parent Editor (adobe account)
10. 10 C2PA signing by Generative AI services image.webp image.webp C2PA metadata “Created by DALL-E“ X.509 certificate chain “Use original one as an ingredient“ parent
11. 11 "Captured with a camera" (~2024.10.15) “I am really at the zoo” https://www.youtube.com/watch?v=gfjgRHtDa38
12. 12 Guessing from their official help page. original.mp4 “Recorded by Canon EOS R1“ upload ・・・・ Whitelist “They are cameras” How does it work
13. 13 ❌ Generative AI: “No camera” gen_by_sora.mp4 “Created by OpenAIs SORA“ upload C2PA metadata X.509 certificate chain ・・・・ Whitelist “They are cameras” Not matched!
14. 14 ✔"Captured with a camera" “Recorded by Canon EOS R1 “ “Edited by Adobe Premiere Pro“ ・・・・ Whitelist “They are cameras” upload Get original mp4 by social engineering, crawling…
15. 15 Air gapping scenario edited.mp4 faked.mp4 C2PA metadata “Recorded by Canon EOS R1 “ X.509 certificate chain Record over the air
16. 16 ❌ “No camera” edited.mp4 faked.mp4 C2PA metadata “Recorded by Sony α7 IV “ X.509 certificate chain SONY metadata “It may record 2D flattened area“ Record 3d-depth over the air
17. 17 My approach:
18. 18 Perfect verifier doesn’t exist Media data movie.mp4 image.jpg voice.wav verifier “Real” “Fake”
19. 19 What should Blue/White-team do? “A Guide to Preparing and Responding to Deepfake Events” OWASP TOP10 LLM App&GenAI (2024.10)
20. 20 What should Blue/White-team do? Financial gain through fraud by impersonation. Impersonation for cyberattacks Job Interview Fraud Mis/Dis/Mal Information
21. 21 Conclusion Detection and Authentication methods are not perfect Proposed a new technique to bypass C2PA authentication Defense-in-depth and layered controls are required.