Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Ideas for defeating Anti-Deep-Fakes
Search
Ren Kimura
November 14, 2024
Programming
0
28
Ideas for defeating Anti-Deep-Fakes
AVTOKYO@2024.11.14
Ren Kimura
November 14, 2024
Tweet
Share
More Decks by Ren Kimura
See All by Ren Kimura
セキュリティベンチャーのリスク管理
rkx1209
0
56
ファジング+トリアージ技術を用いた脆弱性解析自動化
rkx1209
0
57
Introduction to Fuzzing
rkx1209
6
4.2k
ARM TrustZone エクスプロイト入門
rkx1209
7
7.9k
The Game is Over. Nintendo switch has been totally compromised
rkx1209
9
5k
インサイドNintendo Switch
rkx1209
18
12k
More efficient remote debugging with Thin Hypervisor
rkx1209
3
2.5k
Reverse Debugging with radare2
rkx1209
6
1.9k
カーネルエクスプロイトによるシステム権限奪取
rkx1209
13
7.7k
Other Decks in Programming
See All in Programming
新宿駅構内を三人称視点で探索してみる
satoshi7190
2
110
PRレビューのお供にDanger
stoticdev
1
220
dbt Pythonモデルで実現するSnowflake活用術
trsnium
0
240
.NET Frameworkでも汎用ホストが使いたい!
tomokusaba
0
180
CDK開発におけるコーディング規約の運用
yamanashi_ren01
2
210
『品質』という言葉が嫌いな理由
korimu
0
180
color-scheme: light dark; を完全に理解する
uhyo
7
480
pylint custom ruleで始めるレビュー自動化
shogoujiie
0
140
昭和の職場からアジャイルの世界へ
kumagoro95
1
410
ソフトウェアエンジニアの成長
masuda220
PRO
12
2k
DRFを少しずつ オニオンアーキテクチャに寄せていく DjangoCongress JP 2025
nealle
2
210
パスキーのすべて ── 導入・UX設計・実装の紹介 / 20250213 パスキー開発者の集い
kuralab
3
860
Featured
See All Featured
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
100
18k
We Have a Design System, Now What?
morganepeng
51
7.4k
YesSQL, Process and Tooling at Scale
rocio
172
14k
Making Projects Easy
brettharned
116
6k
The Invisible Side of Design
smashingmag
299
50k
Designing on Purpose - Digital PM Summit 2013
jponch
117
7.1k
Visualization
eitanlees
146
15k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
46
2.3k
Embracing the Ebb and Flow
colly
84
4.6k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.4k
Building Applications with DynamoDB
mza
93
6.2k
Measuring & Analyzing Core Web Vitals
bluesmoon
6
250
Transcript
Ideas for defeating Anti-Deep-Fakes Ren Kimura (@RKX1209) AVTOKYO 2024.11.14 Prepare
for the next cyber threat
2 whoami Founder & CEO of Ricerca Security, Inc. Product
Manager (PdM) Ren Kimura (X: @RKX1209) Interested in : Bizdev and Vulnerability Research (VR)
Face Synthesis 3 What is the “Deep Fake” = Techniques
to generate fake media (video, image, voice…) Face manipulation techniques for generating fake videos/images. Face Swap Attribute Manipulation Expression Swap
Name cosine dist login Admin’s voice 0.0 N/A Text to
Speach 0.08 ✔ Another person’s voice 0.69 ☓ 4 DeepFake demo Login_With_Voice_Verification Voice Cloning
5 Any perfect verifier exists? Media data movie.mp4 image.jpg voice.wav
verifier “Real” “Fake”
6 Verification methods Detection Science & Tech Spotlight: Combating Deepfakes
(GAO-24-107292) Authentication • Bit patterns • Color abnormalities • Facial/Vocal inconsistencies “Recorded by camera.”
7 C2PA (Coalition for Content Provenance and Authenticity) original.jpg •
2024-09-04 21:00 • Created: Canon EOS R1 … C2PA meta data c2pa.actions hash function encrypt function encrypted hash Private key in EOS R1
8 edited.jpg C2PA meta data c2pa.actions c2pa.ingredients • original.jpg hash
function encrypt function encrypted hash Private key in Adobes account • 2024-09-10 12:54 • Edited: Adobe Photoshop • Actions: Crop, Frame… … Chain of metadata
9 Chain of trust original.jpg edited.jpg C2PA metadata “Recorded by
Canon EOS R1“ X.509 certificate chain “Edited by Adobe Photoshop“ parent Editor (adobe account)
10 C2PA signing by Generative AI services image.webp image.webp C2PA
metadata “Created by DALL-E“ X.509 certificate chain “Use original one as an ingredient“ parent
11 "Captured with a camera" (~2024.10.15) “I am really at
the zoo” https://www.youtube.com/watch?v=gfjgRHtDa38
12 Guessing from their official help page. original.mp4 “Recorded by
Canon EOS R1“ upload ・・・・ Whitelist “They are cameras” How does it work
13 ❌ Generative AI: “No camera” gen_by_sora.mp4 “Created by OpenAIs
SORA“ upload C2PA metadata X.509 certificate chain ・・・・ Whitelist “They are cameras” Not matched!
14 ✔"Captured with a camera" “Recorded by Canon EOS R1
“ “Edited by Adobe Premiere Pro“ ・・・・ Whitelist “They are cameras” upload Get original mp4 by social engineering, crawling…
15 Air gapping scenario edited.mp4 faked.mp4 C2PA metadata “Recorded by
Canon EOS R1 “ X.509 certificate chain Record over the air
16 ❌ “No camera” edited.mp4 faked.mp4 C2PA metadata “Recorded by
Sony α7 IV “ X.509 certificate chain SONY metadata “It may record 2D flattened area“ Record 3d-depth over the air
17 My approach:
18 Perfect verifier doesn’t exist Media data movie.mp4 image.jpg voice.wav
verifier “Real” “Fake”
19 What should Blue/White-team do? “A Guide to Preparing and
Responding to Deepfake Events” OWASP TOP10 LLM App&GenAI (2024.10)
20 What should Blue/White-team do? Financial gain through fraud by
impersonation. Impersonation for cyberattacks Job Interview Fraud Mis/Dis/Mal Information
21 Conclusion Detection and Authentication methods are not perfect Proposed
a new technique to bypass C2PA authentication Defense-in-depth and layered controls are required.
None