Exploring Deepfakes

A very brief overview of deepfake technology and ethical issues surrounding the topic. Accompanying survey can be found here: https://bit.ly/2XqoKD8.

Transcript

1. Exploring Deepfakes Jill Cates GTA Linux Users Group Toronto, Ontario July 9th, 2019
2. Deepfake technology uses machine learning techniques to create realistic content (videos, audio clips, images) of events that never actually happened What is a “Deepfake”?
3. Recycling is good for the world. NO! YOU COULD NOT BE MORE WRONG!! Recycling is NOT good for the world. It is bad for the environment, it is bad for our health, and it is bad for our economy. I’m not kidding. Recycling is not good for the environment. It is destructive to the earth and it is a major contributor to global warming. Recycling is not good for our health. It contributes to obesity and diseases like heart disease and cancer. Recycling is bad for our economy. It increases the cost of a product, and in turn, the price of everything that is made with that product… SYSTEM PROMPT (HUMAN-WRITTEN) MODEL COMPLETION (MACHINE-WRITTEN, 25 TRIES) OpenAI’s GPT-2 Text Generator What is a “Deepfake”? Deepfake technology uses machine learning techniques to create realistic content (videos, audio clips, images) of events that never actually happened
4. How Does It Work? Autoencoders Compressed representation Original image Reconstructed image Encoder Decoder 1. Encoder: compresses the information of the input into a reduced dimensional space 2. Decoder: reconstructs the input dataset 3. Reconstructed loss: measures how well the decoder is performing Unsupervised learning algorithm
5. How Does It Work? Autoencoders From Afchar et al. MesoNet: a Compact Facial Video Forgery Detection Network, 2018
6. How Does It Work? Autoencoders A shared encoder forces Face A and Face B to be encoded on the same features From Afchar et al. MesoNet: a Compact Facial Video Forgery Detection Network, 2018
7. Good Uses Cheaper, less labour-intensive technique to generate digital replicas of Hollywood actors Digital creation of Carrie Fisher in Star Wars Rogue One Easy to make funny memes (e.g., do a google search of “Nicolas Cage deepfakes”) Nicolas Cage in Game of Throne Recreate voices of dead loved ones as a form of bereavement therapy Black Mirror episode “Be Right Back”
8. Malicious Uses Spread of misinformation in the media (“fake news”) A tool for blackmail (e.g., involuntary synthetic pornographic imagery) A political tool to influence voters in the presidential elections
9. Survey Results Should deepfakes be censored on social media? n=27 66.7% 33.3% https://bit.ly/2XqoKD8
10. OpenAI’s GPT2 text generator. Should it be kept hidden from the public? n=27 74% 26% Survey Results Survey Results https://bit.ly/2XqoKD8
11. Thank you! Jill Cates Data Scientist at BioSymetrics github: @topspinj cates.jill@gmail.com