Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creativity in the Age of Synthetic Realities

Creativity in the Age of Synthetic Realities

Revised version of my Synthetic Realities talk presented at Emerce eDay: https://emerceeday.nl/session/creativity-in-the-age-of-synthetic-realities/

Andy Polaine

October 10, 2019
Tweet

More Decks by Andy Polaine

Other Decks in Technology

Transcript

  1. Creativity in the age
    of synthetic realities
    Design and Innovation from
    Accenture Interactive
    Andy Polaine
    Group Director – Fjord Client Evolution
    @apolaine | @fjord
    trends.fjordnet.com
    pln.me/synthetic
    Emerce eDay, Amsterdam, 2019

    View full-size slide

  2. 2
    Andy Polaine – Creativity in the age of synthetic realities
    Deep Fakes

    View full-size slide

  3. 3
    Andy Polaine – Creativity in the age of synthetic realities
    Bundesweite Umfrage
    Jetzt Umfrage beantworten und exklusives Dankeschön-Paket sichern
    MDM ÖFFNEN
    The Post's View
    Deepfakes are dangerous — and they target a huge
    weakness
    Opinion

    June 16
    DEEPFAKES ARE dangerous — not only the synthetic videos themselves but also the way they
    promise to blur reality in a country where facts are already up for debate.
    "Deepfakes" have changed the idea that seeing is believing - and could have a huge impact on how future political campaigns unfold.
    (Elyse Samuels/The Washington Post)
    By Editorial Board
    "
    Inside the race to beat 'deepfakes' in 2020
    ' Sections Sign In (
    ) Summer Sale
    Democracy Dies in Darkness
    There's a terrifying trend on the internet
    that could be used to ruin your reputation,
    and no one knows how to stop it
    Lisa Eadicicco, Business Insider
    10.07.2019, 17:01
    Samantha Lee/Business Insider
    The rise of deepfakes, or videos created using AI that can make it
    look like someone said or did something they have never done, has
    FACEBOOK
    ! LINKEDIN
    " TWITTER
    # EMAIL
    $ PRINT
    %
    El Paso Shooting
    This PSA About Fake News From
    Barack Obama Is Not What It
    Appears
    Oscar-winning filmmaker Jordan Peele has a warning for viewers about trusting material they
    encounter online.
    David Mack
    BuzzFeed News Reporter
    Posted on April 17, 2018, at 11:26 a.m. ET
    Sitting before the Stars and Stripes, another flag pinned to his lapel, former president
    Barack Obama appears to be delivering an important message about fake news — but
    something seems slightly...off.
    video-player.buzzfeed.com
    ADVERTISEMENT
    ADVERTISEM
    Tweet Share Copy
    Technology
    Home Video World UK Business Tech Science Stories Entertainment & Arts Health World News TV More
    In fighting deep fakes, mice may be great
    listeners
    By Dave Lee
    North America technology reporter
    Top Stories
    Hong Kong airport cancels flights
    over protests
    2 hours ago
    News Sport Reel Worklife Travel Future Search
    Search the BBC
    Sign in More

    View full-size slide

  4. Fake Olds
    4
    Andy Polaine – Creativity in the age of synthetic realities

    View full-size slide

  5. 5
    Andy Polaine – Creativity in the age of synthetic realities
    Image: Wikimedia
    Stalin removes Nikolai Yezhov, 1940

    View full-size slide

  6. Cover ©1982 National Geographic
    6
    Andy Polaine – Creativity in the age of synthetic realities
    Image ©Gordan Gahan
    National Geographic, 1982

    View full-size slide

  7. 7
    Andy Polaine – Creativity in the age of synthetic realities
    Photoshop 1.0, 1990

    View full-size slide

  8. 8
    Andy Polaine – Design in the age of synthetic realities
    Stories (and Sharpies) are a more
    potent technology than Deepfakes.

    View full-size slide

  9. “There is nothing so amazing
    that we can’t get used to it.”
    9
    Andy Polaine – Creativity in the age of synthetic realities
    Ian McEwan, Machines Like Me

    View full-size slide

  10. 10
    Andy Polaine – Creativity in the age of synthetic realities
    The rapid pace of
    synthetic media

    View full-size slide

  11. 11
    Andy Polaine – Creativity in the age of synthetic realities
    Large Scale GAN Training for High Fidelity Natural Image Synthesis. Andrew Brock, Jeff Donahue, Karen Simonyan
    Hi-fidelity synthetic imagery
    Dogball

    View full-size slide

  12. 12
    Andy Polaine – Creativity in the age of synthetic realities
    Synthetic People

    View full-size slide

  13. 13
    Andy Polaine – Creativity in the age of synthetic realities
    Four years of GANs
    Ian Goodfellow: https://twitter.com/goodfellow_ian/status/1084973596236144640

    View full-size slide

  14. 14
    Andy Polaine – Creativity in the age of synthetic realities
    StyleGAN: https://github.com/NVlabs/stylegan

    View full-size slide

  15. 15
    Andy Polaine – Creativity in the age of synthetic realities
    Vid2Vid: https://tcwang0509.github.io/vid2vid/

    View full-size slide

  16. 16
    Andy Polaine – Creativity in the age of synthetic realities
    Jurassic Park, 1993
    Expression & Pose Editing
    Deep Video Portraits: https://arxiv.org/abs/1805.11714

    View full-size slide

  17. 17
    Andy Polaine – Creativity in the age of synthetic realities
    Few/Single Shot Living Portraits
    Few-Shot Adversarial Learning of Realistic Neural Talking Head Models:
    https://arxiv.org/abs/1905.08233v1

    View full-size slide

  18. 18
    Andy Polaine – Creativity in the age of synthetic realities
    The willing
    suspension of
    disbelief

    View full-size slide

  19. 19
    Andy Polaine – Creativity in the age of synthetic realities
    “As soon as it works, no
    one calls it AI anymore.”
    - John McCarthy, 1955

    View full-size slide

  20. 20
    Andy Polaine – Creativity in the age of synthetic realities
    lilmiquela
    Venice Beach
    View Profile
    View More on Instagram
    36,346 likes
    lilmiquela
    *Nicki voice* Let's go to the beach, beach!!! That is all. Have a blessed day bbs
    " # $ %

    view all 296 comments
    Add a comment...
    Lil Miquela at the beach. Do synthetic people need sun protection?
    Given the rise of virtual Instagram inhuencer Lil Miquela (who currently has 1.6m followers) and her forays into music,
    advertising and interviewing, it seems likely that the Vrst full GAN-generated artist is around the corner.
    Lil Miquela
    https://www.instagram.com/lilmiquela/

    View full-size slide

  21. 21
    Andy Polaine – Creativity in the age of synthetic realities
    Hatsune Miku
    https://www.instagram.com/hatsune.miku_/

    View full-size slide

  22. 22
    Andy Polaine – Creativity in the age of synthetic realities
    AI news anchor
    https://twitter.com/XHNews/status/1098221286491271168

    View full-size slide

  23. 23
    Andy Polaine – Creativity in the age of synthetic realities
    Synthetic media
    and the future of
    creative
    industries

    View full-size slide

  24. Synthesise people, faces, objects, animals
    Capture and re-generate poses and movement
    Modify facial expressions
    Synthesise places and landscapes
    Clone voices
    Generate completely new imagery
    Generate writing
    Effortlessly erase anything from images/video
    Generate GUIs and UX flows
    Link them all together in workflows
    24
    Andy Polaine – Creativity in the age of synthetic realities
    We can now:

    View full-size slide

  25. 25
    Andy Polaine – Creativity in the age of synthetic realities
    Digital
    Fashion
    Image: Instagram – Daria Simonova wearing digital clothes by Carlings.

    View full-size slide

  26. 26
    Andy Polaine – Creativity in the age of synthetic realities
    Data Grid
    https://datagrid.co.jp

    View full-size slide

  27. 27
    Andy Polaine – Creativity in the age of synthetic realities

    View full-size slide

  28. 28
    Andy Polaine – Creativity in the age of synthetic realities
    Creative Selection
    StyleGAN: https://github.com/NVlabs/stylegan

    View full-size slide

  29. 29
    Andy Polaine – Creativity in the age of synthetic realities
    AI-assisted
    design

    View full-size slide

  30. 30
    Andy Polaine – Creativity in the age of synthetic realities
    UIzard
    https://uizard.io

    View full-size slide

  31. 31
    Andy Polaine – Creativity in the age of synthetic realities
    Adobe’s Content-Aware Fill

    View full-size slide

  32. 32
    Social media ex-removal?

    View full-size slide

  33. 33
    Andy Polaine – Creativity in the age of synthetic realities
    Designer as
    AI curator
    Image: “squishybrain” on Ganbreeder

    View full-size slide

  34. 34
    Andy Polaine – Creativity in the age of synthetic realities
    Ganbreeder
    http://ganbreeder.app

    View full-size slide

  35. 35
    Andy Polaine – Creativity in the age of synthetic realities
    Text to image synthesis
    AttnGAN: https://arxiv.org/abs/1711.10485

    View full-size slide

  36. 36
    Andy Polaine – Creativity in the age of synthetic realities
    iSketchNFill
    https://github.com/arnabgho/iSketchNFill

    View full-size slide

  37. 37
    Andy Polaine – Creativity in the age of synthetic realities
    Runway ML –
    Photoshop 1.0
    of AI & Design
    http://runwayml.com

    View full-size slide

  38. 38
    Andy Polaine – Creativity in the age of synthetic realities
    Runway ML

    View full-size slide

  39. 39
    Andy Polaine – Creativity in the age of synthetic realities
    Designers’ AI
    assistants
    will become
    valuable IP
    Technology
    Home Video World Asia UK Business Tech Science Stories Entertainment & Arts Health World News T
    1 August 2019
    AI system 'should be recognised as
    inventor'
    By Leo Kelion
    Technology desk editor
    An artificial intelligence system should be recognised as the inventor of two
    ideas in patents filed on its behalf, a team of academics says.
    The AI has designed interlocking food containers that are easy for robots to grasp
    Top Stories
    Amazon fires an 'interna
    crisis', says Macron
    The French president's call fo
    be discussed at the G7 summ
    Brazil’s president.
    2 hours ago
    Cathay Pacific staff spea
    climate of fear
    22 August 2019
    Parents fail to free sons
    daughter's murder
    22 August 2019
    Features
    Why India wants to brea
    decades-old nuclear ple
    Share
    GETTY IMAGES
    News Sport Reel Worklife Travel Future Search
    Search the BBC
    Sign in More

    View full-size slide

  40. 40
    Andy Polaine – Creativity in the age of synthetic realities
    Synthetic Twins

    View full-size slide

  41. “The whole thing looks very
    natural and no one would
    likely even notice without
    prior knowledge of the
    feature.”
    Andrew O’Hara — AppleInsider
    41
    Image: Fernando Frazão/Agência Brasil
    Andy Polaine – Fjord – Towards a mindful service design – Service Design Days 2018
    Images: Will Sigmon @WSig
    https://twitter.com/WSig/status/1146146914985009154
    Corrected
    Uncorrected
    Attention Correction

    View full-size slide

  42. 30 July 2019
    Chinese vlogger who used filter to look younger caught
    in live-stream glitch
    By Dhruti Shah & Kerry Allen
    BBC News & BBC Monitoring
    Your Highness Qiao Biluo's real appearance (left) and one of her filtered faces (right) from an earlier
    livestream on Douyu
    Fans of a popular Chinese video blogger who called herself "Your Highness
    Latest Posts
    Anti-natalists: The peo
    want you to stop havin
    Who are “anti-natalists” and
    want the gradual extinction
    Twitch CEO apologises
    pornography on Ninja'
    Gundam: The 'nerdy' e
    that led to marriage
    TikTok videos spread c
    change awareness
    Subscribe to our
    BBC Trending
    Share
    DOUYU
    42
    Andy Polaine – Design in the age of synthetic realities
    Synthetic
    Twins
    AI Avatars

    View full-size slide

  43. 43
    Andy Polaine – Creativity in the age of synthetic realities
    Snapchat’s
    gender-swap lens
    Nev Schulman - host of MTV’s Catfish
    https://twitter.com/NevSchulman/status/1127724161718202368

    View full-size slide

  44. 44
    Andy Polaine – Creativity in the age of synthetic realities
    Emotion intervention
    Emotion inference
    Real time emotion inference using CycleGAN: https://www.youtube.com/watch?v=JaQQVrAv9ok

    View full-size slide

  45. “You’ve got to rely on people’s ethics.
    You don’t cheat just because the
    technology is available. Machines aren’t
    ethical or unethical — people are.”
    45
    Andy Polaine – Creativity in the age of synthetic realities
    Brian Steffans, graphics editor at The Los Angeles Times, 1987.

    View full-size slide

  46. Thank you.
    Andy Polaine
    @apolaine @fjord
    pln.me/synthetic
    Emerce eDay, Amsterdam, 2019

    View full-size slide