Learning AI with Van Gogh, Botero, and Cruz-Diez by Raul Pino ScaleConfCo 2018 1

Scaling a Painter with AI by Raul Pino ScaleConfCo 2018 2

Who am I? » Born in Venezuela » Living in Chile » uBiome » Groupon » <3 DS, AI, Coffee, Diving Github/Twitter: @p1nox 3

Agenda » Artificial Intelligence » Machine Learning » Deep Learning » Artistic Style » High level implementation » Live example » Related research, Implementations, Takeaways 4

Wait, why Art? "The principles of true art is not to portray, but to evoke." - Kosinski. "We all know that Art is not truth. Art is a lie that makes us realize truth, at least the truth that is given us to understand." - Picasso. 5

Artificial intelligence Sub-problems * Reasoning * Knowledge representation * Planning * Learning: Machine Learning * Natural language processing * Perception * Motion and manipulation * Social intelligence * General intelligence 6

Machine Learning Data >[ Model ]> Prediction Approaches * Deep learning: Artificial Neural Networks - Structured data - Unstructured data 7

Deep Learning: Standard Neural Networks Structured data: table.csv 8

Deep Learning: Standard Neural Networks Structured data: table.csv 9

Deep Learning: Standard Neural Networks Structured data: table.csv 10

Deep Learning: Convolutional Neural Network Unstructured data: img.jpg 11

A Neural Algorithm of Artistic Style 12

Artistic Style A Neural Algorithm of Artistic Style. Leon Gatys, Alexander Ecker, Matthias Bethge - 2015 In a Convolutional Neural Network, "Content" is independent from "Style"! 13

Convolutional Neural Network Pre-trained VGG19 model (University of Oxford) » 14-million images » 1000 categories Identify objects in images checked! 14

Convolutional Neural Network conv 2_3 == 3rd conv layer in the 2nd block 15

Content Extraction conv layer 5_2 16

Style Extraction conv layers 1_1, 2_1, 3_1, and 4_1 17

Layer Extraction » Content = conv layer 5_2 » Style = conv layers 1_1, 2_1, 3_1, 4_1 and 5_1 Mix content and style! iterate cont = get_content(content_img) style = get_style(style_img) cost fn() compare(content_img, get_content(cont)) compare(content_img, get_style(style)) 18

Live Example » Pre-trained VGG19 model » TensorFlow » NumPy » SciPy » Docker Repo: learningaiwith_art 19

Related research » Inceptionism: Going Deeper into Neural Networks » Using Machine Learning for Identification of Art Paintings » Artistic style transfer for videos » Artistic style transfer for videos and spherical images 20

Implementations » Prisma » DeepArt » Dreamscope 21

Takeaways » Adictive & fun! » Imitating first like an artist? » Future art simulation/ classification? Beauty, meaning, uniqueness, intention... 22

Sources & Resources » A Neural Algorithm of Artistic Style » Deep Learning & Art: Neural Style Transfer » Siraj collection on AI and Art » Painting like Van Gogh with Convolutional Neural Networks » VGG19 - MatConvNet » Vincent: AI Artist 23

Sources & Resources » Deep Learning Course - Coursera » Creating art with deep neural networks » Computer algorithm can accurately identify Jackson Pollock paintings » When A Machine Learning Algorithm Studied Fine Art Paintings, It Saw Things Art Historians Had Never Noticed » Is Art Created by AI Really Art? 24

Sources & Resources » Putting the art in artificial intelligence » Why AI is a revolution » JWT's 'The Next Rembrandt' Wins Two Grand Prix at Cannes, in Cyber and Creative Data » Delivering real-time AI in the palm of your hand » TensorFlow Implementation of "A Neural Algorithm of Artistic Style" 25

Paintings » Cover: » The Study of Vermeer » Rubens and His Wife » Induction Chromatique » Physichromie 625 » The Starry Night 26

Paintings » Slide 2: Fisicromía 2250 » Slide 3: Kitchen Table » Slide 4: Guernica » Slide 5: Study on the proportions of head and eyes » Slide 6: Flying machine » Slide 11: The Starry Night » Slide 20: The School of Athens 27

Paintings » Slide 21: Blue (Moby Dick) » Slide 22: » The Girl with a Pearl Earring » The Study of Vermeer » Menina (After Velazquez) » Las Meninas 28

Gracias hermana republica :) 29