Learning AI with Van Gogh, Matta, and Cruz-Diez

Slide 1

Slide 1 text

Learning AI with Van Gogh, Matta, and Cruz-Diez by Raul Pino Development Week Santiago 2018 1

Slide 2

Slide 2 text

Scaling a Painter with AI by Raul Pino Development Week Santiago 2018 2

Slide 3

Slide 3 text

Who am I? » Born in Venezuela » Living in Chile » Elementus » uBiome » Groupon » <3 DS, AI, Coffee, Diving Github/Twitter: @p1nox 3

Slide 4

Slide 4 text

Agenda » Artiﬁcial Intelligence » Machine Learning » Deep Learning » Artistic Style » High level implementation » Live example » Related research, Implementations, Takeaways 4

Slide 5

Slide 5 text

Wait, why Art? "The principles of true art is not to portray, but to evoke." - Kosinski. "We all know that Art is not truth. Art is a lie that makes us realize truth, at least the truth that is given us to understand." - Picasso. 5

Slide 6

Slide 6 text

Artiﬁcial intelligence Sub-problems * Reasoning * Knowledge representation * Planning * Learning: Machine Learning * Natural language processing * Perception * Motion and manipulation * Social intelligence * General intelligence 6

Slide 7

Slide 7 text

Machine Learning Data >[ Model ]> Prediction Approaches * Deep learning: Artiﬁcial Neural Networks - Structured data - Unstructured data 7

Slide 8

Slide 8 text

Deep Learning: Standard Neural Networks Structured data: table.csv 8

Slide 9

Slide 9 text

Deep Learning: Standard Neural Networks Structured data: table.csv 9

Slide 10

Slide 10 text

Deep Learning: Standard Neural Networks Structured data: table.csv 10

Slide 11

Slide 11 text

Deep Learning: Convolutional Neural Network Unstructured data: img.jpg 11

Slide 12

Slide 12 text

A Neural Algorithm of Artistic Style 12

Slide 13

Slide 13 text

Artistic Style A Neural Algorithm of Artistic Style. Leon Gatys, Alexander Ecker, Matthias Bethge - 2015 In a Convolutional Neural Network, "Content" is independent from "Style"! 13

Slide 14

Slide 14 text

Convolutional Neural Network Pre-trained VGG19 model (University of Oxford) » 14-million images » 1000 categories Identify objects in images checked! 14

Slide 15

Slide 15 text

Convolutional Neural Network conv 2_3 == 3rd conv layer in the 2nd block 15

Slide 16

Slide 16 text

Content Extraction conv layer 5_2 16

Slide 17

Slide 17 text

Style Extraction conv layers 1_1, 2_1, 3_1, and 4_1 17

Slide 18

Slide 18 text

Layer Extraction » Content = conv layer 5_2 » Style = conv layers 1_1, 2_1, 3_1, 4_1 and 5_1 Mix content and style! iterate cont = get_content(content_img) style = get_style(style_img) cost fn() compare(content_img, get_content(cont)) compare(content_img, get_style(style)) 18

Slide 19

Slide 19 text

Live Example » Pre-trained VGG19 model » TensorFlow » NumPy » SciPy » Docker Repo: learningaiwith_art 19

Slide 20

Slide 20 text

Related research » Inceptionism: Going Deeper into Neural Networks » Using Machine Learning for Identiﬁcation of Art Paintings » Artistic style transfer for videos » Artistic style transfer for videos and spherical images 20

Slide 21

Slide 21 text

Implementations » Prisma » DeepArt » Dreamscope 21

Slide 22

Slide 22 text

Takeaways » Adictive & fun! » Imitating ﬁrst like an artist? » Future art simulation/ classiﬁcation? Beauty, meaning, uniqueness, intention... 22

Slide 23

Slide 23 text

Sources & Resources » A Neural Algorithm of Artistic Style » Deep Learning & Art: Neural Style Transfer » Siraj collection on AI and Art » Painting like Van Gogh with Convolutional Neural Networks » VGG19 - MatConvNet » Vincent: AI Artist 23

Slide 24

Slide 24 text

Sources & Resources » Deep Learning Course - Coursera » Creating art with deep neural networks » Computer algorithm can accurately identify Jackson Pollock paintings » When A Machine Learning Algorithm Studied Fine Art Paintings, It Saw Things Art Historians Had Never Noticed » Is Art Created by AI Really Art? 24

Slide 25

Slide 25 text

Sources & Resources » Putting the art in artiﬁcial intelligence » Why AI is a revolution » JWT's 'The Next Rembrandt' Wins Two Grand Prix at Cannes, in Cyber and Creative Data » Delivering real-time AI in the palm of your hand » TensorFlow Implementation of "A Neural Algorithm of Artistic Style" 25

Slide 26

Slide 26 text

Paintings » Cover 1: » Morphology » Redness of Blue » Induction Chromatique » Physichromie 625 » The Starry Night 26

Slide 27

Slide 27 text

Paintings » Cover 2: » The Study of Vermeer » Rubens and His Wife » Induction Chromatique » Physichromie 625 » The Starry Night 27

Slide 28

Slide 28 text

Paintings » Slide 2: Fisicromía 2250 » Slide 3: Kitchen Table » Slide 4: Guernica » Slide 5: Study on the proportions of head and eyes » Slide 6: Flying machine » Slide 11: The Starry Night » Slide 20: The School of Athens 28

Slide 29

Slide 29 text

Paintings » Slide 21: Blue (Moby Dick) » Slide 22: » The Girl with a Pearl Earring » The Study of Vermeer » Menina (After Velazquez) » Las Meninas 29

Slide 30

Slide 30 text

Gracias Chile :D 30