Learning AI with Van Gogh, Solar, and Cruz-Diez

Every time somebody mention AI news in the office, you wonder on the glorious future beyond your daily data taming or pipelines monitoring. In this talk you will be introduced to Neural Networks applied to arts, using a paper "A Neural Algorithm of Artistic Style" as a "deep" start.

Presented in SciTech La Plata 2018 - http://www.scitechmeetup.com
Repo: https://github.com/p1nox/learning_ai_with_art

Transcript

1. Learning AI with Van Gogh, Solar, and Cruz-Diez by Raul Pino SciTech La Plata 2018 1
2. Learning AI with Van Gogh, Fini, and Cruz-Diez by Raul Pino SciTech La Plata 2018 2
3. Scaling a Painter with AI by Raul Pino SciTech La Plata 2018 3
4. Who am I? » Born in Venezuela » Living in Chile » Elementus » uBiome » Groupon » <3 DS, AI, Coffee, Diving Github/Twitter: @p1nox 4
5. Agenda » Artificial Intelligence » Machine Learning » Deep Learning » Artistic Style » High level implementation » Live example » Related research, Implementations, Takeaways 5
6. Wait, why Art? "The principles of true art is not to portray, but to evoke." - Kosinski. "We all know that Art is not truth. Art is a lie that makes us realize truth, at least the truth that is given us to understand." - Picasso. 6
7. Artificial intelligence Sub-problems * Reasoning * Knowledge representation * Planning * Learning: Machine Learning * Natural language processing * Perception * Motion and manipulation * Social intelligence * General intelligence 7
8. Machine Learning Data >[ Model ]> Prediction Approaches * Deep learning: Artificial Neural Networks - Structured data - Unstructured data 8
9. Deep Learning: Standard Neural Networks Structured data: table.csv 9
10. Deep Learning: Standard Neural Networks Structured data: table.csv 10
11. Deep Learning: Standard Neural Networks Structured data: table.csv 11
12. Deep Learning: Convolutional Neural Network Unstructured data: img.jpg 12
13. A Neural Algorithm of Artistic Style 13
14. Artistic Style A Neural Algorithm of Artistic Style. Leon Gatys, Alexander Ecker, Matthias Bethge - 2015 In a Convolutional Neural Network, "Content" is independent from "Style"! 14
15. Convolutional Neural Network Pre-trained VGG19 model (University of Oxford) » 14-million images » 1000 categories Identify objects in images checked! 15
16. Convolutional Neural Network conv 2_3 == 3rd conv layer in the 2nd block 16
17. Content Extraction conv layer 5_2 17
18. Style Extraction conv layers 1_1, 2_1, 3_1, and 4_1 18
19. Layer Extraction » Content = conv layer 5_2 » Style = conv layers 1_1, 2_1, 3_1, 4_1 and 5_1 Mix content and style! iterate cont = get_content(content_img) style = get_style(style_img) cost fn() compare(content_img, get_content(cont)) compare(content_img, get_style(style)) 19
20. Live Example » Pre-trained VGG19 model » TensorFlow » NumPy » SciPy » Docker Repo: learningaiwith_art 20
21. Related research » Inceptionism: Going Deeper into Neural Networks » Using Machine Learning for Identification of Art Paintings » Artistic style transfer for videos » Artistic style transfer for videos and spherical images 21
22. Implementations » Prisma » DeepArt » Dreamscope 22
23. Takeaways » Adictive & fun! » Imitating first like an artist? » Future art simulation/ classification? Beauty, meaning, uniqueness, intention... 23
24. Sources & Resources » A Neural Algorithm of Artistic Style » Deep Learning & Art: Neural Style Transfer » Siraj collection on AI and Art » Painting like Van Gogh with Convolutional Neural Networks » VGG19 - MatConvNet » Vincent: AI Artist 24
25. Sources & Resources » Deep Learning Course - Coursera » Creating art with deep neural networks » Computer algorithm can accurately identify Jackson Pollock paintings » When A Machine Learning Algorithm Studied Fine Art Paintings, It Saw Things Art Historians Had Never Noticed » Is Art Created by AI Really Art? 25
26. Sources & Resources » Putting the art in artificial intelligence » Why AI is a revolution » JWT's 'The Next Rembrandt' Wins Two Grand Prix at Cannes, in Cyber and Creative Data » Delivering real-time AI in the palm of your hand » TensorFlow Implementation of "A Neural Algorithm of Artistic Style" 26
27. Paintings » Cover 1: » Pegaso de Sol » Ciudá lagui » Induction Chromatique » Physichromie 625 » The Starry Night 27
28. Paintings » Cover 2: » Red Vision » Cariatide délivrée » Induction Chromatique » Physichromie 625 » The Starry Night 28
29. Paintings » Cover 3: » The Study of Vermeer » Rubens and His Wife » Induction Chromatique » Physichromie 625 » The Starry Night 29
30. Paintings » Slide 2: Fisicromía 2250 » Slide 3: Kitchen Table » Slide 4: Guernica » Slide 5: Study on the proportions of head and eyes » Slide 6: Flying machine » Slide 11: The Starry Night » Slide 20: The School of Athens 30
31. Paintings » Slide 21: Blue (Moby Dick) » Slide 22: » The Girl with a Pearl Earring » The Study of Vermeer » Menina (After Velazquez) » Las Meninas 31
32. Gracias La Plata :) 32