Slide 1

Slide 1 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Danilo Poccia Principal Evangelist, AWS @danilop Playing with Machine Learning

Slide 2

Slide 2 text

Science Museum Group Collection © The Board of Trustees of the Science Museum

Slide 3

Slide 3 text

Diagram of an algorithm for the Analytical Engine for the computation of Bernoulli numbers, from Sketch of The Analytical Engine Invented by Charles Babbage by Luigi Menabrea with notes by Ada Lovelace

Slide 4

Slide 4 text

Letter from Ada Lovelace to Charles Babbage 1843 In this letter, Lovelace suggests an example of a calculation which “may be worked out by the engine without having been worked out by human head and hands first”.

Slide 5

Slide 5 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Machine Learning

Slide 6

Slide 6 text

© 2020, Amazon Web Services, Inc. or its Affiliates. http://www.thehudsonvalley.com/articles/60-years-ago-today-local-technology-demonstrated-artificial-intelligence-for-the-first-time Arthur Samuel (1959)

Slide 7

Slide 7 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Perceptron Frank Rosenblatt (1962)

Slide 8

Slide 8 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Perceptrons: An Introduction to Computational Geometry A perceptron can only solve linearly separable functions (e.g. no XOR) Marvin Minsky, Seymour Papert (1969)

Slide 9

Slide 9 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Intel Xeon CPU 28 cores NVIDIA V100 GPU 5,120 CUDA Cores 640 Tensor Cores M oore’s Law Microprocessor Transistor Counts 1971-2018

Slide 10

Slide 10 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Deep Learning

Slide 11

Slide 11 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. output f(∑) f(∑) f(∑) f(∑) f(∑) f(∑) f(∑) f(∑) f(∑) How to give images in input to a Neural Network? Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 12

Slide 12 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix 0 0 0 0 1 0 0 0 0 Identity Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 13

Slide 13 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix 1 0 -1 2 0 -2 1 0 -1 Left Edges Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 14

Slide 14 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix -1 0 1 -2 0 2 -1 0 1 Right Edges Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 15

Slide 15 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix 1 2 1 0 0 0 -1 -2 -1 Top Edges Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 16

Slide 16 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix -1 -2 -1 0 0 0 1 2 1 Bottom Edges Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 17

Slide 17 text

© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. Convolution Matrix 0.6 -0.6 1.2 -1.4 1.2 -1.6 0.8 -1.4 1.6 Random Values Photo by David Iliff. License: CC-BY-SA 3.0 https://commons.wikimedia.org/wiki/File:Colosseum_in_Rome,_Italy_-_April_2007.jpg

Slide 18

Slide 18 text

© 2020, Amazon Web Services, Inc. or its Affiliates. By Debarko De @debarko https://hackernoon.com/what-is-a-capsnet-or-capsule-network-2bfbe48769cc Convolutional Neural Networks (CNNs)

Slide 19

Slide 19 text

© 2020, Amazon Web Services, Inc. or its Affiliates. 0 5 10 15 20 25 30 2010 2011 2012 2013 2014 2015 2016 2017 CNNs ImageNet Classification Error Over Time

Slide 20

Slide 20 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepLens Get hands-on with Deep Learning 2017

Slide 21

Slide 21 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepLens

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

No content

Slide 24

Slide 24 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepLens Video

Slide 25

Slide 25 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Supervised learning Example-driven training — with labeled data of known outputs for given inputs, a model is trained to predict output for new inputs. Unsupervised learning Inference-based training — with unlabeled data without known outputs, a model is trained to identify related structures or similar patterns within the input data.

Slide 26

Slide 26 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Reinforcement Learning

Slide 27

Slide 27 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepRacer 2018

Slide 28

Slide 28 text

In the box 3 2 1 4 5 9 10a 7a 6a 10b 7b 6b 8 1. Vehicle chassis 2. Vehicle body shell 3. Micro-USB to USB-A cable 4. Compute battery 5. Compute battery connector cable 6a. Compute battery charge adapter 6b. Computer battery charge cable 7a. Vehicle power cable 7b. Vehicle power adapter 8. Pins (spare parts) 9. Vehicle battery 10a. Vehicle battery charge adapter 10b. Vehicle battery charge cable 11. Silicon cable holder (not shown) 12. White marking tape (not shown) 1 Vehicle at a glance Front Front Back Back Camera 4 MP camera with MJPEG SD card slot Power button HDMI Micro USB USB C USB Reset button Power on/off Vehicle chassis Status LEDs Compute module Customizable LED Compute battery on/off 2

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepRacer Video

Slide 31

Slide 31 text

© 2020, Amazon Web Services, Inc. or its Affiliates. What next? Generative Machine Learning

Slide 32

Slide 32 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Generator Neural Network Discriminator Neural Network Real or Generated? Real Picture Generated Picture Generative Adversarial Networks (GANs)

Slide 33

Slide 33 text

© 2020, Amazon Web Services, Inc. or its Affiliates. 2014 Generative Adversarial Networks (GANs)

Slide 34

Slide 34 text

© 2020, Amazon Web Services, Inc. or its Affiliates. 2016 Generative Adversarial Networks (GANs)

Slide 35

Slide 35 text

© 2020, Amazon Web Services, Inc. or its Affiliates. StyleGAN2 (2019) https://thispersondoesnotexist.com https://arxiv.org/abs/1812.04948 http://arxiv.org/abs/1912.04958

Slide 36

Slide 36 text

© 2020, Amazon Web Services, Inc. or its Affiliates. What else can we ”generate” ? Music

Slide 37

Slide 37 text

© 2020, Amazon Web Services, Inc. or its Affiliates. AWS DeepComposer 2019

Slide 38

Slide 38 text

© 2020, Amazon Web Services, Inc. or its Affiliates.

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

© 2020, Amazon Web Services, Inc. or its Affiliates. What about high-level, easy to use AI services? Text-To-Speech Object Detection Language Translation Sentiment Analysis

Slide 41

Slide 41 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Let’s build a “Positive Chat” J • Avoid negative sentiment • Reject negative sentences • Positive sentiment gamification • Automatically translate between different languages • Extract message topics to improve searchability and discoverability • Create and update a chat room “tag cloud” • Search or filter messages by “tag”

Slide 42

Slide 42 text

No content

Slide 43

Slide 43 text

© 2020, Amazon Web Services, Inc. or its Affiliates. $ wc -l positive-chat/app.js 326 positive-chat/app.js $ wc -l www/index.js 204 www/index.js backend + frontend ≃ 460 lines of code removing empty lines and comments https://github.com/danilop/serverless-positive-chat

Slide 44

Slide 44 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Reinforcement Learning Deep Learning Generative Adversarial Networks Let’s Play and Learn with Machine Learning AI Services

Slide 45

Slide 45 text

© 2020, Amazon Web Services, Inc. or its Affiliates. Thank you! @danilop Please give me your feedback!