Artificial Intelligence for Developers

What is Artificial Intelligence and how can you make your application smarter without a data science background? This session will help you understand many Machine Learning concepts and provide a starting point to improve your applications with voice, vision, natural language understanding, multi-language capabilities, and much more!

Transcript

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Alex Casalboni Technical Evangelist, AWS @alex_casalboni @ 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved Artificial Intelligence for Developers
2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. About me • Software Engineer & Web Developer • Serverless Lover & AI Enthusiast • AWS Customer since 2013
3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Myth: AI is dark magic
4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are we talking about? AI Machine Learning Deep Learning
5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. One of the ”Founding Father" of Artificial Intelligence John McCarthy, 1955 Coins the term
6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Frank Rosenblatt, 1957 Perceptron
7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. First known deep network Alexey Grigorevich Ivakhnenko, 1965
8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Paul Werbos, 1975 Backpropagation
9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. LeCun, 1989 First application of backpropagation https://www.youtube.com/watch?v=FwFduRA_L6Q
10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AI winter 1969 – 1990
11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The curse of dimensionality
12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Advent of AI Data GPUs & Acceleration Cloud Computing Algorithms
13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deep Learning is a Big Deal It’s does a better job than other ML and Humans
14. Convolutional Neural Networks (CNN) Conv 1 Conv 2 Conv n … … Feature Maps Labrador Dog Beach Outdoors Softmax Probability Fully Connected Layer
15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Examples of CNN’s
16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. https://github.com/precedenceguo/mx-rcnn https://github.com/zhreshold/mxnet-yolo Object Detection
17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. https://github.com/tornadomeet/mxnet-face Face Detection
18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Object Detection (Video)
19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FDA-approved medical imaging https://www.periscope.tv/AWSstartups/1vAGRgevBXRJl https://www.youtube.com/watch?v=WE81dncwnIc Object Segmentation
20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Text Detection and Recognition https://github.com/Bartzi/stn-ocr
21. Style Transfer
22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Real-Time Pose Estimation https://github.com/dragonfly90/mxnet_Realtime_Multi-Person_Pose_Estimation
23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Generative Adversarial Networks (GAN) The future at work (already) today Generating new ”celebrity” faces https://github.com/tkarras/progressive_growing_of_gans
24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How to ”build” a Neural Network?
25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Visualization & Analysis Business Problem – ML problem framing Data Collection Data Integration Data Preparation & Cleaning Feature Engineering Model Training & Parameter Tuning Model Evaluation Are Business Goals met? Model Deployment Monitoring & Debugging Yes No Data Augmentation Feature Augmentation The AI Process Re-training Predictions
26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Where to look at in your organisation ? Where data is being analyzed to help making decisions: • Sales • Marketing • Social media • Customer supports  • Logs
27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Data is gold”
29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Pro-tip • Make it ridiculously easy to collect and store any type of data. • One line of code should be all it takes for anyone in the company to start collecting and storing new data points
30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ML
32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Where do you start? The Low Hanging Fruits
35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Put AI in the hands of every developer and data scientist Machine Learning at AWS: Our mission
36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FRAMEWORKS / INTERFACES KERAS PLATFORMS APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X AMAZON SAGEMAKER AMAZON MECHANICAL TURK Machine Learning for everyone
37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Polly “Hi, I’m Matthew…” Amazon Polly: Text In, Life-like Speech Out
38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Content creation • Mobile & desktop applications • Internet of Things (IoT) • Education & e-learning • Telephony • Game development Use cases • 54 voices across 26 languages • Lip-syncing & text highlighting • Fine-grained voice control • Custom vocabularies • Available in 16 AWS Regions Key features Amazon Polly: Text In, Life-like Speech Out
39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo
40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Deep learning-based image & video analysis
41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Object & Scene Detection
42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Facial Analysis
43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Facial Search
44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Optical Character Recognition (OCR)
45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Celebrity Recognition
46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition API example $ aws rekognition detect-labels –-image '{"S3Object": {"Bucket": "your-bucket", "Name": "test.jpg"}}' { "Labels": [ { "Confidence": 99.29136657714844, "Name": "Human" }, { "Confidence": 99.29136657714844, "Name": "People" }, { "Confidence": 99.29136657714844, "Name": "Person" }, ……
47. Rekognition Video Analysis Service
49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Marinus Analytics uses facial recognition to stop human trafficking “Now with Traffic Jam’s FaceSearch, powered by Amazon Rekognition, investigators are able to take effective action by searching through millions of records in seconds to find victims.” http://www.marinusanalytics.com/articles/2017/10/17/amazon-rekognition-helps-marinus-analytics-fight-human-trafficking
50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex “What’s the weather forecast?” “It will be sunny and 25°C” Weather Forecast Amazon Lex Build Conversational Chatbots
51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex End to End Speech to Intent ASR+NLU integrated into one API Dialog Management Native support & maintains context Text to Speech Amazon Polly integrated into API Business Logic Native integration with AWS Lambda Deployment One click deployment Security Encrypted data in transit & at rest Scale Completely managed service Analytics Monitor and improve End to End
52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Discover insights from text Entities Key Phrases Language Sentiment Amazon Comprehend Topic Modeling
54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Text analytics workload Amazon Kinesis Amazon ES Amazon Redshift Amazon EMR • Semantic • Rich filtering • Grouping, trends • Joining, correlating • Clustering • Graph, search • Near real-time • Alerts Amazon S3 Social media, support Amazon Aurora Articles, documents
55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Syntax detection $ aws comprehend detect-syntax --language-code 'en' --text 'I love cloud! { "SyntaxTokens": [ { "TokenId": 1, "Text": "I", "BeginOffset": 0, "EndOffset": 1, "PartOfSpeech": { "Tag": "PRON", "Score": 0.9999802112579346 } }, ...
56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hotels.com « Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” Matt Fryer, VP and Chief Data Science Officer, Hotels.com
57. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Hello, this is Allan speaking” Amazon Transcribe Automatic speech recognition service Amazon Transcribe
58. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Transcribe – use cases Call centers Subtitles for VOD Broadcast closed captions Transcribe meetings
59. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Lambda Amazon S3 Amazon Athena Audio Input Amazon QuickSight Amazon Comprehend Amazon Transcribe – media workloads
60. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ringDNA • End-to-end communications platform for sales teams. • Hundreds of enterprise organizations use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate. Speech to Text "A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about Amazon Transcribe since it provides high-quality speech recognition at scale, helping us to better transcribe every call to text " Howard Brown, CEO & Founder, RingDNA https://www.youtube.com/watch?v=1ZJ_f1bDdog
61. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Hello, what’s up? Do you want to go see a movie tonight?” Amazon Translate Natural and fluent language translation "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?" Amazon Translate
62. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Translate – supported languages * Arabic Simplified Chinese French German Spanish Portuguese Japanese Traditional Chinese Italian Russian Turkish Czech * Coming soon: Danish, Dutch, Finnish, Swedish, Hebrew, and Polish
63. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use for high volume and time-sensitive information Share of worldwide digital content Machine translation • User-authored content • Text Analytics • Real-time communication • Content discovery Post-edited machine translation • Legal documents • Healthcare documents • Advertising materials
64. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hotels.com «We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believe that Amazon Translate presents a quick, efficient and most importantly, accurate solution. » Matt Fryer, VP and Chief Data Science Officer, Hotels.com
65. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Who is Running ML on AWS Today?
66. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. < demo time >
67. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. There’s Never Been A Better Time To Build New Businesses
68. aws.amazon.com/education * Programs for Teachers, Entrepreneurs, and Researchers *
69. aws.amazon.com/activate * Programs for Startups, including credits, training, and support *
70. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Alex Casalboni Technical Evangelist, AWS Thank you! @alex_casalboni @ 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved