AWS AI State of the Union - Build On ML BCN

Transcript

1. Julio M Faerman Technical Evangelist @julioaws Machine Learning on AWS: State of the Union
2. http://launchpass.com/aws-spanish Madrid Barcelona Valencia Bilbao Zaragoza Sevilla Alicante AWS en Español
4. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon.com,1995
5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. « Two Decades of Recommender Systems at Amazon.com » (2017) https://www.computer.org/csdl/mags/ic/2017/03/mic2017030012.html G.D. Linden, J.A. Jacobi, and E.A. Benson, Collaborative Recommendations Using Item-to-Item Similarity Mappings, US Patent 6,266,649, to Amazon.com, Patent and Trademark Office, 2001 (filed 1998).
6. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
7. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
8. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
9. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
10. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Put Machine Learning in the hands of every developer and data scientist Our mission
11. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Application Services Platform Services Frameworks & Infrastructure API-driven services: Vision, Language & Speech Services, Chatbots AWS ML Stack Deploy machine learning models with high-performance machine learning algorithms, broad framework support, and one-click training, tuning, and inference. Develop sophisticated models with any framework, create managed, auto- scaling clusters of GPUs for large scale training, or run prediction on trained models.
12. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. More ML is built on AWS than anywhere else
13. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. More ML is built on AWS than anywhere else
14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Application Services
15. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Rekognition Deep Learning-based image analysis service FREE TIER
16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Rekognition Object and scene detection Facial analysis Face comparison Celebrity recognition Image moderation Text in image Image analysis service
17. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Object & Scene Detection
18. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Facial Analysis
19. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Crowd Detection – up to 100 faces NEW
20. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Facial Search
21. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Explicit Nudity Nudity Graphic Male Nudity Graphic Female Nudity Sexual Activity Partial Nudity Suggestive Female Swimwear or Underwear Male Swimwear or Underwear Revealing Clothes Image Moderation
22. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Celebrity Recognition
23. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Text in Image
24. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Marinus Analytics Marinus Analytics provides law enforcement with tools founded in artificial intelligence. Traffic Jam, is a suite of tools for use by law enforcement agencies on sex trafficking investigations. Before using Amazon Rekognition, their only recourse was manual processing; this was time-intensive or not possible. Now, investigators are able to take effective action by searching through millions of records in seconds to find victims. http://www.marinusanalytics.com/articles/ 2017/10/17/amazon-rekognition-helps- marinus-analytics-fight-human-trafficking
25. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Sky News will use Amazon Rekognition to perform real-time identification of guests as they enter St. George’s Chapel
26. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Rekognition Video Deep Learning-based video analysis service NEW FREE TIER
27. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Video Analysis
28. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. http://timescapes.org/trailers/
29. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. http://timescapes.org/trailers/
30. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. City of Orlando Real-time video analysis ”The City of Orlando is excited to work with Amazon to pilot the latest in public safety software through a unique, first-of-it's-kind public-private partnership. Through the pilot, Orlando will utilize Amazon Rekognition Video and Amazon Kinesis Video Streams technology in a way that will use existing City resources to provide real-time detection and notification of persons-of-interests, further increasing public safety, and operational efficiency opportunities for the City of Orlando and other cities across the nation”. John Mina, Police Chief, City of Orlando
31. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon confidential Rekognition Video: Demo
32. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Polly Deep Learning-based text-to-speech service FREE TIER
33. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Polly “Hejsan! Jag heter Astrid och läser upp det som skrivs här.” Amazon Polly: Text In, Life-like Speech Out
34. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. <speak xml:lang="en-US"> The price of this book is <prosody rate="60%">45€</prosody> </speak> A Focus On Voice Quality & Pronunciation Support for Speech Synthesis Markup Language (SSML) Version 1.0 https://www.w3.org/TR/speech-synthesis
35. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Duolingo Duolingo is the most popular language-learning platform and the most downloaded education app in the world, with more than 170 million users. They have run six A/B tests, testing an Amazon Polly voice against a voice from other TTS providers. For all of these experiments, the winning condition was the Amazon Polly voice https://aws.amazon.com/blogs/machine- learning/powering-language-learning-on- duolingo-with-amazon-polly/
36. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Translate Neural Machine Translation Service Now generally available NEW FREE TIER
37. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. “Hello, what’s up? Do you want to go see a movie tonight?” Amazon Translate Natural and fluent language translation "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?" Amazon Translate
38. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Real-time translation Powered by Deep Learning 12 Language pairs (6 more languages to come) Language detection Amazon Translate Natural and fluent language translation
39. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Hotels.com Machine Translation « At Hotels.com, we are committed to offering all of our customers the most relevant and up to date information about their destination. To achieve that, we operate 90 localized websites in 41 languages. We have more than 25M customer reviews and more are coming in every day, making a great candidate for machine translation. Having evaluated Amazon Translate and several other solutions, we believe that Amazon Translate presents a quick, efficient and most importantly, accurate solution » Matt Fryer, VP and Chief Data Science Officer, Hotels.com
40. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Transcribe Automatic speech recognition service Now generally available NEW FREE TIER
41. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. “Hello, this is Allan speaking” Automatic speech recognition service Amazon Transcribe
42. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Support for telephony audio Timestamp generation Intelligent punctuation and formatting Recognize multiple speakers Custom vocabulary Multiple languages Automatic speech recognition service
43. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. ringDNA RingDNA is an end-to-end communications platform for sales teams. Hundreds of enterprise organizations use RingDNA to increase productivity, engage in smarter sales conversations, gain predictive insights and improve their win rate. Speech to Text "A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about Amazon Transcribe since it provides high-quality speech recognition at scale, helping us to better transcribe every call to text" Howard Brown, CEO & Founder, RingDNA https://www.youtube.com/watch?v=1ZJ_f1bDdog
44. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Comprehend Natural Language Processing NEW FREE TIER
45. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Fully managed natural language processing Discover valuable insights from text Entities Key Phrases Language Sentiment Amazon Comprehend
46. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
47. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Topic modeling STORM WORLD SERIES AUSTRALIA STOCK MARKET WASHINGTON HEALTH CRISIS MACHINE LEARNING LIBRARY OF NEWS ARTICLES * Amazon Comprehend
48. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. ClearView Social ClearView Social enables a company’s employees to share approved content on LinkedIn, Twitter, and other social networks. To eliminate the reliance on manual tagging, ClearView Social turned to Amazon Comprehend to find insights and relationships in text. https://aws.amazon.com/blogs/machine-learning/clearview- social-uses-amazon-comprehend-to-measure-the-impact-of- social-sharing/ Natural Language Processing "We use Amazon Comprehend to read an article and extract topics, which are automatically tagged using machine learning. This automatic tagging helps customers easily estimate the market value of their engagement according to the current bid prices from the Google AdWords API" Bill Boulden, CTO, ClearView Social
49. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Lex Conversational Interfaces FREE TIER
50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intents A particular goal that the user wants to achieve Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
51. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Liberty Mutual https://www.youtube.com/watch?v=TeLvFqLW_0A Chatbots « With the growing importance of cognitive technologies in every area of business, we were delighted to see Amazon Lex, with its Speech Recognition and Natural Language Understanding technologies, added to the broad portfolio of services AWS provides. Amazon Lex integrates easily into our existing applications, as well as our new cloud-native serverless architectures. » Gillian Armstrong, Technologist, Liberty Mutual
52. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Platform Services
53. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. End-to-End Machine Learning Platform Zero setup Flexible Model Training Pay by the second $ Amazon SageMaker Build, train, and deploy machine learning models at scale FREE TIER
54. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Highly-optimized machine learning algorithms Build Pre-built notebook instances Amazon SageMaker
55. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Highly-optimized machine learning algorithms One-click training for ML, DL, and custom algorithms Build Pre-built notebook instances Easier training with hyperparameter optimization Train Amazon SageMaker
56. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Highly-optimized machine learning algorithms Deployment without engineering effort Fully-managed hosting at scale Build Pre-built notebook instances Deploy Train One-click training for ML, DL, and custom algorithms Easier training with hyperparameter optimization Amazon SageMaker
57. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Digital Globe http://blog.digitalglobe.com/industry/using-machine-learning- to-save-money-on-cloud-data-storage/ https://www.youtube.com/watch?v=mkKkSRIxU8M In the last 18 years DigitalGlobe has been operating Earth imaging satellites, they have collected over 100 PB of imagery. There is a trade-off between how quickly data can be accessed and how much it will cost to store. Working with the ML Lab, Digital Globe built a predictive model that will reduce cloud storage costs for their imagery archive by 50%.
58. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon ML Lab Lots of companies doing Machine Learning Unable to unlock business potential Brainstorming Modeling Teaching Lack ML expertise Leverage Amazon experts with decades of ML experience with technologies like Amazon Echo, Amazon Alexa, Prime Air and Amazon Go Amazon ML Lab provides the missing ML expertise
59. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Frameworks & Infrastructure
60. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon EC2 C5 instances AVX 512 72 vCPUs “Skylake” 144 GiB memory C5 12 Gbps to EBS 2X vCPUs 2X performance 3X throughput 2.4X memory C4 36 vCPUs “Haswell” 4 Gbps to EBS 60 GiB memory C5: Next G enerat ion Comput e-O pt imized I nst ances wit h I nt el® Xeon® Scalable Processor AW S Comput e opt imized inst ances support t he new I nt el® AVX-512 advanced inst ruct ion set , enabling you t o more eff icient ly run vect or processing workloads wit h single and double f loat ing point precision, such as AI / machine learning or video processing.
61. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon EC2 P3 Instances • Up to eight NVIDIA Tesla V100 GPUs • 1 PetaFLOPs of computational performance – 14x better than P2 • 300 GB/s GPU-to-GPU communication (NVLink) – 9x better than P2 • 16GB GPU memory with 900 GB/sec peak GPU memory bandwidth T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
62. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. AWS Deep Learning AMI • Easy-to-launch tutorials • Hassle-free setup and configuration • Pay only for what you use • Accelerate your model training and deployment • Support for popular deep learning frameworks
63. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. SCDM SCDM Financial uses Deep Learning on AWS to extract valuable information about markets and consumers from mountains of documents and publicly available data. Convolutional Neural Networks analyze large amounts of data in order to recognize and extract actionable insights for clients. Using the Deep Learning AMI and TensorFlow, SCDM was able to build a solution in less than 3 months. https://aws.amazon.com/de/solutions/case-studies/SCDM/
64. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. AWS DeepLens Deep Learning-enabled video camera for developers NEW
65. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Object detection with AWS DeepLens
66. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. FRAMEWORKS AND INTERFACES PLATFORM SERVICES APPLICATION SERVICES Amazon Rekognition Amazon Polly Amazon Lex Democratization of ML Amazon Rekognition Video Amazon Transcribe Amazon Comprehend Amazon SageMaker AWS DeepLens Amazon EMR Deep Learning AMI Amazon Translate
67. Thank you Julio Faerman Technical Evangelist @julioaws