Alex Casalboni Technical Evangelist, AWS @alex_casalboni @ 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved Building smart applications with conversational interfaces and language services on AWS

About me • Software Engineer & Web Developer • Data Science background • Startup experience for 4+ years • AWS Customer since 2013

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Myth: AI is dark magic

AI Machine Learning Deep Learning What are we talking about?

The Advent of AI Data GPUs & Acceleration Cloud Computing Algorithms

How to ”build” intelligence?

Data Visualization & Analysis Business Problem – ML problem framing Data Collection Data Integration Data Preparation & Cleaning Feature Engineering Model Training & Parameter Tuning Model Evaluation Are Business Goals met? Model Deployment Monitoring & Debugging Yes No Data Augmentation Feature Augmentation The AI Process Re-training Predictions

Where to look at in your organisation ? Where data is being analyzed to help making decisions: • Sales • Marketing • Social media • Customer supports  • Logs

No content

“Data is gold”

Pro-tips Make it ridiculously easy to collect and store any type of data. One line of code should be all it takes for anyone in the company to start collecting and storing new data points Make data ingestion cheap and highly scalable with managed services such as Amazon Kinesis Make data aggregation and exploration easy and accessible to everyone with services such as Amazon Athena and Amazon Quicksight

ML @ Amazon

No content

No content

No content

No content

Where do you start? The Low Hanging Fruits

Put machine learning in the hands of every developer Our mission

Some of our machine learning customers…

M L F R A M E W O R K S & I N F R A S T R U C T U R E Amazon ML Stack A I S E R V I C E S R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X R E K O G N I T I O N V I D E O Vision Speech Chatbots A M A Z O N S A G E M A K E R B U I L D T R A I N F O R E C A S T T E X T R A C T P E R S O N A L I Z E D E P L O Y M L O P S & A L G O S F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e E C 2 P 3 & P 3 d n E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C I N F E R E N C E Language Forecasting Recommendations NEW NEW NEW NEW

Language capabilities Vision (OCR) Speech-to-Text (STT) Text-to-Speech (TTS) Natural Language Understanding Language Translation Chatbot Interface

Language capabilities on AWS Vision (OCR) Speech-to-Text (STT) Text-to-Speech (TTS) Natural Language Understanding Language Translation Chatbot Interface Amazon Rekognition & Textract Amazon Transcribe Amazon Polly Amazon Comprehend Amazon Translate Amazon Lex

How do you let your applications see the world? Amazon Rekognition Amazon Textract

Image and Video Analysis

Optical Character Recognition (OCR)

Amazon Textract – OCR++

Textract – How it works

How do you give your applications a voice? Amazon Polly

Amazon Polly “Good morning! My name is…” Text-to-speech (TTS) ! " # $

Polly • Content creation • Mobile & desktop applications • Internet of Things (IoT) • Education & e-learning • Telephony • Game development Use cases • 58 voices across 28 languages • Lip-syncing & text highlighting • Fine-grained voice control • Custom vocabularies • Available in 18 AWS Regions Key features

“With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo

How do you make your applications listen? Amazon Transcribe

“Hi, how are you?” Amazon Transcribe Speech-to-text (STT)

English Italian French Spanish Portuguese New! Supported languages

Use cases Call centers Subtitles for VOD Broadcast closed captions Transcribe meetings

How do you extract insights from unstructured text? Amazon Comprehend

Sentiment Entities Languages Keyphrases Topic modeling Syntax Natural Language Understanding (NLU)

English Italian French German Portuguese New! Supported Languages

« Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” Matt Fryer, VP and Chief Data Science Officer, Hotels.com

Comprehend Medical Extract health information from patient notes clinical trial reports electronic health records

Comprehend Medical

How do you make your applications multilingual? Amazon Translate

Supported languages Arabic Simplified Chinese French German Spanish Portuguese Japanese Traditional Chinese Italian Russian Turkish Czech (417 translation combinations) Danish Dutch Finnish Swedish Polish Hebrew

Think high volume and time-sensitive data Share of worldwide digital content Machine translation • User-authored content • Text Analytics • Real-time communication • Content discovery Post-edited machine translation • Legal documents • Healthcare documents • Advertising materials

How do you make your applications conversational? Amazon Translate

Amazon Lex End to End Speech to Intent ASR+NLU integrated into one API Dialog Management Native support & maintains context Text to Speech Amazon Polly integrated into API Business Logic Native integration with AWS Lambda Deployment One click deployment Security Encrypted data in transit & at rest Scale Completely managed service Analytics Monitor and improve End to End

No content

Demo time!

Alex Casalboni Technical Evangelist, AWS @alex_casalboni @ 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved Thank you!