© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Using Machine Learning for Serverless Analytics Danilo Poccia Principal Evangelist, Serverless AWS @danilop

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T What is serverless? No infrastructure provisioning, no management Automatic scaling Pay for value Highly available and secure

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T More machine learning happens on AWS than anywhere else

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T FRAMEWORKS AND INTERFACES ML for data scientists KERAS Frameworks Interfaces APPLICATION SERVICES ML for everyone PLATFORM SERVICES ML for engineers NVIDIA Tesla V100 GPUs (14x faster than P2) Machine Learning AMIs INFRASTRUCTURE Powering the ML Intel Xeon Skylake (Optimized for ML) A W S G R E E N G R A S S M L L E X P O L L Y R E K O G N I T I O N I M A G E & V I D E O T R A N S C R I B E T R A N S L A T E C O M P R E H E N D F O R E C A S T P E R S O N A L I Z E A M A Z O N S A G E M A K E R A W S D E E P L E N S S A G E M A K E R G R O U N D T R U T H & M E C H A N IC A L T U R K S P A R K & E M R

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Can I build a completely serverless data analytics platform? Can I process both batch and streaming data? Can I use Machine Learning to get insights from data? What about text, audio, images, and videos?

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS IoT Core

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS IoT Core S3 Bucket • Validate syntax • Enrich data • External lookups • DynamoDB Table • RDS Database • Anything, it’s your code!

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Integrated Data Catalog • Automatic schema discovery • Code generation • Developer endpoints • Flexible job scheduler

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Analyze data in Amazon S3 using standard SQL • There is no infrastructure to manage • You pay only for the queries that you run

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Self-service business intelligence (BI) • Deliver rich, interactive dashboards for your readers • Pay-per-session pricing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Firehose S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose • Capture • Transform • Load data streams • Process data streams in real time with SQL and Java (Apache Flink) • Sliding windows • Tumbling windows • Use built-in functions that are optimized for stream processing • Anomaly detection • Top-K analysis • Process or analyze streaming data

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Video Stream Kinesis Video Stream AWS IoT Core Custom Processing Securely stream video from connected devices to AWS for analytics, machine learning (ML), and other processing Kinesis Video Producer SDK • Gstreamer-plugin, • Docker images for Ubuntu, MacOS, and Raspberry Pi • Kinesis Video Streams applications get data, such as fragments and frames, from a Kinesis video stream to view, process, or analyze it • Get media with low-latency using the Kinesis Video Stream Parser Library Serverless But you may need it :)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics AWS IoT Analytics IoT Device AWS IoT Core • Standard SQL queries • Run time-series analyses • Cleans false readings • Fill gaps in the data • Perform mathematical transformations of message data • Use Lambda functions to enrich your device data from external sources

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Custom Processing Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Outside of AWS S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Video Stream IoT Device AWS IoT Core AWS Greengrass Outside of AWS • Local compute (Lambda functions) • Messaging • Data caching • Synchronize data • ML inference Connected devices

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Custom Processing Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Outside of AWS S3 Bucket

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Machine Learning Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Outside of AWS Text Scanned Document S3 Bucket Custom Models Machine Learning

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon SageMaker AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Amazon Translate Amazon Textract Outside of AWS Text Scanned Document S3 Bucket Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon SageMaker Amazon Translate Amazon Textract Text Scanned Document Custom Models • Dominant language • Entities • Key Phrases • Sentiment • Topic Modeling • Transcribe to text • Labels • Faces • Celebrities • Moderation • Text • Tracking • Extracts text and data • Built-in algorithms • Your own algorithms • Marketplace for algorithms and models Same Lambda function for all formats, or different Lambda functions using object key name filtering (e.g. by suffix) • Translate to common languages

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon SageMaker Amazon Translate Amazon Textract Text Scanned Document Custom Models Built-in algorithms • Linear Learner • Factorization Machines • XGBoost Algorithm • Image Classification Algorithm • Sequence to Sequence (seq2seq) • K-Means Algorithm • Principal Component Analysis (PCA) • Latent Dirichlet Allocation (LDA) • Neural Topic Model (NTM) • DeepAR Forecasting • BlazingText • Random Cut Forest • … Your own algorithms • TensorFlow • Apache MXNet • Chainer • PyTorch • Apache Spark • … AWS Marketplace • Algorithms • Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon SageMaker AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Amazon Translate Amazon Textract Outside of AWS Text Scanned Document S3 Bucket Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon SageMaker AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Amazon Translate Amazon Textract Outside of AWS Text Scanned Document S3 Bucket Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon SageMaker AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Amazon Forecast Amazon Personalize Amazon Translate Amazon Textract Outside of AWS Text Scanned Document S3 Bucket Custom Models

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Amazon Forecast Amazon Personalize S3 Bucket Time-series forecasting Real-time personalization and recommendation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Rekognition Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon SageMaker AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Amazon Forecast Amazon Personalize Amazon Translate Amazon Textract Outside of AWS Text Scanned Document S3 Bucket Custom Models Notebook

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Lots is taken care of Security Monitoring Scalability Availability Cost Optimization

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Use only the tools you need Batch or Real-time or IoT Images or Text Social Media Sentiment Analysis …

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Data Format Optimization Partitioning Compression Columnar Formats (Parquet, ORC)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T It’s not just Serverless Amazon Redshift & Redshift Spectrum Amazon Elastic MapReduce (EMR) & Apache Spark Amazon SageMaker & Jupiter Notebooks

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Database Freedom Graph – Amazon Neptune Time Series – Amazon Timestream Ledger – Amazon Quantum Ledger Database (QLDB)

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T Demo Files S3 Bucket Amazon Rekognition Amazon Comprehend Amazon Transcribe Text Audio Image Video Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) Amazon Translate Amazon Textract Text Scanned Document S3 Bucket

Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Danilo Poccia @danilop