AWS re:Invent 2019 re:Cap Tour

Transcript

1. Antje Barth Sr. Developer Advocate, AI & Machine Learning Amazon Web Services @anbarth
2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda • Improving the Developer Experience • Compute • Storage • AI/ML • Database & Analytics • Networking • Security • Extending AWS beyond the Region
7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
8. Improving the Developer Experience
9. L E A R N M O R E SVS401 - Optimizing your serverless applications Provisioned Concurrency on AWS Lambda New Feature • Keeps functions initialized and hyper-ready, ensuring start times stay in the milliseconds • Builders have full control over when provisioned concurrency is set • No code changes are required to provision concurrency on functions in production • Can be combined with AWS Auto Scaling at launch DRAFT Serverless General Availability – December 3
10. Achieve up to 67% cost reduction and 50% latency reduction compared to REST APIs. HTTP APIs are also easier to configure than REST APIs, allowing customers to focus more time on building applications. Reduce application costs by up to 67% Reduce application latency by up to 50% Configure HTTP APIs easier and faster than before HTTP APIs for Amazon API Gateway Introducing DRAFT Mobile Services Preview – December 4 L E A R N M O R E CON213-L - Leadership session: Using containers and serverless to accelerate modern application development (incl schema registry demo)
11. AWS Step Functions Express Workflows Introducing Orchestrate AWS compute, database, and messaging services at rates greater than 100,000 events/second, suitable for high-volume event processing workloads such as IoT data ingestion, streaming data processing and transformation. DRAFT App Integration General Availability – December 3 L E A R N M O R E API321: Event-Processing Workflows at Scale with AWS Step Functions
12. Amplify for iOS & Android Introducing DRAFT Mobile Services General Availability – December 3 Open source libraries and toolchain that enable mobile developers to build scalable and secure cloud powered serverless applications. L E A R N M O R E MOB317 - Speed up native mobile development with AWS Amplify
13. Amplify DataStore New Feature DRAFT Mobile Services General Availability – December 3 Multi-platform (iOS/Android/React Native/Web) on-device persistent storage engine that automatically synchronizes data between mobile/web apps and the cloud using GraphQL. L E A R N M O R E MOB402: Build data-driven mobile and web apps with AWS AppSync
14. Compute
15. Amazon EC2 Inf1 Instances Introducing The fastest and lowest cost machine learning inference in the cloud Featuring AWS Inferentia, the first custom ML chip designed by AWS Inf1 delivers up to 3X higher throughput and up to 40% lower cost per inference compared to GPU powered G4 instances Compute General Availability – December 3 L E A R N M O R E CMP324-R: Deliver high performance ML inference with AWS Inferentia Natural language processing Personalization Object detection Speech recognition Image processing Fraud detection
16. AWS Graviton2 Processor Introducing Enabling the best price/performance for your cloud workloads Graviton1 Processor Graviton2 Processor DRAFT Compute Preview – December 3 L E A R N M O R E CMP322-R: Deep dive on EC2 instances powered by AWS Graviton
17. AWS Graviton2 Based Instances Introducing Up to 40% better price-performance for general purpose, compute intensive, and memory intensive workloads. l M6g C6g R6g DRAFT Built for: General-purpose workloads such as application servers, mid-size data stores, and microservices Instance storage option: M6gd Built for: Compute intensive applications such as HPC, video encoding, gaming, and simulation workloads Instance storage option: C6gd Built for: Memory intensive workloads such as open-source databases, or in-memory caches Instance storage option: R6gd Compute Preview – December 3 L E A R N M O R E CMP322-R: Deep dive on EC2 instances powered by AWS Graviton
18. Amazon Braket Introducing Fully managed service that makes it easy for scientists and developers to explore and experiment with quantum computing. DRAFT Quantum Technology Preview – December 2 LEARN MORE CMP213: Introducing Quantum Computing with AWS
19. AWS Nitro Enclaves Introducing Create additional isolation to further protect highly sensitive data within EC2 instances Nitro Hypervisor Instance A Enclave A Instance B EC2 Host Additional isolation within an EC2 instance Isolation between EC2 instances in the same host Local socket connection DRAFT Compute Preview – December 3
20. AWS Compute Optimizer Introducing Identify optimal EC2 instances and Auto Scaling group with a ML- powered recommendation engine. Integrated with AWS Organizations. DRAFT Management Tools General Availability – December 3 LEARN MORE CMP323-R: Optimize performance and cost for your AWS compute
21. AWS Compute Optimizer
22. DRAFT Containers General Availability – December 3 LEARN MORE CON-326R - Running Kubernetes Applications on AWS Fargate Introducing The only way to run serverless Kubernetes containers securely, reliably, and at scale Amazon EKS for AWS Fargate
23. Spare capacity with savings up to 70% off of Fargate standard pricing Improved scalability, reduced operational cost to run containers Containers New Features Accelerating momentum for AWS container services
24. Build and maintain secure OS images more quickly & easily Introducing DRAFT Compute General Availability – December 3 EC2 Image Builder
25. AWS License Manager - Simplified Windows & SQL Server BYOL New Feature DRAFT Compute General Availability – December 1 • Bring your eligible Windows and SQL BYOL Licenses to AWS • Leverage existing licensing investments to save costs • Automate ongoing management of EC2 Dedicated Hosts Simplified Management Elasticity of EC2 for Dedicated Hosts with AWS License Manager Integration (New) Windows BYOL • B A • L • A LEARN MORE WIN201 - Leadership session: Five New Features of Microsoft and .NET on AWS that you want to learn
26. Introducing DRAFT Compute General Availability – December 1 Helps customers upgrade legacy applications to run on newer, supported versions of Windows Server without any code changes Future-proof Reduced risk Cost-effective Improved security posture on supported, new OS Isolate old runtimes Compliance with industry regulations No application refactoring or recoding cost No extended support costs Decouple from underlying OS Low risk of failure on subsequent OS updates Supports all OS version Reduced operating costs AWS End-of-support Migration Program for Windows Server
27. Storage
28. EBS Direct APIs for Snapshots Introducing A simple set of APIs that provide access to directly read EBS snapshot data, enabling backup providers to achieve up to 70% faster backups for EBS volumes at lower costs. Up to 70% faster backup times More granular recovery point objectives (RPOs) Lower cost backups Storage Easily track incremental block changes on EBS volumes to achieve: General Availability – December 3
29. Amazon S3 Access Points Introducing Simplify managing data access at scale for applications using shared data sets on Amazon S3. Easily create hundreds of access points per bucket, each with a unique name and permissions customized for each application. DRAFT General Availability – December 3 Storage
30. AI & Machine Learning
31. VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia (Inf1) FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW AWS Machine Learning stack NEW
32. AI Services
33. Pre:Invent highlights https://aws.amazon.com/about-aws/whats-new/machine-learning • Amazon Comprehend: 6 new languages • Amazon Translate: 22 new languages • Amazon Transcribe: 15 new languages, alternative transcriptions • Amazon Lex: SOC compliance, sentiment analysis, web & mobile integration with Amazon Connect • Amazon Personalize: batch recommendations • Amazon Forecast: use any quantile for your predictions With region expansion across the board!
34. Introducing Amazon Transcribe Medical Easy-to-Use Accurate Affordable
35. Introducing Amazon Rekognition Custom Labels • Import images labeled by Amazon SageMaker Ground Truth… • Or label images automatically based on folder structure • Train a model on fully managed infrastructure • Split the data set for training and validation • See precision, recall, and F1 score at the end of training • Select your model • Use it with the usual Rekognition APIs
36. A2I lets you easily implement human review in machine learning workflows to improve the accuracy, speed, and scale of complex decisions. Amazon Augmented AI (A2I)
37. How Amazon Augmented AI works Client application sends input data AWS AI Service or custom ML model makes predictions Results stored to your S3 1 2 6 4 Low confidence predictions sent for human review 3 High-confidence predictions returned immediately to client application 5 Reviews consolidated using A2I answer consolidation algorithms Client Application
39. Introducing Amazon Fraud Detector A fraud detection service that makes it easy for businesses to use machine learning to detect online fraud in real-time, at scale
40. Fraud Detection With ML Is Difficult Top data scientists are costly & hard to find One-size-fits-all models underperform Often need to supplement data Data transformation + feature engineering Fraud imbalance = needle in a haystack
41. Amazon Fraud Detector – Automated Model Building 1 2 4 5 Training data in S3 6 3
42. Use cases • Online identity fraud • Payment fraud for online orders • New account fraud, within an account sign-up process • Account takeover (when bad actors use stolen credentials to log in to a legitimate customer’s account) • Promotion code abuse • Seller performance evaluations in online marketplaces
43. Introducing Contact Lens For Amazon Connect Theme detection Built-in automatic call transcription Automated contact categorization Enhanced Contact Search Real-time sentiment dashboard and alerting Presents recurring issues based on Customer feedback Identify call types such as script compliance, competitive mentions, and cancellations. Filter calls of interest based on words spoken and customer sentiment View entire call transcript directly in Amazon Connect Quickly identify when customers are having a poor experience on live calls Easily use the power of machine learning to improve the quality of your customer experience without requiring any technical expertise
45. Introducing AWS CodeGuru Built-in code reviews with intelligent recommendations Detect and optimize expensive lines of code before production Easily identify latency and performance improvements production environment CodeGuru Reviewer CodeGuru Profiler
46. CodeGuru Reviewer: How It Works Input: Source Code Feature Extraction Machine Learning Output: Recommendations Customer provides source code as input Java AWS CodeCommit Github Extract semantic features / patterns ML algorithms identify similar code for comparison Customers see recommendations as Pull Request feedback
47. CodeGuru Example – Looping vs Waiting do { DescribeTableResult describe = ddbClient.describeTable(new DescribeTableRequest().withTableName(tableName)); String status = describe.getTable().getTableStatus(); if (TableStatus.ACTIVE.toString().equals(status)) { return describe.getTable(); } if (TableStatus.DELETING.toString().equals(status)) { throw new ResourceInUseException("Table is " + status + ", and waiting for it to become ACTIVE is not useful."); } Thread.sleep(10 * 1000); elapsedMs = System.currentTimeMillis() - startTimeMs; } while (elapsedMs / 1000.0 < waitTimeSeconds); throw new ResourceInUseException("Table did not become ACTIVE after "); This code appears to be waiting for a resource before it runs. You could use the waiters feature to help improve efficiency. Consider using TableExists, TableNotExists. For more information, see https://aws.amazon.com/blogs/developer/waiters-in-the-aws-sdk-for-java/ Recommendation Code We should use waiters instead - will help remove a lot of this code. Developer Feedback
48. CodeGuru Profiler – Example
49. Introducing Kendra Easy to find what you are looking for Fast search, and quick to set up Native connectors (S3, Sharepoint, file servers, HTTP, etc.) Natural language Queries NLU and ML core Simple API and console experiences Code samples Incremental learning through feedback Domain Expertise
50. Ask intuitive questions Natural language queries Keyword queries
51. Kendra connectors …and more coming in 2020
52. Domain Expertise Optimized for 16 major domains More domains planned for 2020
54. Break
55. VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia (Inf1) FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW AWS Machine Learning stack NEW
56. ML Services
57. Pre:Invent highlights https://aws.amazon.com/about-aws/whats-new/machine-learning • Invoke Amazon SageMaker models in Amazon Quicksight • Invoke Amazon SageMaker models in Amazon Aurora • Deploy many models on the same Amazon SageMaker endpoint
58. Fully managed infrastructure in SageMaker Introducing Amazon SageMaker Operators for Kubernetes Kubernetes customers can now train, tune, & deploy models in Amazon SageMaker
59. Machine learning is iterative involving dozens of tools and hundreds of iterations Multiple tools needed for different phases of the ML workflow Lack of an integrated experience Large number of iterations Cumbersome, lengthy processes, resulting in loss of productivity + + =
60. Introducing Amazon SageMaker Studio The first fully integrated development environment (IDE) for machine learning Organize, track, and compare thousands of experiments Easy experiment management Share scalable notebooks without tracking code dependencies Collaboration at scale Get accurate models for with full visibility & control without writing code Automatic model generation Automatically debug errors, monitor models, & maintain high quality Higher quality ML models Code, build, train, deploy, & monitor in a unified visual interface Increased productivity
62. Introducing Amazon SageMaker Notebooks Access your notebooks in seconds with your corporate credentials Fast-start shareable notebooks Administrators manage access and permissions Share your notebooks as a URL with a single click Dial up or down compute resources Start your notebooks without spinning up compute resources
64. Introducing Amazon SageMaker Experiments Experiment tracking at scale Visualization for best results Flexibility with Python SDK & APIs Iterate quickly Track parameters & metrics across experiments & users Organize experiments Organize by teams, goals, & hypotheses Visualize & compare between experiments Log custom metrics & track models using APIs Iterate & develop high- quality models A system to organize, track, and evaluate training experiments
66. Automatic data analysis Relevant data capture Automatic error detection Improved productivity with alerts Visual analysis and debug Introducing Amazon SageMaker Debugger Analyze and debug data with no code changes Data is automatically captured for analysis Errors are automatically detected based on rules Take corrective action based on alerts Visually analyze & debug from SageMaker Studio Analysis & debugging, explainability, and alert generation
68. Introducing Amazon SageMaker Autopilot Quick to start Provide your data in a tabular form & specify target prediction Automatic model creation Get ML models with feature engineering & automatic model tuning automatically done Visibility & control Get notebooks for your modelswith source code Automatic model creation with full visibility & control Recommendations & Optimization Get a leaderboard & continue to improve your model
70. Introducing Amazon SageMaker Model Monitor Automatic data collection Continuous Monitoring CloudWatch Integration Data is automatically collected from your endpoints Automate corrective actions based on Amazon CloudWatch alerts Continuous monitoring of models in production Visual Data analysis Define a monitoring schedule and detect changes in quality against a pre-defined baseline See monitoring results, data statistics, and violation reports in SageMaker Studio Flexibility with rules Use built-in rules to detect data drift or write your own rules for custom analysis
72. Ground Truth Algorithms & Frameworks Collaborative notebooks Experiments Distributed Training & Debugger Deployment, Monitoring, & Hosting SageMaker AutoPilot Build, Train, Deploy Machine Learning Models Quickly at Scale Reinforcement Learning Tuning & Optimization SageMaker Studio Marketplace for ML Amazon SageMaker
73. AWS DeepRacer improvements • AWS DeepRacer Evo • Stereo camera • LIDAR sensor • New racing opportunities • Create your own races • Object Detection & Avoidance • Head-to-head racing
74. AWS DeepComposer • MIDI keyboard to experiment with music generation using ML • Compose music using Generative Adversarial Networks (GAN) • Use a pretrained model, or train your own
75. Databases & Analytics
76. Amazon Managed Apache Cassandra Service Introducing A scalable, highly available, and serverless Apache Cassandra–compatible database service. Run your Cassandra workloads in the AWS cloud using the same Cassandra application code and developer tools that you use today. Apache Cassandra- compatible Performance at scale Highly available and secure No servers to manage DRAFT Databases Preview – December 3 LEARN MORE DAT324: Overview of Amazon Managed Apache Cassandra Service
77. Amazon RDS Proxy Introducing Fully managed, highly available database proxy feature for Amazon RDS. Pools and shares connections to make applications more scalable, more resilient to database failures, and more secure. DRAFT Databases Public Beta – December 3 LEARN MORE DAT368: Setting up database proxy servers with RDS Proxy
78. UltraWarm for Amazon Elasticsearch Service Introducing A low cost, scalable warm storage tier for Amazon Elasticsearch Service. Store up to 10 PB of data in a single cluster at 1/10th the cost of existing storage tiers, while still providing an interactive experience for analyzing logs. DRAFT Analytics Public Beta – December 3 LEARN MORE ANT229: Scalable, secure, and cost-effective log analytics
79. DRAFT Analytics Amazon Redshift RA3 instances with Managed Storage Optimize your data warehouse costs by paying for compute and storage separately General Availability – December 3 L E A R N M O R E ANT213-R1: State of the Art Cloud Data Warehousing ANT230: Amazon Redshift Reimagined: RA3 and AQUA Delivers 3x the performance of existing cloud DWs 2x performance and 2x storage as similarly priced DS2 instances (on-demand) Automatically scales your DW storage capacity Supports workloads up to 8PB (compressed) COMPUTE NODE (RA3/i3en) SSD Cache S3 STORAGE COMPUTE NODE (RA3/i3en) SSD Cache COMPUTE NODE (RA3/i3en) SSD Cache COMPUTE NODE (RA3/i3en) SSD Cache Managed storage $/node/hour $/TB/month Introducing
80. AQUA (Advanced Query Accelerator) for Amazon Redshift Introducing Redshift runs 10x faster than any other cloud data warehouse without increasing cost DRAFT Analytics Private Beta – December 3 LEARN MORE ANT230: Amazon Redshift Reimagined: RA3 and AQUA AQUA brings compute to storage so data doesn't have to move back and forth High-speed cache on top of S3 scales out to process data in parallel across many nodes AWS designed processors accelerate data compression, encryption, and data processing 100% compatible with the current version of Redshift S3 STORAGE AQUA ADVANCED QUERY ACCELERATOR RA3 COMPUTE CLUSTER
81. Amazon Redshift Federated Query Analyze data across data warehouse, data lakes, and operational database New Feature DRAFT Analytics Public Beta – December 3 LEARN MORE ANT213-R1: State of the Art Cloud Data Warehousing
82. Amazon Redshift Data Lake Export New Feature No other data warehouse makes it as easy to gain new insights from all your data. DRAFT Analytics General Availability – December 3 LEARN MORE ANT335R: How to build your data analytics stack at scale with Amazon Redshift
83. Networking
84. Existing Service DRAFT Networking Scale connectivity across thousands of Amazon VPCs, AWS accounts, and on-premises networks Amazon VPC Amazon VPC Amazon VPC Amazon VPC Customer gateway VPN connection AWS Direct Connect Gateway L E A R N M O R E NET203-L Leadership Session Networking AWS Transit Gateway
85. New Feature AWS Transit Gateway Inter-Region Peering General Availability – December 3 DRAFT Networking AWS TRANSIT GATEWAY Inter-Region Peering Build global networks by connecting transit gateways across multiple AWS Regions L E A R N M O R E NET203-L Leadership Session Networking
86. AWS Transit Gateway Network Manager Introducing General Availability – December 3 DRAFT Networking L E A R N M O R E NET212 - AWS Transit Gateway Network Manager
87. AWS Transit Gateway Network Manager
88. New Feature Transit Gateway Multicast General Availability – December 3 DRAFT Networking Build and deploy multicast applications in the cloud L E A R N M O R E NET203-L Leadership Session Networking
89. New Feature Amazon VPC Ingress Routing General Availability – December 3 DRAFT Networking Route inbound and outbound traffic through a third party or AWS service L E A R N M O R E NET203-L Leadership Session Networking
90. Security
91. Amazon Detective Introducing Quickly analyze, investigate, and identify the root cause of security findings and suspicious activities. Automatically distills & organizes data into a graph model Easy to use visualizations for faster & effective investigation Continuously updated as new telemetry becomes available Preview – December 3 DRAFT Security LEARN MORE SEC312: Introduction to Amazon Detective
92. How Amazon Detective Works?
93. AWS IAM Access Analyzer Introducing Continuously ensure that policies provide the intended public and cross-account access to resources, such as Amazon S3 buckets, AWS KMS keys, & AWS Identity and Access Management roles. General Availability – December 2 DRAFT Security Uses automated reasoning, a form of mathematical logic, to determine all possible access paths allowed by a resource policy Analyzes new or updated resource policies to help you understand potential security implications Analyzes resource policies for public or cross-account access LEARN MORE SEC309: Deep Dive into AWS IAM Access Analyzer
94. Extending AWS beyond the Region
95. AWS Outposts Now Available Fully managed service that extends AWS infrastructure, AWS services, APIs, and tools to virtually any connected customer site. Truly consistent hybrid experience for applications across on-premises and cloud environments. Ideal for low latency or local data processing application needs. Same AWS-designed infrastructure as in AWS regional data centers (built on AWS Nitro System) delivered to customer facilities Fully managed, monitored, and operated by AWS as in AWS Regions Single pane of management in the cloud providing the same APIs and tools as in AWS Regions Compute General Availability – December 3 LEARN MORE CMP302-R: AWS Outposts: Extend the AWS experience to on-premises environments
97. Services supported on Outposts (additionally to EC2 & EBS)
98. Local Zones Introducing Extend the AWS Cloud to more locations and closer to your end-users to support ultra low latency application use cases. Use familiar AWS services and tools and pay only for the resources you use. DRAFT Compute General Availability – December 3 The first Local Zone to be released will be located in Los Angeles.
99. AWS Wavelength Introducing Embeds AWS compute and storage inside telco providers’ 5G networks. Enables mobile app developers to deliver applications with single-digit millisecond latencies. Pay only for the resources you use. DRAFT Compute Announcement – December 3
100. AWS Wavelength Introducing Embeds AWS compute and storage inside telco providers’ 5G networks. Enables mobile app developers to deliver applications with single-digit millisecond latencies. Pay only for the resources you use. DRAFT Compute Announcement – December 3
101. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
102. Here are all of the new launches! https://aws.amazon.com/new/reinvent
103. Go Build! Here to help you build
104. Thank you. Antje Barth Sr. Developer Advocate, AI & Machine Learning Amazon Web Services @anbarth