AWS Containerized and Serverless services for running enterprise code at scale

Transcript

1. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential 1 | © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AWS Container and Serverless services for running enterprise code at scale Carmen Puccio, Principal Solutions Architect, AWS
2. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential The new normal: companies are increasingly global and products are increasingly digital 47% of CEOs said they are being challenged by the board of directors to make progress in digital business Source: Gartner 79% of CIOs believe that digital business is making their IT organizations better prepared to change 67% of all business leaders believe that they must pick up the pace of digitalization to remain competitive
3. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential To maintain competitive advantage, digital businesses must innovate as rapidly as possible Feedback Ideas Experiment Innovation Flywheel
4. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS customers are pioneering modern applications reduced overall compute costs by 95% releases over 50+ deployments per hour created a stock trade validation system in 3 months cut processing time from 36 hours to 10 seconds
5. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential What changes have to be made in this new world? Architectural patterns Operational model Software delivery
6. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Changes to the architectural patterns
7. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential When the impact of change is small, release velocity can increase Monolith Does everything Microservices Do one thing
8. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Mobile client Client IoT Microservices architectures API Gateway Account DB Shipping DB Inventory DB Store Front Web App Account Lookup Shipment Query Inventory Query
9. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Cloud-native architectures are small pieces, loosely joined
10. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Changes to the operational model
11. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Isn’t all of this very hard now that we have lots of pieces to operate?
12. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS operational responsibility models On-Premises Cloud Less More Compute Virtual Machine EC2 Elastic Beanstalk AWS Lambda Fargate Databases MySQL MySQL on EC2 RDS MySQL RDS Aurora Aurora Serverless DynamoDB Storage Storage S3 Messaging ESBs Amazon MQ Kinesis SQS / SNS Analytics Hadoop Hadoop on EC2 EMR Elasticsearch Service Athena
13. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential What is serverless? No infrastructure provisioning, no management Automatic scaling Pay for value Highly available and secure
14. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS Lambda AWS Fargate Amazon API Gateway Amazon SNS Amazon SQS AWS Step Functions COMPUTE DATA STORES INTEGRATION Amazon Aurora Serverless Amazon S3 Amazon DynamoDB AWS AppSync
15. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Changes to the delivery of software
16. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential How do I develop and deploy code in a serverless microservices architecture?
17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Microservice development lifecycle developers services monitor release test build delivery pipelines monitor release test build monitor release test build monitor release test build monitor release test build monitor release test build
18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Best practices (microservices, 2 pizza teams) (governance, templates)
19. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers are the best on ramp towards modern applications
20. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Why are enterprises adopting containers? • Accelerate software development • Build modern applications • Automate operations at web scale © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
21. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Make AWS the BEST PLACE to run ANY containerized applications © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
22. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Helping customers scale containers 450+% growth Hundreds of millions of containers started each week of millions of container instances
23. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Why customers love AWS container services Containers are a first-class citizen of the AWS Cloud Deeply integrated with AWS Security and Compliance Broad selection of compute instances and IAM security, VPC networking, load balancing, and autoscaling ISO, HIPPA, PCI, SOC1, SOC2, SOC3 Infocomm Media Development Auth. DevOps Workflow Best place to build and operate a complete DevOps workflow for containers—AWS DevTools and Cloud9 DEV OPS
24. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Typical use cases • Microservices: Java, Node.js, Go, Web Apps, etc. • Continuous Integration and Continuous Deployment (CICD) • Batch Processing and ETL jobs • Common PaaS Stack for Application Deployment • Legacy Application Migration to the Cloud • Hybrid Workloads • AI/ML • Scale Testing • Backend for IoT use cases
25. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS container services landscape Management Deployment, Scheduling, Scaling & Management of containerized applications Hosting Where the containers run Amazon Elastic Container Service Amazon Elastic Container Service for Kubernetes Amazon EC2 AWS Fargate Image Registry Container Image Repository Amazon Elastic Container Registry
26. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon Elastic Container Service
27. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Scheduling and Orchestration Cluster Manager Placement Engine ECS
28. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential McDonald’s Home Delivery: Why Amazon ECS? Speed to market Scalability and reliability Security DevOps—CI / CD Monitoring
29. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS Fargate
30. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Without Fargate, you end up managing more than just containers EC2 Instance ECS Agent Docker Agent OS
31. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential - Patching and Upgrading OS, agents, etc. - Scaling the instance fleet for optimal utilization
32. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon Elastic Container Service
33. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon Elastic Container Service AWS Fargate run serverless containers
34. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Your containerized applications Managed by AWS No EC2 Instances to provision, scale or manage Elastic Scale up & down seamlessly. Pay only for what you use Integrated with the AWS ecosystem: VPC Networking, Elastic Load Balancing, IAM Permissions, CloudWatch and more AWS Fargate
35. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Fully managed container environment with AWS ECS + Fargate Bring existing code Production ready Powerful integrations No changes required of existing code, works with existing workflows and microservices built on Amazon ECS ISO, PCI, HIPAA, SOC compliant. Launch ten or tens of thousands of containers in seconds in 9 global regions (+7 in 2018) Native AWS integrations for networking, security, CICD, monitoring, and tracing Fargate runs tens of millions of containers for AWS customers every week
36. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential migrated ~850 applications running in ~5000 containers to Fargate to reduce the undifferentiated heavy lifting that came with managing Kubernetes
37. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS Fargate customers ”We don't want to babysit any clusters. That has nothing to do with us” Shimon Tolts CTO, DATREE “We moved to Fargate because we need the ability to scale quickly up from baseline and get fine-grained network control, without having to manage our own infrastructure” Product Hunt
38. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon Elastic Container Service for Kubernetes
39. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Open source container management platform Helps you run containers at scale Gives you primitives for building modern applications What is Kubernetes?
40. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Community, contribution, choice
41. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential But where you run Kubernetes matters Quality of the cloud platform Quality of the applications Your users
42. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential —CNCF survey
43. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential mycluster.eks.amazonaws.com Availability Zone 1 Availability Zone 2 Availability Zone 3 Kubectl
44. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential EKS is Kubernetes certified
45. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential How are customer using Amazon EKS? Microservices PaaS Platform-as-a-Service Enterprise App Migration Machine Learning
46. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Customers adopting Kubernetes on AWS
47. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Customer example: Snap 100% on Kubernetes in the cloud Moving core messaging architecture to AWS and EKS Currently monolithic, breaking this into SOA and microservices “Undifferentiated Heavy Lifting is work that we have to do that doesn’t directly benefit our customers. It’s just work. EKS frees us up to worry about delivering customer value and allows developers without operational experience to innovate without having to know where their code runs.” More detailed talk: AWS New York Summit 2018 - Run Kubernetes with Amazon EKS (SRV318)
48. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon container services AWS Fargate
49. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential New: AWS Cloud Map Service discovery for all your cloud resources Constantly monitor the health of every resource Dynamically update the location of each microservice Increase developer productivity Single registry for all app resources Define resources with user-friendly names Integration with Amazon container services AWS Fargate Amazon ECS Amazon EKS AWS Cloud Map
50. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential New: AWS App Mesh Observability & traffic control Easily export logs, metrics, and traces Client side traffic policies—circuit breaking, retries Routes for deployments Works across clusters and container services Amazon ECS Amazon EKS Kubernetes on EC2 AWS Fargate (coming soon!) AWS built and run No control plane to manage Ease of operations High scale
51. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential THANK YOU https://aws.amazon.com/containers