Containers on AWS, presented by Julien Simon at AWS Sofia 2018

An overview of container services available on AWS: Amazon Elastic Container Service (ECS), Amazon ECS for Kubernetes (EKS) and Amazon Fargate

http://aws.techhuddle.com

Transcript

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers on AWS: State of the Union Julien Simon Principal Technical Evangelist @julsimon
2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are people building with containers on AWS?
3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Short answer: everything!
4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. We started in 2014
5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Customers running Docker on EC2 from the very beginning...
6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. But there were pain points. Things like scheduling, placing, managing and deploying containers were difficult. They wanted something to make those pain points better.
7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. So we built ECS Highly scalable, high performance container management system A managed platform ECS Cluster management Container orchestration Deep AWS integration
8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. So we built ECS Highly scalable, high performance container management system ECS AWS VPC networking mode Advanced task placement Deep integration with AWS platform ECS CLI … { } Global footprint Powerful scheduling engines Auto scaling CloudWatch metrics Load balancers
9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ECS helps customers scale containers 450+% growth Hundreds of millions of containers started each week Millions of container instances
10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Europe's leading app for ordering taxis Majority of services on ECS
11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 10+ million users with 45,000+ taxis across 40+ cities. With the microservice architecture (140+ services) built on AWS, mytaxi can provide new features to users faster than ever before. Running entirely on Spot. ECS
12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. „In November 2015 we moved our Docker container architecture to Amazon ECS, and for the first time ever in December we were able to celebrate a new year in which our system could handle the huge number of requests without any crashes or interruptions.“ -Sebastian Herzberg, System Engineer
13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building an Ecosystem
14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEMO
15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Not the only way to run containers in production… More customers running Kubernetes on AWS than anywhere else.
16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. UK FinTech startup Kubernetes on AWS
17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. More than 350 microservices Kubernetes on EC2
18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Multi-master Hundreds of workers Highly-available backing store of etcd High availablity at every level
19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Deploying Kubernetes in a highly available configuration on AWS is not for the faint of heart and requires you to get familiar with its internals, but we are very pleased with the results”
20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Run Kubernetes for me”
22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. So we built EKS Platform for enterprises to run production-grade Kubernetes-grade installations EKS Managed and upstream experience Seamless, native integration with AWS services Contributes back to open source community
23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Run my containers for me”
24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers are great! ...but they’re a lot of heavy lifting!
25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Fargate No cluster or infrastructure to manage or scale Everything is handled at the container level Scale seamlessly on demand Underlying technology for container management
26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What does Fargate mean? Not worrying about scaling, underlying infrastructure, cluster resources, capacity, setup. Just give it a task definition or pod (in 2018), set some resource limits, and away you go.
27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How does this work in practice? Two launch types for ECS and EKS: • EC2 (traditional, manage your cluster infrastructure) • Fargate
28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Focus on your workload first.
29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How everyone thinks about compute is changing.
30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. First: treat containers as a fundamental, compute primitive.
31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Now: treat TASKS as a fundamental, compute primitive.
32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. IAM Roles for Tasks Task Auto Scaling Task Load Balancers Task Networking
33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. So what does all of this mean for you?
34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Bottom line: Lots of options for running containers on AWS
35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. OK, so why do you want options? • Options are good! They make the community stronger. • Use what works for you, all choices are good! Use what you can manage. • Containers support polyglot architectures. Build in the language, choose the tool/orchestration platform that works for YOU.
36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Make AWS the BEST PLACE to run ANY containerized applications © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What does the landscape look like all together? Amazon ECS (available now) Amazon EKS (preview) Fargate mode for ECS (available now) Fargate mode for EKS (available 2018)
38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Let’s compare.
39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ECS Easiest way to deploy and manage containers Integration with entire AWS platform ALB, Auto Scaling, Batch, Elastic Beanstalk, CloudFormation, CloudTrail, CloudWatch Events, CloudWatch Logs, CloudWatch Metrics, ECR, EC2 Spot, IAM, NLB, Parameter Store, and VPC Scales to support clusters of any size Service integrations (like ALB and NLB) are at container level 1 2 3
40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FULL CD WITH AWS CODEPIPELINE AWS CodeCommit AWS CodeBuild Amazon ECR Amazon ECS Source Repository Build Deploy or or AWS CodePipeline Store Image
41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Managed Service Discovery Applications invoked by name Automatically resolved to IP or port Native to Amazon ECS services No infrastructure to manage
42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What we did with ECS in 2017 Container access to environmental metadata Network Load Balancer support Console support for SpotFleet Override parameters for RunTask and StartTask APIs Task Elastic Network Interface Application Load Balancer Support HIPAA eligibility Console UX improvements CLI V1.0 Container instance draining Windows containers Cron and Cloudwatch Event Task scheduling Support for Docker Privileged Mode Lifecycle Policies for container images Beijing Region Support for Device and Init flags Add attributes during boot Seoul Region Linux capabilities
43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS Managed Kubernetes on AWS Highly available Automated version upgrades Integration with other AWS services Etcd Master Managed Kubernetes control plane CloudTrail, CloudWatch, ELB, IAM, VPC, PrivateLink
44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fargate Launch quickly Scale easily No infrastructure Resource based pricing Containers on demand Manage everything at container level
45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What’s next?
46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How can I get started? • ECS: https://aws.amazon.com/ecs/ • Fargate: https://aws.amazon.com/fargate/ • EKS preview: https://aws.amazon.com/eks/ • Blogs: • https://aws.amazon.com/blogs/aws/aws-fargate/ • https://aws.amazon.com/blogs/aws/amazon-elastic-container-service-for- kubernetes/
47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you! Julien Simon Principal Technical Evangelist @julsimon