Containers Immersion Day - Austin, TX

Overview of the container landscape on AWS

Transcript

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Brent Langston, Sr Developer Advocate @brentContained Containers on AWS Let me count the ways
2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are containers and why are customers using them?
3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are containers? A container is an atomic, self-contained package of software that includes everything it needs to run (code, runtime, libraries, packages, etc.). A popular, widely-used container platform is Docker. More on that here: https://www.docker.com
4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why not VM’s? Server Host OS Hypervisor Guest OS Guest OS Guest OS Bins/libs Bins/libs Bins/libs App A App A App B Server Host OS Docker Engine Bins/libs Bins/libs App A App A App B App B App B App B
5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why are containers so popular? • Portable • Lightweight • Standardized • Easy to deploy • Along with containers, comes the “monolith to microservices” story: containers and microservices go hand in hand.
6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. First customers ran docker on EC2 +
7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Make this easier for us!”
8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Elastic Container Service
9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers made it easy to build and scale apps But management of thes systems where hard Amazon Elastic Container Service Cluster management as a hosted service
10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. We removed the pain points and heavy lifting • Scheduling • Placement • Task management (health checks) • Management control plane updates
11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ECS Highl y sca l a bl e, high perf o rm a nce co nta iner m a na gem ent sy stem A managed platform ECS Cluster management Container orchestration Deep AWS integration
12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Broad range of customers
13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “By taking advantage of Amazon ECS, we have the power to understand, manipulate, and manage our environment easily.” Zaven Boni DevOps Engineering Lead, GoPro
14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 70% Reduction in Compute Footprint
15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What we did with ECS in 2018 Route 53 Auto Naming Service Discovery Daemon Scheduling CLI Supports Docker Compose V3 ECS Agent Signed for Security Faster Launch Times SSM Parameter Support Configure shm-size and tmpfs Docker Container Health Checks Task metric & metadata endpoint Docker17.09
16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Registry
17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECR Container Registry • Fully Managed • Secure • Highly Available • Simplified Workflow
18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kubernetes – now GA
19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kubernetes
20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 57%of Kubernetes workloads run on AWS today — Cloud Native Computing Foundation
21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Make this easier for us!”
22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Native AWS Integrations.”
23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ”An Open Source Kubernetes Experience.”
24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. E L A S T I C C O N TA I N E R S E RV I C E F O R K U B E R N E T E S (EKS)
25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS is Kubernetes Certified
26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS P l a t f o r m f o r e n t e r p r i s e s t o r u n p r o d u c t i o n - g r a d e K u b e r n e t e s - g r a d e i n s t a l l a t i o n s EKS Managed and upstream experience Seamless, native integration with AWS services Contributes back to open source community
27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. mycluster.eks.amazonaws.com EKS Workers kubectl Amazon EKS AZ 1 AZ 2 AZ 3 Your AWS account
28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Semantic Versioning (semver) v1.10.0 Major Minor Patch Breaking Changes New Features Bug fixes Security
29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 1.9.1 1.9.2 Version 1.9 Version 1.10 Kubernetes Upgrades
30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Still managing workers/nodes is hard!
31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Make this easier for us!”
32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fargate
33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Fargate No cluster or infrastructure to manage or scale Everything is handled at the container level Scale seamlessly on demand Underlying technology for container management
34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What does Fargate mean? No worrying about scaling, service mesh, underlying infrastructure, cluster resources, capacity, setup. Just give it a task definition or pod (in 2019), set some resource limits, and away you go.
35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. With Fargate: focus on your workload (job, container, function, task) first. Full stop.
36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How does this work in practice? Two launch types for ECS and EKS: • EC2 (traditional, manage your cluster infrastructure) • Fargate
37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. TASK CPU MEMORY CONFIGURATIONS 50 different CPU/Memory configurations to choose from CPU Memory 256 (.25 vCPU) 512MB, 1GB, 2GB 512 (.5 vCPU) 1GB, 2GB, 3GB, 4GB 1024 (1 vCPU) 2GB, 3GB, 4GB, 5GB, 6GB, 7GB, 8GB 2048 (2 vCPU) Between 4GB and 16GB in 1GB increments 4096 (4 vCPU) Between 8GB and 30GB in 1GB increments
38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. PRICING Per-second billing. 1 minute minimum Pay for what you provision Billed for Task level CPU and Memory
39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. This is changing compute!
40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Treat containers as a fundamental, compute primitive. TASKS
41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • IAM Roles for Tasks • Task Auto Scaling • Task Load Balancers • Task Networking
42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Focus!
43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Summary
44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Container landscape Amazon ECS Amazon EKS Fargate mode for ECS Fargate mode for EKS (available 2019)
45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ECS Highl y sca l a bl e, high perf o rm a nce co nta iner m a na gem ent sy stem A managed platform ECS Cluster management Container orchestration Deep AWS integration
46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS Managed Kubernetes on AWS Highly available Automated version upgrades Integration with other AWS services Etcd Master Managed Kubernetes control plane CloudTrail, CloudWatch, ELB, NLB, VPC, PrivateLink
47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fargate Launch quickly Scale easily No infrastructure Resource based pricing Containers on demand Manage everything at container level
48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Need help choosing an option? https://medium.com/containers-on-aws/choosing-your- container-environment-on-aws-with-ecs-eks-and- fargate-cfbe416ab1a @nathanpeck
49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Getting started • To get started with EKS: https://aws.amazon.com/eks/ • To get started with Fargate: https://aws.amazon.com/fargate/ • Blogs: https://aws.amazon.com/blogs/aws/aws-fargate/ • https://aws.amazon.com/blogs/aws/amazon-elastic-container-service-for-kubernetes/ • Liz Rice from Aquasec on Fargate: https://blog.aquasec.com/securing-struts-in-aws-fargate • Nathan Peck from AWS: https://medium.com/containers-on-aws/choosing-your-container- environment-on-aws-with-ecs-eks-and-fargate-cfbe416ab1a • Deepak Singh (containers GM at AWS): https://www.slideshare.net/AmazonWebServices/containers-on-aws-state-of-the-union- con201-reinvent-2017
50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you! @brentContained https://ecsworkshop.com http://bit.ly/atx-id