fargate deep dive (london summit)

Transcript

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep dive: AWS Fargate Abby Fuller, Developer Relations, AWS @abbyfuller
2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. First things first: who here is new to containers?
3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A container is an atomic, self-contained package of software that includes everything it needs to run (code, runtime, libraries, packages, etc.). A popular, widely-used container platform is Docker. More on that here: https://www.docker.com
4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s talk container basics Docker pull Docker build Docker run Docker tag Docker push
5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why are containers so popular? Portable Lightweight Standardized Easy to deploy Along with containers, comes the “monolith to microservices” story: containers and microservices go hand in hand (more on that in a second)
6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. OK, so what are microservices? ”Service oriented architecture composed of loosely coupled elements that have bounded contexts.” - Adrian Cockroft (This is Adrian)
7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why do microservices and containers go together? • One job, one service à container • Can deploy and scale containers independently • This means that a high traffic service, like a messaging service, might need to be scaled frequently, but a low traffic service, like an internal dashboard, doesn’t need to be scaled at the same time
8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Running one container is easy Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Running many containers is hard…
9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Enter container orchestration tools
10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. To avoid doing extra hard work that we don’t have to, we use container orchestration tools
11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. There are few options on AWS for container orchestration
13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Today, we’re going to focus on Fargate.
15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. No infrastructure Launch quickly Scale easily Manage everything at container level Resource based pricing
16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “When someone asks you for a sandwich, they aren’t asking you to put them in charge of a global sandwich logistic chain. They just want a sandwich” P.S., the sandwich is Fargate
17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Fargate?
18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Remember this?
19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Running one container is easy Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Server Guest OS Running many containers is hard…
20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Managing a production container infrastructure can be a lot of work
21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Using ECS made it easier Scheduling and Orchestration Cluster Manager Placement Engine Availability Zone #1 Availability Zone #2 Availability Zone #3
22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. But it’s not totally hands off ECS AMI Docker agent ECS agent ECSTask ECSTask ECSTask ECSTask EC2 Instance ECS AMI Docker agent ECS agent EC2 Instance
23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Fargate lets you focus on your application
24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “When someone asks you for a sandwich, they aren’t asking you to put them in charge of a global sandwich logistic chain. They just want a sandwich” P.S., the sandwich is Fargate
25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s look at that in practice
26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So you want to run a managed container on AWS 1 Choose your orchestration tool AMAZON CONTAINER SERVICES 2 Choose your launch type ECS EKS EC2 FARGATE EC2 FARGATE
27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s go back to EC2 mode for a second
28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How do the pieces of ECS map back to traditional workloads? Instances: standard EC2 boxes. Once registered to a Cluster, your Tasks run here Services: layer that manages and places tasks Tasks: container wrapper and configuration around processes running on the instance
29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So what am I responsible for in ECS? Instances Service Tasks
30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So what am I responsible for in ECS pt 2 ? • In EC2 mode, you’re responsible for configuring all three of those pieces: instances, services, and tasks. • Instances are configured through the ecs-optimized AMI (or your own AMI), and/or you can configure with EC2 user-data • Services and Tasks (and containers) are all configured through the ECS API, which you can either access directly, or go through the CLI. Tasks are defined through Task Definitions, and Containers are defined through Container Definitions.
31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does compute work in ECS? • Choose your own instance type, with any combination of resources • Controlled through the Service ASG launch configuration, like with any other EC2 cluster. • Supports GPUs, spot instances, RIs, etc.
32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Running Fargate-mode containers on ECS
33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A lot of similarities with the basics of ECS Same Task Definition schema Use ECS APIs to launch Fargate Containers Easy migration – Run Fargate and EC2 launch type tasks in the same cluster Share primitives like VPC, CloudWatch, IAM with ECS
34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So what am I responsible for in Fargate mode? Instances Service Tasks
35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So what am I responsible for in Fargate mode pt 2? • In EC2 mode, you’re responsible for configuring services and tasks • Instances are not configured by you, you can ONLY configure at the container/task level • Services and Tasks (and containers) are all configured through the ECS API, which you can either access directly, or go through the CLI. Tasks are defined through Task Definitions, and Containers are defined through Container Definitions.
36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does compute work in Fargate? CPU Memory 256 (.25 vCPU) 512MB, 1GB, 2GB 512 (.5 vCPU) 1GB, 2GB, 3GB, 4GB 1024 (1 vCPU) 2GB, 3GB, 4GB, 5GB, 6GB, 7GB, 8GB 2048 (2 vCPU) Between 4GB and 16GB in 1GB increments 4096 (4 vCPU) Between 8GB and 30GB in 1GB increments 50-ish combos, y’all
37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How do I know what to choose? Depends on your workload. Fargate: if you can configure with just a Task Definition, and you’re ok with awsvpc networking mode, try Fargate. Some caveats: can’t exec into the container, or access the underlying host (this is also a good thing) EC2 mode: good if you need to customize!
38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. •Change in networking mode: "networkMode": "awsvpc” •Only specify container port, no host port: •"portMappings": [{"containerPort": ”8081"}] •No links (only local loopback) •No ELB Classic, only ALB or NLB. ALB needs to use target type IP, not instance. •Launch Type: Fargate •Windows containers only on EC2, not Fargate
39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. requiresCompatibilities requiresCompatibilities parameter. "requiresCompatibilities": ["FARGATE"] You can have tasks that have multiple compatibilities: "requiresCompatibilities": ["FARGATE”, “EC2”]
40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s talk about networking (baby)
41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Local networking On a single EC2 instance, two components could communicate via the local, loopback interface: more commonly known as `localhost` or 127.0.0.1 This bypasses networking interface and lets processes communicate directly Got it? Good.
42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. External networking This covers communication with services that are not part of the same task, or to external services. This means traffic is (most likely) routed through the internet through your VPC. Tasks are launched into subnets, which define traffic rules through routing tables. • Two types of subnets: • Public: associated internet gateway • Private: no direct internet gateway, traffic is routed through NAT (Network Address Translation)
43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Traditional Docker networking Bridge: docker0. This is the default behavior. Containers on the same network can communicate via IP address. No automatic service discovery. Connect containers with ---link None: no network interface, only local loopback (which I’ll explain shortly) Host: connect to host network (container maps to host)
44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. awsvpc (the slightly longer version) With awsvpc, each task is allocated an ENI (Elastic Network Interface) Containers launched as part of the same task can use the local loopback interface With the ENI allocation comes a private IP. Public IPs can also be allocated (with Fargate).
45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Looking for more networking details? https://aws.amazon.com/blogs/compute/task-networking-in-aws-fargate/ https://aws.amazon.com/blogs/compute/introducing-cloud-native-networking-for-ecs- containers/
46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. If you don’t know now you now (or FAQs)
47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Q: can I have both EC2 and Fargate tasks? A: yes, you can run hybrid clusters, or switch back and forth. Tasks can be compatible with both. Q: how do I exec into a Fargate container? Short A: you don’t Longer A: if it were me, I’d stop the Fargate container and restart as type EC2 for debugging, then switch back over.
48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Q: why can’t I use my own VPC with the Fargate first run wizard? A: The wizard is just for learning Fargate concepts and how it works. You absolutely can (and should) use your own VPC. Wait what? The wizard/getting started flow in Fargate will create a VPC and subnets for you. You can both a) edit the resources created through the wizard, or launch Fargate tasks into a previously created VPC through the regular console flow/the CLI.
49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. I get by with a little help from my friends (CLIs)
50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. CLIs (that I know about) for Fargate/ECS aws-cli: the official OG. Open source, includes most AWS services. • More info here: https://aws.amazon.com/cli/ • Github here: https://github.com/aws/aws-cli ecs-cli: also official, but just for ECS. Supports docker compose files. • More info here: https://github.com/aws/amazon-ecs-cli Some good unofficial options: Fargate cli: https://github.com/jpignata/fargate Coldbrew cli: https://github.com/coldbrewcloud/coldbrew-cli
51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thanks! @abbyfuller