The Hidden Costs of Managed Open Source

When building on AWS there are frequently multiple ways to achieve the same goal: You can run containers on ECS or EKS; you can use SQS or Amazon MQ; there’s MSK and Kinesis, … In this talk we will look at few different ways in which you might be paying more when selecting the (managed) Open Source Solution. From the expected higher base cost for a private control plane, to the more surprising costs that suddenly can appear in the EC2-Other category.

Talking giving at the AWS Community Day Belfast

Transcript

1. The Hidden Costs of Managed Open Source Ben Bridts aka: tables and numbers
2. ? ~$ whoami
3. Some ways to run software in AWS DIY Managed Native DIY Managed Native Pay per Infrastructure Pay per Capacity Unit Pay per Request Everything in your account Most things in your account Some things in your account DIY Authentication DIY Authorization Sometimes IAM authentication Custom or IAM authorization IAM authentication IAM authorization
4. Authentication Authorization application integration
5. Connecting to DynamoDB Effect: "Allow" Action: "dynamodb:GetItem" Resource: "arn:aws:dynamodb:eu-west-1:123456789012:table/ $table" aws dynamodb get-item \ --table-name $table --key '{"Id":{"S": "$item"}}'
6. Connecting to RDS Effect: "Allow" Action: "rds-db:connect" Resource: "arn:aws:rds-db:eu-west-1:123456789012:db-user: $db-instance/$db-user" admin@$db-instance: CREATE USER '$db-user' IDENTIFIED WITH AWSAuthenticationPlugin AS 'RDS'; aws rds generate-db-auth-token \ --hostname $hostname --port 3306 \ --username $db-user mysql --host $hostname --port 3306 --user $db-user --password $db-auth-token
7. Some ways to run software in AWS DIY Managed Native DIY Managed Native Pay per Infrastructure Pay per Capacity Unit Pay per Request Everything in your account Most things in your account Some things in your account DIY Authentication DIY Authorization Sometimes IAM authentication Custom or IAM authorization IAM authentication IAM authorization
8. Managed Native Amazon Kinesis Amazon Managed Streaming for Apache Kafka (Amazon MSK) Amazon Simple Queue Service (Amazon SQS) Amazon MQ AWS Step Functions Amazon Managed Workflows for Apache Airflow (Amazon MWAA) Amazon Elastic Kubernetes Service (Amazon EKS) Amazon Elastic Container Service (Amazon ECS) Amazon DocumentDB (with MongoDB compatibility) Amazon DynamoDB Amazon CloudWatch Amazon Managed Service for Prometheus Amazon FSx Amazon Elastic File System (Amazon EFS)
9. You are all smart people and we all run open source software*
10. Why Managed Open Source? lift and shift insourcing features cost modeling
11. The bill please Some examples
12. Amazon EKS
13. Amazon EKS 1x Cluster /h 0.10 USD 73.20 3x VPC Endpoint /h 0.011 USD 24.16 ------------- Subtotal: 97.36 1x Ext. Support Cluster /h 0.60 USD 439.20 ?x Inter-AZ Datatransfer /GB 0.02 USD ??.?? ------------- Total: > 536.56
14. Amazon EKS
15. Amazon EKS Shared Clusters ~ increase blast radius ~ operational overhead Less cross-AZ data transfer ~ Topology Aware Routing (beta) ~ sub. kube-proxy w. ALB Less NAT transfer ~ S3 Gateway Endpoint for ECR ~ ECR Pull-Through Cache for e.g. dockerhub
16. Amazon Managed MQ RabbitMQ
17. Amazon Managed MQ RabbitMQ 1x mq.t3.micro /h 0.030 USD 21.70 1x Amazon EBS 5GB /month 0.55 USD 0.55 ------------- Subtotal: 22.35
18. Amazon Managed MQ RabbitMQ 1x mq.t3.micro /h 0.030 USD 21.70 1x Amazon EBS 5GB /month 0.55 USD 0.55 ------------- Subtotal: 22.35 3x mq.t3.micro /h 0.030 USD 65.09 3x Amazon EBS 5GB /month 0.55 USD 1.65 ------------- Subtotal: 66.09
19. 1x mq.t3.micro /h 0.030 USD 21.70 1x Amazon EBS 5GB /month 0.55 USD 0.55 ------------- Subtotal: 22.35 3x mq.t3.micro /h 0.030 USD 65.09 3x Amazon EBS 5GB /month 0.55 USD 1.65 ------------- Subtotal: 66.09
20. 1x mq.t3.micro /h 0.030 USD 21.70 1x Amazon EBS 5GB /month 0.55 USD 0.55 ------------- Subtotal: 22.35 3x mq.t3.micro /h 0.030 USD 65.09 3x Amazon EBS 5GB /month 0.55 USD 1.65 ------------- Subtotal: 66.09 3x mq.m5.large /h 0.321 USD 704.91 3x Amazon EBS 5GB /month 0.55 USD 1.65 ------------- Subtotal: 706.56
22. Amazon MSK 1x kafka.t3.small /h 0.0499 USD 35.53 1x kafka.m7g.large /h 0.2275 USD 166.53 3x kafka.t3.small /h 0.0499 USD 106.59 3x kafka.m7g.large /h 0.2275 USD 499.59 1x serverless cluster /h 0.8625 USD 631.35 ?x partition /h 0.0017 USD 1.26 5x storage /GB /month 0.1150 USD 0.58 ?x Data in /GB 0.1150 USD ?.?? ?x Data out /GB 0.0575 USD ?.??
23. Talking About MSK More hidden costs
24. Amazon MSK + AWS Lambda
26. Amazon MSK + AWS Lambda 3x kafka.t3.small /h 0.0499 USD 106.59 3x kafka.m7g.large /h 0.2275 USD 499.59 1x serverless cluster /h 0.8625 USD 631.35 3x NAT-GW /h 0.0480 USD 184.46 ?x NAT-GW data /GB 0.0480 USD ???.??
27. Amazon MSK + AWS Lambda 3x kafka.t3.small /h 0.0499 USD 106.59 3x kafka.m7g.large /h 0.2275 USD 499.59 1x serverless cluster /h 0.8625 USD 631.35 3x NAT-GW /h 0.0480 USD 184.46 ?x NAT-GW data /GB 0.0480 USD ???.?? 3x VPC-Endpoint /h. 0.0110 USD 24.16 ?x VPC-Endpoint data /GB. 0.0100 USD ?.??
28. NAT Gateway VPC-Endpoint Data Transfer Cost
29. What does that tell us?
30. Rules of Cost Modeling include all environments data transfer is not free units and gaps matter
31. It’s not about the license it's about the control plane stable cost vs. pay for value spectrum of software cost of operations
32. @benbridts@hachyderm.io ben@cloudar.be benbridts @benbridts Thank you!