Castle on a Cloud - The GitHub Story

When you think "GitHub", you're probably thinking of what we lovingly refer to as GitHub Dot Com: The Web Site. GitHub Dot Com: The Web Site runs on an incredibly interesting infrastructure composed of very powerful, cleverly configured, and deeply handsome servers. This is not their story.

This is the story of the other half of our infrastructure. This is the story of the 350 AWS instances, 250 Heroku dynos, and hundreds of other VMs we run. This is a story of tooling and monitoring, of happiness and heartbreak, and, ultimately, of The Cloud.

Transcript

1. Castle on a Cloud @bleything
2. ❤️☁️
3. ChatOps
4. Infrastructure Overview ! ! • Data Center • AWS ! ! ! • Heroku • Elsewhere
5. Infrastructure Overview ! ! • Data Center • AWS ! ! ! • Heroku • Elsewhere
6. Infrastructure Overview ! ! • Data Center • AWS ! ! ! • Heroku • Elsewhere
7. Infrastructure Overview ! ! • Data Center • AWS ! ! ! • Heroku • Elsewhere
8. Infrastructure Overview ! ! • Data Center • AWS ! ! ! • Heroku • Elsewhere
9. AWS
10. Default Resource Limits •EC2 •~115 instances •5 EIPs •10 ELBs •20 RIs per AZ •S3 •100 Buckets •RDS •40 Instances •10 TB total storage •EBS •5,000 volumes •10,000 snapshots •20 TiB total storage •IAM •5,000 users •100 groups •250 roles •150 instance profiles
11. Default Resource Limits •EC2 •~115 instances •5 EIPs •10 ELBs •20 RIs per AZ •S3 •100 Buckets •RDS •40 Instances •10 TB total storage •EBS •5,000 volumes •10,000 snapshots •20 TiB total storage •IAM •5,000 users •100 groups •250 roles •150 instance profiles
12. S3 has a fixed, unchangeable 100 bucket limit
13. IAM Cool Feature #1 ❤️☁️
14. IAM Roles & STS Cool Feature #1.1 ❤️☁️
15. Instance Profiles Cool Feature #1.2 ❤️☁️
16. yourapp-fe1-stg.aws.example.com iam:::role/yourapp-prd iam:::role/yourapp-stg iam:::role/yourapp-dev IAM Instance Profiles In Practice s3://yourapp/ /production /staging /development
17. yourapp-fe1-stg.aws.example.com iam:::role/yourapp-prd iam:::role/yourapp-stg iam:::role/yourapp-dev IAM Instance Profiles In Practice s3://yourapp/ /production /staging /development
18. yourapp-fe1-stg.aws.example.com iam:::role/yourapp-prd iam:::role/yourapp-stg iam:::role/yourapp-dev IAM Instance Profiles In Practice s3://yourapp/ /production /staging /development
19. Cross-Account Access Controls Cool Feature #1.3 ❤️☁️
20. An Interlude: ChatOps
24. Resource Tagging Cool Feature #2 ❤️☁️
26. Another Interlude: Cost Management
27. The Olden Days ¯\_( 100%
28. /graph me @aws.ec2.costs
29. VPC Cool Feature #3 ❤️☁️
30. Direct Connect Cool Feature #4 ❤️☁️
31. Heroku
32. ChatOps for Heroku
33. It looks like you're trying to create an application!
34. It looks like you're trying to view your logs!
35. It looks like you're trying to scale your app!
36. It looks like you're trying to shut your app down!
37. It looks like you're trying to run a command!
38. what about mysql tho :(
39. Thanks. Ben Bleything @bleything • ben@bleything.net