Scalable Continuous Integration for iOS

SwiftLeeds 2024 talk.

https://swiftleeds.co.uk/

Transcript

1. SwiftLeeds 2024 Scalable Continuous Integration for iOS Alberto De Bortoli
2. 🙋 Alberto De Bortoli 🇮🇹 Based in London 💼 IC at JET 10 years 📱 iOS ♾ DevOps 🍕 JustEatTakeaway.com 
 About me
3. What’s this about? 🧑💻 Let’s implement a Continuous Integration infrastructure in-house!
4. Agenda 🤌 What is a Continuous Integration & Delivery system? 🛍 Existing CI/CD solutions 😏 Focus on a setup using AWS EC2 + GitHub Actions 🤖 Implementation using DevOps tools 🤔 Final considerations
5. What is this CI/CD thing?
6. CI/CD system A system that executes tasks on your code to allow integration and deployment of software… …continuously (if you’re lucky)
7. CI/CD system 🚢 Continuous Delivery Deploy the software so it can be used (internally and/or publicly) • Build • Archive • Upload to QA/staging/ production distribution channels 🤖 Continuous Integration Make sure the changes proposed are safe to merge into the default branch • Run validations • Run tests • Generate artifacts
12. Existing Solutions
13. CI/CD solutions Server + Workers
14. CI/CD solutions Server + Workers Server only
15. CI/CD solutions Server + Workers Server only Workers only
16. CI/CD solutions Server + Workers Server only Workers only
17. CI/CD solutions Server + Workers Server only Workers only Apple hardware is required here
18. CI/CD solutions Server + Workers Server only Workers only Apple hardware is required here not here
19. • Ready out-of-the-box • Workers are virtualized • Usually provide related tools/products • Xcode Cloud special snow fl ake • Appropriate for small-mid apps CI/CD solutions Server + Workers
20. CI/CD solutions Server only • Powerful and fl exible build systems • Usually require a high degree of customisation facebook/buck
21. CI/CD solutions Workers only • On premise • Cloud-hosted
22. Workers solutions On premise 👷
23. Workers solutions Cloud ☁ macstadium.com
24. Workers solutions Cloud ☁ aws.amazon.com
25. Let’s go!
26. ClickOps vs IaC
27. 👍 IaC Infrastructure as Code • Predictable • Reviewable • Auditable • Replicable • Point&Click in the UI • Error-prone • Intuitive 👎 ClickOps
28. Setup via ClickOps
29. aws.amazon.com
30. aws.amazon.com
31. aws.amazon.com
32. aws.amazon.com
33. aws.amazon.com
34. aws.amazon.com
41. aws.amazon.com
51. Setup via IaC
52. Hashicorp tools IaC Tool Machine Image Creator
53. AMI definition in Packer
57. AMI creation in Packer AWS credential required export AWS_ACCESS_KEY_ID=“your_access_key"
 export AWS_SECRET_ACCESS_KEY=“your_secret_key" Or set them in ~/.aws/credentials
60. IaC in Terraform
65. Deploying/Decommissioning
66. Deploying/Decommissioning
67. Dedicated hosts via AWS CLI
68. Dedicated hosts via AWS CLI
70. Secrets are best saved in Secrets Manager 🤫 Set up permissions to access Secrets Manager via IAM 🕵 Pass the secret ID (ARN) via user data when creating the EC2 instance 🏁 Use AWS ec2-macos-init to handle user data for startup operations 🍏 🔌 Connect to GitHub Actions… need a join token
71. Recap
72. Recap Dedicated host EC2 AMI (image) EC2 instance EC2 AMI (image) EC2 instance Dedicated host
73. EC2 instances Recap Dedicated host EC2 AMI (image) EC2 instance EC2 AMI (image) Dedicated hosts
74. Recap … Self-hosted runners
75. Console in GHA
76. Console in GHA The operations we want to automate: 1. The creation of the AMI 2. The deployment and decommission of the infrastructure 3. The allocation/release of the dedicated hosts
77. Console in GHA The operations we want to automate: 1. The creation of the AMI 2. The deployment and decommission of the infrastructure 3. The allocation/release of the dedicated hosts
78. Console in GHA The operations we want to automate: 1. The creation of the AMI 2. The deployment and decommission of the infrastructure 3. The allocation/release of the dedicated hosts
79. Console in GHA The operations we want to automate: 1. The creation of the AMI 2. The deployment and decommission of the infrastructure 3. The allocation/release of the dedicated hosts
80. Final considerations
81. Taking it further 🤔 • Automate scaling • Consider smart scaling • CloudWatch monitoring • IaC all the things • Optimise your code and pipelines 🫵
82. Costs 💸 • Back-of-the-envelope calculations Orka on AWS Anka on AWS In-house infra In-house infra w/ smart scaling Mac minis on premise 5 M1 instances per month ~ $3-4k > $3k ~ $2,300 ~ $1,650 🤯 Maintenance pain Virtually none Moderate Initial setup pain,
 joy and satisfaction thereafter High
83. One size does not fit all Any budget restriction? Buy vs Build? What’s the expected workload? How many pull requests & CD jobs per hour? Codebase size? How many apps/tools/repos? Need a CI/CD at all? Dev-hosted runners? In-house HW? Full third-party platform? Just workers? Existence of a DevOps team? Any in-house knowledge Anybody with the desire to skill up in DevOps? Number of teams? Would Virtualisation help?
84. Say hi! 👋 albertodebortoli.com @albertodebo