how-to-choose-cicd-tools.pdf

Transcript

1. How to choose CICD tools?
2. 我是誰 • 安安我是 Rico • 翻譯《Google The Site Reliability Workbook》 • 曾在 Bincentive 工作 • DevOps Taiwan 志工 • 冰雪奇緣愛好者
3. Gopher!!!!
4. DevOps Taiwan Community Telegram Facebook
5. Agenda • What is CICD • Organization considerations • Technical considerations • Popular CICD tools • References
6. What is CICD
9. CI CD
11. Organization considerations
12. • Learning curve • Commercial or open source? • Price • On premises or cloud? • Different team use different CICD tool? Organization considerations
15. • Organization policy • Support • Customization or self-customization • Security • SLA Commercial or open source?
16. Beautiful Jenkins dashboard Circle CI for Sumo logic Better UI/UX!!?
17. • Totally free for small project • Free for open source • Per user • By usage • Enterprise custom pricing • Instance for self-hosted open source Price
18. • Organization policy • Maintenance cost • Network Latency • Scale size • Flexible to customize • Hybrid strategy On premises or cloud?
19. Don’t worries, we have Raid 0~6!?
20. • Federation identity support • Organizational structure ◦ SRE workbook - chapter 6: case study 2 Different team use different CICD tool?
21. Technical considerations
22. • OS ecosystem • CICD tools plugin ecosystem • Community • Learning curve • SaaS or self-hosted • Artifact management Technical considerations
23. • Can we customize it easily? • What is your orchestration? • Visibility • Metric
24. • Linux ecosystem • Windows ecosystem • Apple ecosystem OS ecosystem
25. • SCM (source control management) plugin • Language/platform plugin • Cloud provider service plugin • Cluster management plugin • Notification plugin • Issue tracking plugin • …...and many CICD tools plugin ecosystem
26. No matter open source or commercial software, all need population • Open source project can be more stable • Commercial software can be more understand their users • Different scenario experience sharing Community
27. • Official document • Vendor authorized training partners • Community sharing Learning curve
28. • Security • Networking design • Maintenance cost • SLA SaaS or self-hosted
29. • Types of artifact • Integration • Access management for private repository • SaaS or self-hosted Artifact management
30. • Commercial vs. open source • Configuration as code after customization • Re-usable CICD libraries Can we customize it easily?
31. • Bare metal, VM or container? • Deployment strategies • CICD tool should inside or outside orchestration cluster? What is your orchestration?
33. • Locate the broken issue quickly • Visual analysis dashboard Visibility
34. • Metric aggregation • CICD pipeline metric 1. Lead time (Duration) 2. Time to recovery (Mean Time to Recovery) 3. Deployment frequency (Throughput) 4. Change failure rate (Success Rate) Metric
35. Popular CICD tools
36. • General CICD tools • Cloud provider CICD tools • Mobile application CICD tools • GitOps CICD tools • Infrastructure CICD tools Popular CICD tools
37. General CICD tools
38. • Open source with rich community support • More than 1400 plugins • Configuration as code • Steep learning curve • Easy customize • Commercial support (CloudBees CI/CD) • Only self-hosted Jenkins
39. • Free for open source project • Focus on CI • Provide IP range on cloud • Suit for small to big team Travis CI
40. • Free for limit usage on private project • Auto-cancel redundant builds • Nice UI/UX • Multi-language support • Suit for small to big team Circle CI
41. • Free for limit usage on private project • Open source project • Start at source control management (SCM) • Include artifact management • Commercial support GitLab CI/CD
44. Cloud provider CICD tools
45. • Excellent integration with their product • Steep learning curve • Complex cost calculate by usage • Vendor lock-in issue AWS pipeline solution
47. • Out-of-box email notifications • Calendar views • Good at UI/UX • Support Azure pipeline agent on macOS • Pay by users and additional services Azure pipeline
48. Mobile application CICD tools
49. • Open source absolute free • Rich community-powered workflow • Multi-container testing • macOS VM support GitHub Actions
50. • Free for limit usage on private project • Easy to set up • Rich re-use CICD libraries • Trace service in BETA • Not very support private network Bitrise
51. • Free for limit usage on private project • Total solution for App ◦ CICD ◦ SDK for monitoring ◦ User tracking App Center
52. GitOps CICD tools
53. • Open source • Watch container image update • Only 1 repository per Flux operator • Multi cluster manage not very effectively • No GUI unless you pay to Weaveworks • Configuration drift detection • More coming on Flux 2 Flux
55. • Open source • Multi repositories • Multi cluster • Good UI/UX dashboard • Configuration drift detection • Suit for multi team ArgoCD
57. • GitOps solution of CICD for Kubernetes • It’s total solution with many component • Including CI and CD • Suit for new project with new environment • Only self-hosted Jenkins X
61. Infrastructure CICD tools
62. • Free up to 5 members • Easy to teamwork on changes • Rich community • Status management • User management feature need to pay Terraform Cloud
63. • Resources graph view • CICD is base on other CICD tool • Pulumi GitHub App Pulumi Cloud
64. Pulumi resources graph view
65. Pulumi resources graph view
66. References
67. • Top Pressing Concerns for CI/CD in 2020 • Tips for Choosing the Right CI/CD Tools • Choosing the Right Continuous Integration Tool • Continuous Delivery And Release Automation, Q2 2020 • ON-PREMISES VS. CLOUD • SRE Books • Developing C# on Linux • Browse Jenkins plugin • OCI Image Format • Deployment Strategies on Kubernetes
68. • Measuring DevOps by CD Foundation • Four Keys project • How to find and monitor engineering metrics for team success by circleci • How to measure DevOps success: 4 key metrics by circleci • Jenkins vs Travis CI vs Circle CI vs TeamCity vs Codeship vs GitLab CI vs Bamboo • CI/CD tools compared: CircleCI and Travis CI vs. major CSPs
69. • Travis CI is no longer providing CI minutes for open source projects • Jenkins X concept • Jenkins X overview • Free build on Bitrise limit (is cancel right now) • ArgoCD vs Flux • FluxCD, ArgoCD or Jenkins X: Which Is the Right GitOps Tool for You? • Terraform Cloud • Pulumi