COSCUP - Dynamic Jenkins Agent on Kubernetes

Jenkins CICD more Cloud Native way.

Transcript

1. Dynamic Jenkins Agent on Kubernetes 政治要正確，正名 Jenkins Agent
2. Apology I shouldn't use a word like "slave" on the COSCUP agenda description. All lives matters. Don’t KILLALL -9 me.
3. Who am I • I work for Bincentive • Volunteer with DevOps Taiwan • Frozen lover
4. Agenda • What is Cloud Native • Why do we keep using Jenkins? • Introduce plugins • Case study • Live demo • Reference
5. What is Cloud Native
6. Cloud Native definition • Cloud Native technologies build and run scalable applications in modern, dynamic environments • Loosely coupled systems that are resilient, manageable, and observable
7. Why do we keep using Jenkins?
8. Jenkins advantage • Open source with rich community support • More than 1000 plugins • Jenkins just like Transformers. Plugin can make Jenkins more Cloud Native way
9. 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨巨 巨巨巨巨巨巨巨巨巨巨巨巨巨巨 好巨的肩膀，不站嗎？
10. Introduce plugins
11. AWS ECS is base on Auto Scaling Group. 2018 was lacking storage management. What can I do??? Main
12. Kubernetes plugin • Run dynamic agents in a Kubernetes • The agent is essentially a pod • Can config PV, resources limit, namespaces … and more
13. How to config agent pod? • Start with UI • Jenkins configuration as code plugin • Declarative or Scripted pipeline (use source control)
14. default namespace jenkins namespace EKS cluster Jenkins-agent service Jenkins main service Kubernetes service 1 3 2
15. Jenkins agent pod docker dind jenkins-agent golang aws-cli nodeSelector tolerations serviceAccount envVars
16. Case study
17. Issues • Too many microservices project • Prefer less plugins to reduce Jenkins main’s complex • Compiler job could impact develop environment. We need isolate Jenkins agent pod. • Compiler resources usage
18. Pod Template docker dind jenkins- agent golang aws-cli docker dind jenkins- agent node.js aws-cli Pod Template nodeSelector tolerations serviceAccount envVars nodeSelector tolerations serviceAccount envVars
19. Pod Template Pod Template golang docker dind jenkins- agent aws-cli node.js nodeSelector tolerations serviceAccount envVars Jenkins shared library
20. agent pod jenkins main app pod app pod app pod Normal worker nodes group jenkins agent worker nodes group
21. agent pod agent pod Can I build now? No. plz queue.
22. Live demo
23. Isolate Jenkins aget pod • nodeSelector • taints • tolerations
24. Resources limit • only demo cpu request & limit
25. Reference
26. • Jenkins Kubernetes plugin • Jenkins Helm Charts • Jenkins and Kubernetes - Secret Agents in the Clouds • Dynamic Jenkins Agent from Kubernetes • Docker image for inbound Jenkins agents • CNTUG #28 - Kubernetes Resource and Eviction Management and more (speak slide) • cAdvisor - Analyzes containers resources usage
27. • Jenkins Configuration as Code plugin • Jenkins Configuration as Code Job DSL example • Jenins Job DSL GitHub • Jenkins Job DSL API Document • Jenkins Job DSL playground
28. • CNCF Cloud Native Definition v1.0 • Access-cluster-services • FluxCD, ArgoCD or Jenkins X GitOps • “docker stop” and “docker kill”?
29. Thanks you Q & A