DevOps Taiwan 2020 Workshop - Jenkins CICD

Jenkins CICD on Kubernetes workshop

Transcript

1. 1 健步如飛的北北 Jenkins DevOps Taiwan 我說在座的各位都手速 3000
2. Hello everyone, My name is JohnChen 2 I was • a System engineer • a DevOps I am • a Site Reliability Engineer for Grindr
3. Who am I 3 I am Rico Chen and work for Bincentive Who am I is not important. Today is Anna’s birthday!!!!!! Happy Birthday yooohoooo
4. Outline • Jenkins Background • Why use Jenkins • CICD principle • Jenkins Workshop!!!! 4
5. Before We start …… • WARNING 1: If you use any Ad Block extension on browser. Please disable first. • WARNING 2: Please be a copycat as much as you can. No matter AWS region or config. Just be a copycat. 5
6. Setup Cloud9 and EKS Following pictures of installation guide comes from: https://github.com/pahud/amazon-eks-workshop 6
7. 7 AWS Cloud 9 link (click me)
8. 8 Copy & paste me ! jenkins-workshop
12. 12 ~$ aws sts get-caller-identity
13. Create IAM key if you have no one 13 AWS IAM link (click me)
20. Export your credential to environment (CDK not support AWS CLI v2 right now, export to env is only way to feed aws credential) export AWS_ACCESS_KEY_ID={your key id} export AWS_SECRET_ACCESS_KEY={your secret key} export AWS_DEFAULT_REGION=ap-northeast-2 Make sure this IAM User has Administrator Access and run cli, you should be able to see the returned JSON output like this. aws sts get-caller-identity 20
21. ~$ git clone https://github.com/ricotoothless/aws-cdk-jenkins-workshop.git 21 Git clone baby~
22. Set up EKS env by CDK 22 ~$ cd aws-cdk-jenkins-workshop/01-install-eks-cluster ~$ bash install.sh
23. Outline • Jenkins Background • Why use Jenkins • CICD principle • Jenkins Workshop!!!! 23
24. Jenkins Background 24
25. Jenkins 是一款由 Java 編寫的開源的持續整合工具，前身是 Hudson 軟體專案。 Hudson 2004 年夏天始創於 Sun Microsystems。 Jenkins 提供了軟體開發的持續整合服務。它執行在 Tomcat 容器中。它支援軟體組 態管理工具，可以執行基於 Apache Ant 和 Apache Maven 的專案，以及任意的 Shell 命令和 Windows 批次處理命令。 Jenkins 的主要開發者是川口耕介。 Jenkins 是在 MIT 授權條款下釋出的自由軟體。 25
26. 川口耕介（Kohsuke Kawaguchi）是一位程式設計師，以 Jenkins 軟體專案的創建者 而聞名。在 Sun Microsystems 工作期間，他是 Hudson 專案的主要開發人員。他還 因對 Jenkins 項目的工作而獲得了2011 年 Google-O'Reilly 開放源碼獎。 2019 DevOps World | Jenkins World 演講 26
28. 結論：Oracle 很邪惡呵呵呵 啊，好像挖到有趣的東西，打倒資本主義 的高牆！！ [click me] 哇，又不小心滑到一篇 [click me] 好孩子不要反白 28
29. Jenkins 2 的兩大核心組件： 1. Pipeline 2. Blue Ocean 29
30. Pipeline 有兩種： 1. Scripted Pipeline 2. Declarative Pipeline 30
31. Scripted Pipeline Declarative Pipeline 31
32. Blue Ocean 32
33. Outline • Jenkins Background • Why use Jenkins • CICD principle • Jenkins Workshop!!!! 33
34. 1. 開源，即免費。 2. 支援多種平臺（windows、linux、os x都支援）。 3. 安裝、配置簡單。 4. Web 視覺化管理介面，並且有很多plugin。 34
35. Outline • Jenkins Background • Why use Jenkins • CICD principle • Jenkins Workshop!!!! 35
36. 36 https://blogs.cisco.com/cloud/have-you-ever-considered-ci-cd-as-a-service
37. 37 CI/CD 就是要快 要快就需要 Automation
38. Outline • Jenkins Background • Why use Jenkins • CICD principle • Jenkins Workshop!!!! 38
39. Set up Jenkins 39 ~$ cd ../02-install-istio-jenkins/ ~$ bash install.sh ~$ bash get-links.sh
40. Workshop Architecture 40
41. Jenkins-to-GitLab authentication 41
42. Jenkins-to-GitLab authentication 42 GitLab link (click me)
43. 43 Username: admin Password: admin
45. 45 Copy & paste me ! gitlab-connection https://gitlab.com
46. 46 Copy & paste me ! gitlab-api-token
48. GitLab-to-Jenkins authentication 48
51. Go application example 51
52. Go application example 52 go app example (click me)
53. 53 http://{jenkins user}:{jenkins token}@{jenkins hostname}/project/jenkins-w orkshop-go-app-example
54. 54 Copy & paste me ! jenkins-workshop-go- app-example
55. 55 Copy & paste me ! [J|j]enkins [R|r]ebuild
56. 56 Use your forked repo
57. 57 Copy & paste me ! origin +refs/heads/*:refs/r emotes/origin/* +refs/merge-reques ts/*/head:refs/remo tes/origin/merge-re quests/* origin/${gitlabSourc eBranch} merge-requests/${gitlabMergeRequestIid}
59. 59 Copy & paste me ! origin ${gitlabTargetBranch} jenkins@haha.com jenkins
62. Jenkins Workshop Lessons • Lesson-1 • Lesson-2 • Lesson-2.5 • Lesson-3 • Lesson-4 • Lesson-5 • Lesson-6 • Lesson-7 • Uninstall 62
63. Lesson-1 63
64. Lesson-1 • Code review in PR (or MR) • Unit test in PR (or MR) • Build test in PR (or MR) • Jenkins rebuild in PR (or MR) • Dockerfile experimental cache feature[link] 64
65. 65 Please select your fork repo. Not RicoToothless repo
68. 68 Copy & paste me ! jenkins rebuild
71. 71 Copy & paste me ! kubectl get pod bash get-links.sh And then click go-app url
72. Lesson-2 72
73. Lesson-2 • Use jenkins shared library to reduce duplication between project repositories • Demo jenkins-workshop-jenkins-library (click me) 73
76. Lesson-2.5 76
77. Lesson-2.5 • Store json / yaml in shared library • Store python / shell script in shared library 77
78. Directory structure 78
79. Directory structure src: It is a regular java source directory. It is added to the classpath during every script compilation. vars: This directory holds all the global shared library code that can be called from a pipeline. It has all the library files with a .groovy extension. resources: All the non-groovy files required for your ur pipelines can be managed in this folder. 79
80. 80 Copy & paste me ! lesson-2.5
81. 81 Copy & paste me ! https://gitlab.co m/RicoToothless/ jenkins-worksho p-go-app-exampl e */lesson-2.5
88. Lesson-3 88
89. Lesson-3 • Let user choose which platform/distribution to deploy artifacts. 89
90. 90 Copy & paste me ! lesson-3
91. 91 Copy & paste me ! https://gitlab.com /RicoToothless/je nkins-workshop-g o-app-example */lesson-3
96. Lesson-4 96
97. Lesson-4 • Include all branch / tag into one project 97
98. 98 Copy & paste me ! lesson-4 https://gitlab.com /RicoToothless/je nkins-workshop-g o-app-example
102. Lesson-5 102
103. Lesson-5 • Send project build status to Slack 103
106. 106 0jHOjE57pnAX8kHPyx7PJXAR slack-token-jenkins slack-token-jenkins
107. 107 Copy & paste me ! chenchihchiang #workshop
108. 108 Copy & paste me ! lesson-5
109. 109 Copy & paste me ! https://gitlab.com /RicoToothless/je nkins-workshop-g o-app-example */lesson-5
111. Lesson-6 111
112. Lesson-6 • Store credentials in AWS Secret Manger 112
113. https://plugins.jenkins.io/aws-secrets-manager-credentials-provider/ 113
114. 114 aws secretsmanager create-secret --name 'slack-token-aws' --secret-string '0jHOjE57pnAX8kHPyx7PJXAR' --tags 'Key=jenkins:credentials:type,Value=string' --description 'slack-token-aws' --region ap-northeast-2
117. Lesson-7 117
118. Lesson-7 • Blue Ocean GUI 118
120. Uninstall 120
121. 121 ~$ cd ../uninstall ~$ bash uninstall.sh
125. Reference 125
126. 126 • jenkins service user only in EE version • jenkins gitlab plugin • JNLP fails to connect to master when istio envoy-proxy is present • add clusterrole for executing helm inside pipeline • Dockerfile buildkit feature
127. 127 • Docker buildkit feature with frontend experimental syntaxes • Jenkins Configuration as Code Plugin • CDK ECR not support --force option • AWS CDK didn’t support AWS CLI v2 • Dynamic Jenkins Agent from Kubernetes • Jenkins artwork
128. 128 • 精通 Jenkins Pipeline — part1 (Groovy 以及 Jenkinsfile) • 精通 Jenkins Pipeline — part2 (Transform, Node Step 以及 Declarative Pipeline) • 精通 Jenkins Pipeline — part3 (Declarative Pipeline and its implementation)