Cloud Native Coding

This repository contains some tools and concepts for Cloud Native Coding

Transcript

1. Cloud Native Coding CLOUD NATIVE DAY / 10.02.2021 CHRISTOPHER SCHMIDT @FAKOD
2. topics today • software development • debugging running containers • CI/CD • application container design • the future of managed service 2
3. Cloud Native Applications adopting the principles of Microservices, packaged and delivered as Containers, orchestrated by Kubernetes, running on top of Cloud infrastructure Cloud-native software is highly distributed, must operate in a constantly changing environment, and is itself constantly changing Cloud is about where we’re computing. Cloud-native is about how. KubeCon 2017 Cornelia Davis, Manning: Cloud Native Patterns 3
4. Issues Cloud Software Development • more and more modules & Microservices • more complex systems • container and platforms • SEO still important databases? managed services? service discovery? Canary releases? 4
5. Issues Cloud Software Development • source code on a laptop • test and Integration system in a cloud using container or binaries? Cycle too long? mocks? Cluster on laptop? how is the development cycle? 5
6. Dev for the Cloud - General Categories Sources & Services VPN Services Source & Services Sources 6
7. Dev for the Cloud - General Categories Sources & Services VPN Services Source & Services Sources 7
8. Sources and Services on Laptop Docker for Windows • seems to be awesome with WSL 2 backend Docker for MacOS Kind • uses curated container images and • kubeadm to provision K8s in a Container 8
9. Kind 9
10. Dev for the Cloud - General Categories Sources & Services VPN Services Source & Services Sources 10
11. Services in Cluster • kubefwd bulk port forwarding Kubernetes services • telepresence fast, local development for Kubernetes 11
12. Dev for the Cloud - General Categories Sources & Services VPN Services Source & Services Sources 12
13. Source and Service in Cloud VSCode / Theia based Gitpod • organized by workspaces • pre de ined images • short lifecycle Cloud Native Coding IDE • management UI as SaaS (optional) • IDEs managed by an operator • more VM like Github Codespaces • instant DEV environment Coder • software development to the cloud 13
14. Pros, Issues and Dif iculties • many, very speci ic Development Envs • server side control (security) • cluster resource pool • Visual Studio Code • Resource Limits and Requests? • container isolation? • updates? -> Cloud VMs per Virtual Kubelet (Kip) 14
15. Debugging?
16. Debugging Tools kubectl plugins • open-svc: open the Kubernetes URL(s) for the speci ied service in your browser through a local proxy server • spy: pod debugging tool for kubernetes clusters with docker runtimes • sniff: Perform network snif ing on a container running in a kubernetes cluster 16
17. kubespy How does it work? kubectl -n "${ns}" run --generator=run-pod/v1 --overrides=' { "spec": { "hostNetwork": true, "hostPID": true, "hostIPC": true, "nodeName": "'"${no}"'", "containers": [ { "name": "spy", "image": "busybox", "command": [ "/bin/chroot", "/host"], "args": [ "docker", "run", "--network=container:'"${cid}"'", "--pid=container:'"${cid}"'", "--ipc=container:'"${cid}"'", "'"${ep}"'" ], "stdin": true, "stdinOnce": true, "tty": true, "volumeMounts": [ { "mountPath": "/host", "name": "node" } ] } ], "volumes": [ { "name": "node", "hostPath": { "path": "/" } } ] } } ' --image=busybox --restart=Never "${spyid}" 17
18. Releasing?
19. Release Strategies • with downtime • recreate • without downtime • rolling update • blue green • canary - based on • location • device • traf ic share • technical/business metrics • . . . Kubernetes build-in means? Service Meshes? 19
20. Canary Release Flagger (progressive delivery) • deployment strategies like Canary releases, A/B testing, Blue/Green • can query Prometheus, Datadog or CloudWatch 20
21. CI/CD
22. Cluster Setup one cluster per environment? one cluster per team? one cluster per test/branch/version? 22
23. Cluster Setup management cluster • Jira/GitLab/etc. Dev/Int/Stage/... cluster • IDEs • Pull Requests/feature branches performance test cluster prod cluster 23
24. Cluster Deployments • dedicated server • build runner • cloud native CI/CD Tools • Tekton CD • Argo CD • . . . runner 24
25. Tekton.dev • cloud-native solution for building CI/CD pipelines • no build server instance 25
26. Task apiVersion: tekton.dev/v1beta1 kind: Task metadata: name: argo-deploy spec: params: - name: APP description: Name of ArgoCD App to sync - name: TOKEN description: Authentication token for ArgoCD - name: SERVER description: AgroCD Server location resources: inputs: - name: source type: git - name: image type: image steps: - name: argo-deploy image: argoproj/argocd:v1.6.1 script: | argocd app set $(inputs.params.APP) \ --kustomize-image $(resources.inputs.image.url):$(resources.inputs.source.revision) \ --auth-token $(inputs.params.TOKEN) --server $(inputs.params.SERVER) --insecure argocd app sync $(inputs.params.APP) \ --auth-token $(inputs.params.TOKEN) --server $(inputs.params.SERVER) --insecure 26
27. Tools... 27
28. Application Container Design OOP in a Cloud Native World?
29. From DDD to Production DDD Architecture Production ? 29
30. ACD Proxy App Pod • rate limiting • circuit breaking • TLS • Cache & CORS header • routing • . . . 30
31. ACD: Scatter-Gather Frwk Vendor A Frwk Vendor B Frwk Vendor C Frwk Frwk Aggregate 31
32. ACD • NFRs to the platform • scaling, self healing, placement, jobs, cronjobs etc. • CQRS • different scaling needs • different releasing requirements (Recreate instead of Canary) • smaller components • -> better test-ability 32
33. Managed Services and their future
34. Managed Services Kubernetes Apps Tool Tool Vendor A Tool Tool Vendor B Apps Apps 34
35. Managed Services • goal: environment independence • (not feature-set) • what about your Dev-laptop setup? • many APIs with different semantics (User, Role, Network, ACL, Cost control etc) • Different Monitoring/Alerting? 35
36. Managed Services • vendor decoupling • decoupling operations Vendor A Vendor B Vendor C Kubernetes Operator CRD 36
37. Managed Services Kubernetes Operator Tool operates uses 37
38. zalando/postgres-operator 38
39. Danke! Fragen? Christopher Schmidt christopher.schmidt@innoq.com @fakod www.innoq.com innoQ Schweiz GmbH Hardturmstrasse 253 8005 Zürich Gewerbestr. 11 6330 Cham 39