Event Driven Autoscaling using KEDA

Slidedeck used during the Coding Night NZ session on 2 Septemeber 2024. The recording of the session is available on YouTube
https://www.youtube.com/live/a8gwqaJR1Ck?si=V9iskiZQCUHOvgzj

Transcript

1. Event Driven Autoscaling using KEDA Nilesh Gule @nileshgule
2. $whoami { “name” : “Nilesh Gule”, “website” : “https://www.HandsOnArchitect.com", “github” : “https://GitHub.com/NileshGule" “twitter” : “@nileshgule”, “linkedin” : “https://www.linkedin.com/in/nileshgule”, “YouTube” : “https://www.YouTube.com/@nilesh-gule” “likes” : “Technical Evangelism, Cricket”, }
4. @nileshgule KEDA Kubernets based Event Driven Autoscaling Scaling in Kubernetes KEDA Overview TechTalks demo with RabbitMQ Autoscaling with KEDA KEDA Architecture Agenda
5. Pre-requisites • Self contained application with all its dependencies Docker • Orchestrates containers • Self healing • Service discovery • Scaling Kubernetes • Dockerhub / private container registry • Repository for storing container images Container Registry • Managed Kubernetes service on Azure • Native integration with other Azure services like Azure Active Directory (AAD), Azure Container registry (ACR), Azure Container Instances (ACI), Azure Monitor etc. Azure Kubernetes Service (AKS)
6. Kubernetes scaling options Horizontal Pod Autoscaler Vertical Pod Autoscaler Cluster Autoscaler Manual
7. TechTalks Application Architecture TechTalks Consumer TechTalks Producer TechTalks Frontend (UI) Message Broker Polyglot Programming
8. Techtalks-producer Azure-Melbourne-cluster demo-azure-melbourne-rg ngacrregistry acrResourceGroup Techtalks-consumer TechTalks without KEDA
9. @nileshgule Demo
10. Problem statement • Unpredictable workload • Special events (Christmas / New Year / Diwali / Deepavali / Thanksgiving etc.) • Scale based on factors outside of Kubernetes cluster • Scale based on combination of factors • Unexpected event (large number of logs compared to normal)
11. @nileshgule Demo KEDA in action
12. Techtalks-producer Azure-Melbourne-cluster demo-azure-melbourne-rg ngacrregistry acrResourceGroup Techtalks-consumer TechTalks with KEDA - AKS
13. KEDA Architecture
14. ScaledObject apiVersion: keda.k8s.io/v1alpha1 kind: ScaledObject metadata: name: rabbitmq-consumer namespace: default labels: deploymentName: rabbitmq-consumer-deployment spec: scaleTargetRef: deploymentName: rabbitmq-consumer pollingInterval: 5 # Optional. Default: 30 seconds cooldownPeriod: 30 # Optional. Default: 300 seconds minReplicaCount: 1 # Optional. Default: 0 maxReplicaCount: 30 # Optional. Default: 100 triggers: - type: rabbitmq metadata: queueName: techtalks-consumer-techtalks queueLength : ‘5’ authenticationRef: name: trigger-auth-rabbitmq-host
15. KEDA Features
16. Run Containers at scale ❖KEDA supported scale triggers including Azure Event Hub, Apache Kafka, RabbitMQ, MongoDB, MySQL, PostgreSQL etc. ❖Robust autoscaling without managing complex infrastructure ❖Scale to zero and pay only for use by the second https://keda.sh/docs/2.15/scalers/
17. Summary • KEDA helps to auto scale on metrics external to Kubernetes • KEDA does not modify the behavior of the application • Application designed using cloud native approach are more suited for KEDA integrations • KEDA helps to auto scale on composite metric • KEDA supports authentication providers
18. References https://www.youtube.com/@nilesh-gule https://dapr.io/ Dapr Publish and Subscribe Kubernetes Event Driven Autoscaling Serverless - Dapr and Azure Container Apps
19. Containerize Apps Resources https://github.com/NileshGule/pd-tech-fest-2019 https://github.com/NileshGule/cloud-native-ninja https://github.com/NileshGule/techtalks-azure-container-apps-demo Pd tech fest 2019 : https://github.com/NileshGule/pd-tech-fest-2019 Cloud Native Ninja : https://github.com/NileshGule/cloud-native-ninja Azure Container Apps : https://github.com/NileshGule/techtalks-azure-container-apps-demo Slides https://www.slideshare.net/nileshgule/ Slideshare: https://www.slideshare.net/nileshgule/ https://speakerdeck.com/nileshgule/ Speaker Deck: https://speakerdeck.com/nileshgule/
20. Nilesh Gule ARCHITECT | MICROSOFT MVP “Code with Passion and Strive for Excellence” nileshgule @nileshgule Nilesh Gule NileshGule www.handsonarchitect.com https://www.youtube.com/@nilesh-gule
21. #GlobalAzure Q&A