Improve observability of Kubernetes workloads using Prometheus and Grafana

Slidedeck is related to the presentation done for Azure Community Malaysia user group about Imporove Observability of Kubernetes workloads with Prometheus and Grafana on 11 September 2021.
Covered Prometheus Architecture, installation using Prometheus operator, Service Monitor, Pod Monitor, Alert rules. Live demo included Prometheus and Grafana integrations for Spring Boot and .Net Core application. Monitoring for infrastructure / messaging platforms using RabbitMQ is also covered.

https://www.meetup.com/en-AU/AzureMY/events/280331290

Transcript

1. Nilesh Gule @nileshgule | www.HandsOnArchitect.com Improve Observability of Kubernetes workloads With Prometheus and Grafana
2. $whoami { “name” : “Nilesh Gule”, “website” : “https://www.HandsOnArchitect.com", “github” : “https://GitHub.com/NileshGule" “twitter” : “@nileshgule”, “linkedin” : “https://www.linkedin.com/in/nileshgule”, “likes” : “Technical Evangelism, Cricket”, “co-organizer” : “Azure Singapore UG” } https://bit.ly/AzureSingaporeSessions
3. @nileshgule Kubernetes Observability Prometheus and Grafana Need for Prometheus & Grafana Prometehus Architecture Spring Boot integration demo .Net Core integration demo Alert manager demo Agenda
4. Pre-requisites • Self contained application with all its dependencies Docker • Orchestrates containers • Self healing • Service discovery • Scaling Kubernetes • Dockerhub / private container registry • Repository for storing container images Container Registry • Managed Kubernetes service on Azure • Native integration with other Azure services like Azure Active Directory (AAD), Azure Container registry (ACR), Azure Container Instances (ACI), Azure Monitor etc. Azure Kubernetes Service (AKS)
5. @nileshgule Rise of Cloud Native Adoption Building Cloud Native Software on Top of Kubernetes (slideshare.net)
7. @nileshgule CNCF cloud trail https://github.com/cncf/trailmap
8. @nileshgule Prometheus Architecture
9. @nileshgule Prometheus Metric Types
10. @nileshgule Install Prometheus using Kube-prometheues-stack https://github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack  Installs collection of Kubernetes manifests, Grafana dashboards and Prometheus rules  Documentation and scripts to provide easy to operate end-to-end Kubernetes cluster monitoring with Prometheus using the Prometheus operator  Prometheus operator : simplify & automate the configuration of Prometheus based monitoring stack for Kubernetes clusters  Kubernetes custom resources  Simplified deployment configuration (versions, persistence, retention policies, replicas)  Prometheus target configurations
11. @nileshgule Conference App Demo setup https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server
12. @nileshgule Spring Boot Conference App integration https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server
13. @nileshgule TechTalks Demo setup 1000 (configurable) messages Batch of 50 (configurable) messages https://github.com/NileshGule/pd-tech-fest-2019
14. @nileshgule .Net Core TechTalks Integration https://github.com/NileshGule/pd-tech-fest-2019
15. Summary • Modern day cloud native applications need new ways of monitoring • Prometheus provides easy to use metrics for platforms, applications • Use service monitor to scrape metrics for Kubernetes service • Use pod monitor to scrape metrics for Kubernetes pods • Grafana provides visualization capabilities to build intuitive dashboards • Alert Manager provides alerting capabilities based on Prometheus queries / expressions
16. Prometheus.io Grafana.com Kube Prometheus Stack Prometheus operator Houssem Dellai – Prometheus & Grafana for monitoring Kubernetes Tech world with Nana Prometheus debugging
17. https://github.com/NileshGule/pd-tech-fest-2019 https://github.com/NileshGule/spring-boot- conference-app/tree/mssql-server
18. Thank you very much Code with Passion and Strive for Excellence https://www.slideshare.net/nileshgule/presentations https://speakerdeck.com/nileshgule/
19. Nilesh Gule ARCHITECT | MICROSOFT MVP “Code with Passion and Strive for Excellence” nileshgule @nileshgule Nilesh Gule NileshGule www.handsonarchitect.com https://bit.ly/youtube-nileshgule
20. Q&A