Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Improve observability of Kubernetes workloads using Prometheus and Grafana

9e33a1d43a88f23f6c545c1e0f07f4b5?s=47 Nilesh Gule
September 11, 2021

Improve observability of Kubernetes workloads using Prometheus and Grafana

Slidedeck is related to the presentation done for Azure Community Malaysia user group about Imporove Observability of Kubernetes workloads with Prometheus and Grafana on 11 September 2021.
Covered Prometheus Architecture, installation using Prometheus operator, Service Monitor, Pod Monitor, Alert rules. Live demo included Prometheus and Grafana integrations for Spring Boot and .Net Core application. Monitoring for infrastructure / messaging platforms using RabbitMQ is also covered.

https://www.meetup.com/en-AU/AzureMY/events/280331290

9e33a1d43a88f23f6c545c1e0f07f4b5?s=128

Nilesh Gule

September 11, 2021
Tweet

More Decks by Nilesh Gule

Other Decks in Technology

Transcript

  1. Nilesh Gule @nileshgule | www.HandsOnArchitect.com Improve Observability of Kubernetes workloads

    With Prometheus and Grafana
  2. $whoami { “name” : “Nilesh Gule”, “website” : “https://www.HandsOnArchitect.com", “github”

    : “https://GitHub.com/NileshGule" “twitter” : “@nileshgule”, “linkedin” : “https://www.linkedin.com/in/nileshgule”, “likes” : “Technical Evangelism, Cricket”, “co-organizer” : “Azure Singapore UG” } https://bit.ly/AzureSingaporeSessions
  3. @nileshgule Kubernetes Observability Prometheus and Grafana Need for Prometheus &

    Grafana Prometehus Architecture Spring Boot integration demo .Net Core integration demo Alert manager demo Agenda
  4. Pre-requisites • Self contained application with all its dependencies Docker

    • Orchestrates containers • Self healing • Service discovery • Scaling Kubernetes • Dockerhub / private container registry • Repository for storing container images Container Registry • Managed Kubernetes service on Azure • Native integration with other Azure services like Azure Active Directory (AAD), Azure Container registry (ACR), Azure Container Instances (ACI), Azure Monitor etc. Azure Kubernetes Service (AKS)
  5. @nileshgule Rise of Cloud Native Adoption Building Cloud Native Software

    on Top of Kubernetes (slideshare.net)
  6. None
  7. @nileshgule CNCF cloud trail https://github.com/cncf/trailmap

  8. @nileshgule Prometheus Architecture

  9. @nileshgule Prometheus Metric Types

  10. @nileshgule Install Prometheus using Kube-prometheues-stack https://github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack  Installs collection of

    Kubernetes manifests, Grafana dashboards and Prometheus rules  Documentation and scripts to provide easy to operate end-to-end Kubernetes cluster monitoring with Prometheus using the Prometheus operator  Prometheus operator : simplify & automate the configuration of Prometheus based monitoring stack for Kubernetes clusters  Kubernetes custom resources  Simplified deployment configuration (versions, persistence, retention policies, replicas)  Prometheus target configurations
  11. @nileshgule Conference App Demo setup https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server

  12. @nileshgule Spring Boot Conference App integration https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server

  13. @nileshgule TechTalks Demo setup 1000 (configurable) messages Batch of 50

    (configurable) messages https://github.com/NileshGule/pd-tech-fest-2019
  14. @nileshgule .Net Core TechTalks Integration https://github.com/NileshGule/pd-tech-fest-2019

  15. Summary • Modern day cloud native applications need new ways

    of monitoring • Prometheus provides easy to use metrics for platforms, applications • Use service monitor to scrape metrics for Kubernetes service • Use pod monitor to scrape metrics for Kubernetes pods • Grafana provides visualization capabilities to build intuitive dashboards • Alert Manager provides alerting capabilities based on Prometheus queries / expressions
  16. Prometheus.io Grafana.com Kube Prometheus Stack Prometheus operator Houssem Dellai –

    Prometheus & Grafana for monitoring Kubernetes Tech world with Nana Prometheus debugging
  17. https://github.com/NileshGule/pd-tech-fest-2019 https://github.com/NileshGule/spring-boot- conference-app/tree/mssql-server

  18. Thank you very much Code with Passion and Strive for

    Excellence https://www.slideshare.net/nileshgule/presentations https://speakerdeck.com/nileshgule/
  19. Nilesh Gule ARCHITECT | MICROSOFT MVP “Code with Passion and

    Strive for Excellence” nileshgule @nileshgule Nilesh Gule NileshGule www.handsonarchitect.com https://bit.ly/youtube-nileshgule
  20. Q&A