Tweet
Tweet

Slide 1

Slide 1 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 1 © Copyright 2020 Rancher Labs. All Rights Reserved. 1 Monitoring in Kubernetes with Prometheus and Grafana BASTIAN HOFMANN Field Engineer - DACH

Slide 2

Slide 2 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 2 Rancher Technical Overview Rancher Technical Overview © Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 5 Rancher’s recipe for production quality Kubernetes at scale Shared Tooling & Services Security & Authentication Simplified Cluster Operations & Infrastructure Management Policy management Pod & network security policies CIS benchmark monitoring RBAC policies Configuration enforcement Visibility & diagnostics Centralized audit Monitoring & alerting Kubernetes version management Node pool management Cluster provisioning Amazon EKS Azure AKS Google GKE Cloud Datacenter Dev Branch Edge Secure Application Deployment Routing Autoscaling Metrics Load Balancing Canary Git Deployments Beta © Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 1 Rancher enables production quality Kubernetes operations everywhere Amazon EKS Azure AKS Google GKE Containerized App 1 Containerized App 2 Containerized App 3 Cloud Datacenter Dev Branch Edge Central Management Shared Tooling & Services Security & Authentication Simplified Cluster Operations & Infrastructure Management Policy management Pod & network security policies CIS benchmark monitoring RBAC policies Configuration enforcement Visibility & diagnostics Centralized audit Monitoring & alerting Kubernetes version management Node pool management Cluster provisioning Infrastructure agnostic

Slide 3

Slide 3 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 3 Agenda • How to set up Prometheus and Grafana • How to get and visualize metrics from Kubernetes • How to get and visualize metrics from your own applications • How to add alerts • How to collect logs from your applications • How Service Meshes help with traffic observability

Slide 4

Slide 4 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 4 4 Demos, Demos, Demos

Slide 5

Slide 5 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 5 5 First, we need a Kubernetes Cluster

Slide 6

Slide 6 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 6 6 Demo

Slide 7

Slide 7 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 7 7 Extending Kubernetes

Slide 8

Slide 8 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 8 Standardization of compute, network and service discovery

Slide 9

Slide 9 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 9 Extensible API

Slide 10

Slide 10 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 10 Easy integration of additional tools

Slide 11

Slide 11 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 11 Custom Resource Definitions • Extend the Kubernetes API with additional Resource Definitions • Certificate • MySQLCluster • Prometheus • … • Deploy a controller into the cluster that listens on creation, change and deletion of these resources and perform the necessary actions

Slide 12

Slide 12 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 12

Slide 13

Slide 13 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 13 13 Prometheus-operator

Slide 14

Slide 14 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 14 Manages and Configures Prometheus, Alertmanager (and Grafana)

Slide 15

Slide 15 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 15 CustomResourceDefinitions • Workload Management • Prometheus • Alertmanager • Prometheus Configuration • ServiceMonitor • PodMonitor • Rule

Slide 16

Slide 16 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 16

Slide 17

Slide 17 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 17 17 Demo

Slide 18

Slide 18 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 18 18 Monitoring external resources

Slide 19

Slide 19 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 19 Blackbox-monitor

Slide 20

Slide 20 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 20 20 Demo

Slide 21

Slide 21 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 21 21 Central log management

Slide 22

Slide 22 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 22 Several solutions • Commercial • OpenSource • ElasticSearch – FluentD/FluentBit/Logstash – Kibana • Loki – Promtail – Grafana

Slide 23

Slide 23 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 23 23 Demo

Slide 24

Slide 24 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 24 24 Service Meshes

Slide 25

Slide 25 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 25 Service Meshes • Observability • Traffic Control • Traffic Security • Connectivity • On top of the Kubernetes Pod network

Slide 26

Slide 26 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 26 Service Meshes • Istio • Linkerd • Maesh • Kuma • …

Slide 27

Slide 27 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 27

Slide 28

Slide 28 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 28 28 Service Mesh Features

Slide 29

Slide 29 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 29 Traffic Security • Automatic mutual TLS encryption of traffic • Automatic certificate management • Optional certificate-based authentication of traffic

Slide 30

Slide 30 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 30

Slide 31

Slide 31 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 31 Traffic Control • Advanced traffic management between services in the mesh • Blue/Green Deployments • Canary Deployments • A/B Testing • Fault injection • Circuit breakers

Slide 32

Slide 32 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 32

Slide 33

Slide 33 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 33 Multi-cluster Service Mesh • Connect separate Kubernetes cluster together • Securely handle traffic between clusters

Slide 34

Slide 34 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 34 Observability • Monitor all TCP connections, HTTP and GRCP requests • Bytes in/out • Amount of requests • Success rate • Response time • Visualize service communication

Slide 35

Slide 35 text

No content

Slide 36

Slide 36 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 36 Tracing • Trace a single incoming request through all services • Enhance with application spans through Open Tracing

Slide 37

Slide 37 text

No content

Slide 38

Slide 38 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 38 38 Demo

Slide 39

Slide 39 text

© Copyright 2020 Rancher Labs. All Rights Reserved. Confidential 39 39 Thank you Bastian Hofmann Field Engineer, DACH * [email protected]