OpenTelemetry Collector Deployment Patterns

Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

Juraci Paixão Kröhling - Red Hat OpenTelemetry Collector Deployment Patterns

Slide 3

Slide 3 text

Who am I? ➔ Juraci Paixão Kröhling ➔ @jpkrohling (github|twitter) ➔ Jaeger maintainer ➔ OpenTelemetry Collector approver

Slide 4

Slide 4 text

Agenda ➔ OpenTelemetry ➔ OpenTelemetry Collector ➔ Patterns! @jpkrohling

Slide 5

Slide 5 text

Patterns ➔ Pattern #1 - Basic I and II ➔ Pattern #2 - Normalizer ➔ Pattern #3 - On Kubernetes ➔ Pattern #4 - Load balancer ➔ Pattern #5 - Multi-cluster ➔ Pattern #6 - Multitenant @jpkrohling

Slide 6

Slide 6 text

Patterns ➔ Take a look at the GitHub repository for detailed explanations and working examples. @jpkrohling

Slide 7

Slide 7 text

OpenTelemetry ➔ Fusion of OpenTracing and OpenCensus ➔ Specifications and conventions ➔ Client APIs and SDKs ➔ OTLP (Line Protocol) ➔ Collector (or “otelcol”) @jpkrohling

Slide 8

Slide 8 text

OpenTelemetry Collector “Vendor-agnostic way to receive, process and export telemetry data.” -- https://opentelemetry.io/docs/collector/ @jpkrohling

Slide 9

Slide 9 text

OpenTelemetry Collector ➔ Receivers ➔ Processors ➔ Exporters ➔ Extensions @jpkrohling

Slide 10

Slide 10 text

OpenTelemetry Collector @jpkrohling

Slide 11

Slide 11 text

OpenTelemetry Collector ➔ Receivers ◆ Jaeger ◆ Prometheus ◆ OTLP ◆ Zipkin ◆ ... @jpkrohling

Slide 12

Slide 12 text

OpenTelemetry Collector ➔ Processors ◆ Sampling ◆ Change attributes ◆ Batching ◆ ... @jpkrohling

Slide 13

Slide 13 text

OpenTelemetry Collector ➔ Exporters ◆ Jaeger, Zipkin, ... ◆ Prometheus ◆ OTLP ◆ Pretty much all commercial vendors... @jpkrohling

Slide 14

Slide 14 text

OpenTelemetry Collector ➔ Contrib is where all non-core components live, including vendor-specific ones ➔ Builder allows you to create your own distribution @jpkrohling

Slide 15

Slide 15 text

OpenTelemetry Collector $ cat opentelemetry-collector-config.yaml extensions: health_check: receivers: otlp: protocols: grpc: processors: batch: exporters: logging: service: extensions: [health_check] pipelines: traces: receivers: [otlp] processors: [batch] exporters: [logging] @jpkrohling

Slide 16

Slide 16 text

Pattern #1 - Basic I ➔ OpenTelemetry SDK with OTLP ➔ OpenTelemetry Collector ➔ Jaeger @jpkrohling

Slide 17

Slide 17 text

Pattern #1 - Basic I @jpkrohling

Slide 18

Slide 18 text

Pattern #1 - Basic II - Fanout ➔ OpenTelemetry SDK with OTLP ➔ OpenTelemetry Collector ➔ Jaeger ➔ Some vendor @jpkrohling

Slide 19

Slide 19 text

Pattern #1 - Basic II - Fanout @jpkrohling

Slide 20

Slide 20 text

Pattern #2 - Normalizer ➔ Prometheus client ➔ Jaeger client ➔ Collector with attributes processor ➔ Jaeger ➔ Prometheus @jpkrohling

Slide 21

Slide 21 text

Pattern #2 - Normalizer @jpkrohling

Slide 22

Slide 22 text

Pattern #3 - On Kubernetes I ➔ Workload pod with collector sidecar ➔ Collector ➔ Backends @jpkrohling

Slide 23

Slide 23 text

Pattern #3 - On Kubernetes I @jpkrohling

Slide 24

Slide 24 text

Pattern #3 - On Kubernetes I @jpkrohling

Slide 25

Slide 25 text

Pattern #3 - On Kubernetes I @jpkrohling

Slide 26

Slide 26 text

Pattern #3 - On Kubernetes II ➔ Collector as DaemonSet ➔ Collector ➔ Backends @jpkrohling

Slide 27

Slide 27 text

Pattern #3 - On Kubernetes II @jpkrohling

Slide 28

Slide 28 text

Pattern #3 - On Kubernetes II @jpkrohling

Slide 29

Slide 29 text

Pattern #4 - Load balancer ➔ Multiple services sending data ➔ Trace ID aware load balancer ➔ Scalable tail-based sampling! ➔ Backends @jpkrohling