OpenTelemetry – An Observability Framework for Cloud-Native Software (VoxxedDays Zürich)

In cloud-native technology stacks, distributed and polyglot architectures are the norm. Distributed architectures introduce a variety of operational challenges including how to solve availability and performance issues quickly.

These challenges have led to the rise of observability. Telemetry data is needed to power observability products. Traditionally, telemetry data has been provided by either open-source projects or commercial vendors. With a lack of standardization, the net result is the lack of data portability and the burden on the user to maintain the instrumentation.

This session introduces the OpenTelemetry project which solves these problems by providing a single, vendor-agnostic solution. We'll take a look at the different parts of the specification and how OpenTelemetry integrates with popular frameworks and libraries. Finally we look at the interaction with Cloud infrastructure as OpenTelemetry is especially focused on cloud-native applications.

https://voxxeddays.com/zurich/schedule/talk/?id=1439

Transcript

1. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. OpenTelemetry An Observability Framework for Cloud-Native Software Dennis Kieselhorst Sr. Solutions Architect Amazon Web Services
2. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates.
3. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. Foundation for observability METRICS TRACES LOGS
4. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. CNCF Cloud Native Landscape http://l.cncf.io
5. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. CNCF Cloud Native Landscape http://l.cncf.io
6. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. CNCF end-user technology radar „1. The most commonly adopted tools are open source. 2. There’s no consolidation in the observability space. 3. Prometheus and Grafana are frequently used together.” https://radar.cncf.io/2020-09-observability https://www.cncf.io/blog/2020/09/11/cncf-end-user-technology-radar-observability-september-2020/
7. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. What is OpenTelemetry OpenTelemetry is a collection of tools, APIs, and SDKs. You can use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) for analysis in order to understand your software's performance and behavior. A N O B S E R V A B I L I T Y F R A M E W O R K F O R C L O U D - N A T I V E S O F T W A R E Broad Language Support Java | C# | Go | JavaScript | PHP | Python | Rust | C++ | Erlang/Elixir | .NET | Swift Integrates With Popular Frameworks and Libraries MySQL | Redis | Django | Kafka | Jetty | Akka | RabbitMQ | Spring | Flask | net/http | gorilla/mux | WSGI | JDBC | PostgreSQL https://opentelemetry.io
8. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. OpenTelemetry Reference architecture https://opentelemetry.io/docs/
9. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. OpenTelemetry status METRICS TRACES LOGS API: stable SDK: mixed Protocol: stable https://opentelemetry.io/status/ API: draft SDK: draft Protocol: beta API: stable SDK: stable Protocol: stable
10. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. 13 Demo Blog: https://a.co/5sIvwvL Workshop: https://observability.workshop.aws
11. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. OpenTelemetry Collector https://opentelemetry.io/docs/collector/
12. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. AWS OTel Collector Amazon Managed Service for Prometheus Workspace AWS EMF Exporter Prometheus Exporter AWS X-Ray Exporter OTLP Receiver Processor Amazon CloudWatch AWS X-Ray Example: OpenTelemetry Collector on AWS 𝜇Service1 Amazon Elastic Kubernetes Service (EKS) Amazon Elastic Container Service (ECS) AWS Container Insights Receiver Prometheus Receiver
13. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. Resources • Observability Workshop: https://observability.workshop.aws • Developer Portal: https://aws-otel.github.io • Overview page: http://aws.amazon.com/otel • Roadmap: https://github.com/orgs/aws-observability/projects/4 • Feature requests, bugs: https://github.com/aws- observability/aws-otel-community/issues • OpenTelemetry spec https://github.com/open- telemetry/opentelemetry-specification/tree/main/specification • Contact us on Gitter: https://gitter.im/aws-otel- distro/community
14. VOXXED DAYS ZURICH 2022 - OPENTELEMETRY © 2022, Amazon Web Services, Inc. or its affiliates. Thank you! © 2022, Amazon Web Services, Inc. or its affiliates. Dennis Kieselhorst linkedin.com/in/kieselhorst/