Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTelemetry at AWS

E7526ec3e801f8ba99f6746498a154a6?s=47 JBD
May 18, 2021
Programming
1
1.6k

OpenTelemetry at AWS

Register and watch this talk now! https://o11yfest.org/attend.

E7526ec3e801f8ba99f6746498a154a6?s=128

JBD

May 18, 2021
Tweet

More Decks by JBD

See All by JBD
eBPF in Microservices Observability at eBPF Day
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
1.7k
eBPF in Microservices Observability
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
1.3k
Debugging Code Generation in Go
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
5
1.3k
Are you ready for production?
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
8
2.1k
Servers are doomed to fail
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
3
1.2k
Serverless Containers
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
170
Critical Path Analysis
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
0
250
Monitoring and Debugging Containers
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
2
980
CPDD
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
0
3.8k

Other Decks in Programming

See All in Programming
話題の AlloyDB は本当に凄いデータベースなのでプレビューを使い倒した #devio2022
Ae763d151aeee101b40ae10cc13ebe63?s=48 maroon1st
0
13k
Rに管理されてみる
154699a2e3d8b497494a5ee118f211a5?s=48 kazutan
0
260
Now in Android Overview
62384887995a0ce07ec4f86b89f5ec9e?s=48 aosa4054
1
410
Atomic Design とテストの○○な話
Fd3e212c7b5255c6164d7d52bfe79dfb?s=48 takfjp
2
820
OSS貢献を気軽にしたい Let's Go Talk #1
Aa0368c69701536321af9db1ae552b45?s=48 yuyaabo
2
240
SwiftUIで「意図」を伝える / swiftui_intention
42a6a049ac8f5265f31858a9509217fb?s=48 uhooi
2
150
レビュー駆動学習のススメ_StaPy#83
86b349524dfba1c635e944f2a9c92e91?s=48 soogie
0
320
Amazon Lookout for Visionで 筆跡鑑定してみた
B3cc0e7ba8e6c941f08a2e6f69d3e4c2?s=48 cmnakamurashogo
0
170
Pluggable Storage in PostgreSQL
62f5ee39e37ba4f8a22acc714781c879?s=48 sira
1
190
パスワードに関する最近の動向
8fd1ae6548d5ab14139c8d8032b76ee1?s=48 kenchan0130
1
330
Isar勉強会
693ed679c8dde3eccbc682ff44f357e1?s=48 hoddy3190
0
520
Carp言語さわってみた 〜鯉を取り戻せ編〜
Ced5def68f1a6bcd0736018bc64b116d?s=48 tsin45
0
110

Featured

See All Featured
5 minutes of I Can Smell Your CMS
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
196
18k
StorybookのUI Testing Handbookを読んだ
50fc0fdc2327ecbe7350645812de52e3?s=48 zakiyama
6
2.5k
Pencils Down: Stop Designing & Start Developing
79acae287842acf29084005533a7fb3b?s=48 hursman
113
9.9k
How To Stay Up To Date on Web Technology
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
780
250k
A Philosophy of Restraint
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
192
15k
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
173
8.6k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
In The Pink: A Labor of Love
E837d2996f52008ace055a08fbfff992?s=48 frogandcode
131
21k
A Tale of Four Properties
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
149
21k
How to name files
0a4f62e90c976eeb44d33add75cca5af?s=48 jennybc
40
63k
Reflections from 52 weeks, 52 projects
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
337
17k
The Straight Up "How To Draw Better" Workshop
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
225
130k

Transcript

  1. @rakyll OpenTelemetry at AWS Jaana Dogan Principal Engineer, AWS jbd@amazon.com

  2. @rakyll Who? Jaana Dogan, AWS Explicit focus on instrumentation

  3. @rakyll Five AWS stories... Too many agents Too many formats

    Too little correlation Too many ways to propagate Too many products to support

  4. @rakyll Too many agents 4-5 agents Friction in installation Operational

    burden Friction in configuration delivery Performance penalty

  5. @rakyll Too many formats EMF CloudWatch Prometheus statsd Vendor formats

    ... X-Ray Zipkin Jaeger Vendor formats ...

  6. @rakyll Too little correlation Tool fatigue Disjoint views Missing metadata

    Friction in troubleshooting

  7. @rakyll Too many ways to propagate Lack of end-to-end traces

    Missing label propagation No W3C TraceContext or B3 support No runtime propagation standards

  8. @rakyll Too many products to support CloudWatch X-Ray Prometheus Elasticsearch/OpenSearch

    New Relic, Datadog, Splunk, Honeycomb, Lightstep and more.

  9. @rakyll What do we use? Specification Context Propagation Semantic Conventions

    Data Model Protocol (OTLP) Collector Client Libraries

  10. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc.

  11. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc.

  12. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin

  13. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Elastic/OpenSearch Jaeger Zipkin Vendors Raw storage

  14. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Jaeger Zipkin Vendors Raw storage enrich, transform, ...

  15. @rakyll Container Insights now collected by OpenTelemetry.

  16. @rakyll What do we use? Specification Context Propagation Semantic Conventions

    Data Model Protocol (OTLP) Collector Client Libraries

  17. @rakyll What works well? Flexible Composable Lightweight enough Holistic Legacy

    protocol friendly Community

  18. @rakyll What challenges us? Stability Custom builds Compatibility (Prometheus &

    CloudWatch) Boilerplate in client libraries

  19. @rakyll What are we working on next?

  20. @rakyll Prometheus

  21. @rakyll Prometheus Drop-in replacement for Prometheus Data model changes Remote

    write compliance Discovery + scrape config compliance Kubernetes operator

  22. @rakyll Components Container Insights receivers and processors CloudWatch histogram compatibility

    CloudWatch Logs exporter S3 exporter

  23. @rakyll Propagation Adopting 128-bit trace IDs in X-Ray Context propagation

    in SQL

  24. @rakyll Platforms EC2 ECS EKS Lambda (and control plane components...)

  25. @rakyll Lambda support

  26. @rakyll Others... eBPF Profiles Real time user monitoring Network diagnostics

    Database performance

  27. @rakyll One more thing...

  28. @rakyll Exporting to vendors? Vended data streams CloudWatch Metric Streams

    support OTLP CW Metrics S3 (in JSON or OTLP) Kinesis (in JSON or OTLP)

  29. @rakyll It’s not a fork. It’s a snapshot for security,

    performance, support.

  30. @rakyll Thank you Jaana Dogan Principal Engineer, AWS jbd@amazon.com