Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTelemetry at AWS

E7526ec3e801f8ba99f6746498a154a6?s=47 JBD
May 18, 2021
Programming
1
1.5k

OpenTelemetry at AWS

Register and watch this talk now! https://o11yfest.org/attend.

E7526ec3e801f8ba99f6746498a154a6?s=128

JBD

May 18, 2021
Tweet

More Decks by JBD

See All by JBD
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
1.5k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
1.2k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
5
1.3k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
8
1.9k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
3
1.2k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
150
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
0
200
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
2
940
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
0
3.8k

Other Decks in Programming

See All in Programming
4bcb32bcb73d1ead993a6ad55b189e9e?s=48 rluisr
1
130
646a01801bac1886ddf86aee2de913ed?s=48 miyukki
0
130
2a67c9a199a83a5eada6276f20630cb1?s=48 ohr486
3
150
404a34d5e0d3d7b38237a8cbecf4c18a?s=48 seiseikai123
0
240
5c588fdfe782f92fa6b081903edd82bb?s=48 hr01
2
10k
Ae276805027a01983503c3edafbdb6b2?s=48 martysuzuki
5
610
Fb8392642d939c918bf61fc6d8094409?s=48 misawasan
0
150
249b3122eee454c0a818bfe7851418e4?s=48 fromkk
0
880
0c217b9a7dd0aa31ed40bd0f453727e1?s=48 ramsey
PRO
1
250
993ef638264def4334358f986fb4a91d?s=48 uhyo
26
6.9k
Fbe7836c8ca96e3099dd5bbd83d1a391?s=48 hideg
0
370
Ae763d151aeee101b40ae10cc13ebe63?s=48 maroon1st
0
360

Featured

See All Featured
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
44
2.3k
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
11
1.3k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
396
61k
Eb8975af8e49e19e3dd6b6b84a542e26?s=48 qrush
288
19k
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
149
12k
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
100
15k
053e75a5b48b44d6dd0612795dfb326d?s=48 notwaldorf
56
3.6k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
125
5.2k
B47b288784fda77a94aeb234ca743c24?s=48 keavy
112
15k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
277
17k
Be9caeb9d4ef9944d151af909063ed6e?s=48 samlambert
238
10k
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1021
410k

Transcript

  1. @rakyll OpenTelemetry at AWS Jaana Dogan Principal Engineer, AWS jbd@amazon.com

  2. @rakyll Who? Jaana Dogan, AWS Explicit focus on instrumentation

  3. @rakyll Five AWS stories... Too many agents Too many formats

    Too little correlation Too many ways to propagate Too many products to support

  4. @rakyll Too many agents 4-5 agents Friction in installation Operational

    burden Friction in configuration delivery Performance penalty

  5. @rakyll Too many formats EMF CloudWatch Prometheus statsd Vendor formats

    ... X-Ray Zipkin Jaeger Vendor formats ...

  6. @rakyll Too little correlation Tool fatigue Disjoint views Missing metadata

    Friction in troubleshooting

  7. @rakyll Too many ways to propagate Lack of end-to-end traces

    Missing label propagation No W3C TraceContext or B3 support No runtime propagation standards

  8. @rakyll Too many products to support CloudWatch X-Ray Prometheus Elasticsearch/OpenSearch

    New Relic, Datadog, Splunk, Honeycomb, Lightstep and more.

  9. @rakyll What do we use? Specification Context Propagation Semantic Conventions

    Data Model Protocol (OTLP) Collector Client Libraries

  10. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc.

  11. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc.

  12. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin

  13. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Elastic/OpenSearch Jaeger Zipkin Vendors Raw storage

  14. @rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,

    etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Jaeger Zipkin Vendors Raw storage enrich, transform, ...

  15. @rakyll Container Insights now collected by OpenTelemetry.

  16. @rakyll What do we use? Specification Context Propagation Semantic Conventions

    Data Model Protocol (OTLP) Collector Client Libraries

  17. @rakyll What works well? Flexible Composable Lightweight enough Holistic Legacy

    protocol friendly Community

  18. @rakyll What challenges us? Stability Custom builds Compatibility (Prometheus &

    CloudWatch) Boilerplate in client libraries

  19. @rakyll What are we working on next?

  20. @rakyll Prometheus

  21. @rakyll Prometheus Drop-in replacement for Prometheus Data model changes Remote

    write compliance Discovery + scrape config compliance Kubernetes operator

  22. @rakyll Components Container Insights receivers and processors CloudWatch histogram compatibility

    CloudWatch Logs exporter S3 exporter

  23. @rakyll Propagation Adopting 128-bit trace IDs in X-Ray Context propagation

    in SQL

  24. @rakyll Platforms EC2 ECS EKS Lambda (and control plane components...)

  25. @rakyll Lambda support

  26. @rakyll Others... eBPF Profiles Real time user monitoring Network diagnostics

    Database performance

  27. @rakyll One more thing...

  28. @rakyll Exporting to vendors? Vended data streams CloudWatch Metric Streams

    support OTLP CW Metrics S3 (in JSON or OTLP) Kinesis (in JSON or OTLP)

  29. @rakyll It’s not a fork. It’s a snapshot for security,

    performance, support.

  30. @rakyll Thank you Jaana Dogan Principal Engineer, AWS jbd@amazon.com