Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
OpenTelemetry at AWS
Search
JBD
May 18, 2021
Programming
1
1.8k
OpenTelemetry at AWS
Register and watch this talk now!
https://o11yfest.org/attend
.
JBD
May 18, 2021
Tweet
Share
More Decks by JBD
See All by JBD
eBPF in Microservices Observability at eBPF Day
rakyll
1
2k
eBPF in Microservices Observability
rakyll
1
1.6k
Debugging Code Generation in Go
rakyll
5
1.4k
Are you ready for production?
rakyll
8
2.5k
Servers are doomed to fail
rakyll
3
1.4k
Serverless Containers
rakyll
1
220
Critical Path Analysis
rakyll
0
410
Monitoring and Debugging Containers
rakyll
2
1.1k
CPDD
rakyll
0
4.1k
Other Decks in Programming
See All in Programming
Tailwind CSSを本気でカスタマイズする方法
fsubal
13
5.2k
Elm Form Validation
bkuhlmann
0
510
R言語の環境構築と基礎 Tokyo.R 112
bob3bob3
0
260
ゆるい個人開発のススメ
kuroppe1819
10
990
新宿ダンジョンを可視化してみた
satoshi7190
2
240
コーンフレークから始める モデリング会話入門
ogurotakayuki
0
360
Micro Frontends for Java Microservices - Devnexus 2024
mraible
PRO
0
490
データアナリストが行うDatabricksを活用したETLの自動化事例
shinoa
0
260
[技育CAMPアカデミア]アイディアを形に!【超入門】スマホアプリ開発〜リリースまでの流れをご紹介
teamlab
PRO
0
360
What We Can Learn From OSS
inouehi
0
420
サイコロで理解する統計的仮説検定の考え方
tatamiya
4
910
Semantic search with Django and pgvector
pauloxnet
0
240
Featured
See All Featured
What's in a price? How to price your products and services
michaelherold
237
11k
Building a Modern Day E-commerce SEO Strategy
aleyda
17
6.4k
Ruby is Unlike a Banana
tanoku
96
10k
Building Better People: How to give real-time feedback that sticks.
wjessup
355
18k
The Pragmatic Product Professional
lauravandoore
25
5.8k
Happy Clients
brianwarren
92
6.4k
Designing on Purpose - Digital PM Summit 2013
jponch
110
6.5k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
2
3.4k
4 Signs Your Business is Dying
shpigford
175
21k
What's new in Ruby 2.0
geeforr
337
31k
Raft: Consensus for Rubyists
vanstee
132
6.3k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
352
28k
Transcript
@rakyll OpenTelemetry at AWS Jaana Dogan Principal Engineer, AWS
[email protected]
@rakyll Who? Jaana Dogan, AWS Explicit focus on instrumentation
@rakyll Five AWS stories... Too many agents Too many formats
Too little correlation Too many ways to propagate Too many products to support
@rakyll Too many agents 4-5 agents Friction in installation Operational
burden Friction in configuration delivery Performance penalty
@rakyll Too many formats EMF CloudWatch Prometheus statsd Vendor formats
... X-Ray Zipkin Jaeger Vendor formats ...
@rakyll Too little correlation Tool fatigue Disjoint views Missing metadata
Friction in troubleshooting
@rakyll Too many ways to propagate Lack of end-to-end traces
Missing label propagation No W3C TraceContext or B3 support No runtime propagation standards
@rakyll Too many products to support CloudWatch X-Ray Prometheus Elasticsearch/OpenSearch
New Relic, Datadog, Splunk, Honeycomb, Lightstep and more.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Elastic/OpenSearch Jaeger Zipkin Vendors Raw storage
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Jaeger Zipkin Vendors Raw storage enrich, transform, ...
@rakyll Container Insights now collected by OpenTelemetry.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What works well? Flexible Composable Lightweight enough Holistic Legacy
protocol friendly Community
@rakyll What challenges us? Stability Custom builds Compatibility (Prometheus &
CloudWatch) Boilerplate in client libraries
@rakyll What are we working on next?
@rakyll Prometheus
@rakyll Prometheus Drop-in replacement for Prometheus Data model changes Remote
write compliance Discovery + scrape config compliance Kubernetes operator
@rakyll Components Container Insights receivers and processors CloudWatch histogram compatibility
CloudWatch Logs exporter S3 exporter
@rakyll Propagation Adopting 128-bit trace IDs in X-Ray Context propagation
in SQL
@rakyll Platforms EC2 ECS EKS Lambda (and control plane components...)
@rakyll Lambda support
@rakyll Others... eBPF Profiles Real time user monitoring Network diagnostics
Database performance
@rakyll One more thing...
@rakyll Exporting to vendors? Vended data streams CloudWatch Metric Streams
support OTLP CW Metrics S3 (in JSON or OTLP) Kinesis (in JSON or OTLP)
@rakyll It’s not a fork. It’s a snapshot for security,
performance, support.
@rakyll Thank you Jaana Dogan Principal Engineer, AWS
[email protected]