Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
OpenTelemetry at AWS
Search
JBD
May 18, 2021
Programming
1
1.8k
OpenTelemetry at AWS
Register and watch this talk now!
https://o11yfest.org/attend
.
JBD
May 18, 2021
Tweet
Share
More Decks by JBD
See All by JBD
eBPF in Microservices Observability at eBPF Day
rakyll
1
2k
eBPF in Microservices Observability
rakyll
1
1.6k
Debugging Code Generation in Go
rakyll
5
1.5k
Are you ready for production?
rakyll
8
2.6k
Servers are doomed to fail
rakyll
3
1.5k
Serverless Containers
rakyll
1
230
Critical Path Analysis
rakyll
0
490
Monitoring and Debugging Containers
rakyll
2
1.1k
CPDD
rakyll
0
4.1k
Other Decks in Programming
See All in Programming
GoのIteratorに詳しくなってしまう
inatonix
1
190
私のEbitengineの第一歩
qt_luigi
0
440
仮想ファイルシステムを導入して開発環境のストレージ課題を解消する
segadevtech
2
490
開発を加速する共有Swift Package実践
elmetal
PRO
0
380
rbs-inlineを導入してYARDからRBSに移行する
euglena1215
1
230
What we keep in mind when migrating from Serverless Framework to AWS CDK and AWS SAM
kasacchiful
1
140
Web技術を駆使してユーザーの画面を「録画」する
yukukotani
13
6.5k
令和トラベルにおけるLLM活用事例:社内ツール開発から得た学びと実践
ippo012
0
120
オートマトン学習しろ / Do automata learning
makenowjust
3
110
Rustではじめる負荷試験
skanehira
5
1.2k
全力の跳躍を捉える計測アプリを作る
ogijun2018
1
1.3k
[DroidKaigi 2024] Android ViewからJetpack Composeへ 〜Jetpack Compose移行のすゝめ〜 / From Android View to Jetpack Compose: A Guide to Migration
syarihu
1
220
Featured
See All Featured
Facilitating Awesome Meetings
lara
49
5.9k
Designing on Purpose - Digital PM Summit 2013
jponch
113
6.8k
Fireside Chat
paigeccino
31
2.9k
Scaling GitHub
holman
458
140k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
248
20k
Unsuck your backbone
ammeep
667
57k
Statistics for Hackers
jakevdp
793
220k
Optimising Largest Contentful Paint
csswizardry
29
2.8k
Art, The Web, and Tiny UX
lynnandtonic
294
20k
Fashionably flexible responsive web design (full day workshop)
malarkey
401
65k
Become a Pro
speakerdeck
PRO
22
4.9k
Designing Experiences People Love
moore
138
23k
Transcript
@rakyll OpenTelemetry at AWS Jaana Dogan Principal Engineer, AWS
[email protected]
@rakyll Who? Jaana Dogan, AWS Explicit focus on instrumentation
@rakyll Five AWS stories... Too many agents Too many formats
Too little correlation Too many ways to propagate Too many products to support
@rakyll Too many agents 4-5 agents Friction in installation Operational
burden Friction in configuration delivery Performance penalty
@rakyll Too many formats EMF CloudWatch Prometheus statsd Vendor formats
... X-Ray Zipkin Jaeger Vendor formats ...
@rakyll Too little correlation Tool fatigue Disjoint views Missing metadata
Friction in troubleshooting
@rakyll Too many ways to propagate Lack of end-to-end traces
Missing label propagation No W3C TraceContext or B3 support No runtime propagation standards
@rakyll Too many products to support CloudWatch X-Ray Prometheus Elasticsearch/OpenSearch
New Relic, Datadog, Splunk, Honeycomb, Lightstep and more.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc.
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Elastic/OpenSearch Jaeger Zipkin Vendors Raw storage
@rakyll What’s next? collector Managed on EC2, ECS, EKS, Lambda,
etc. OTLP Prometheus statsd X-Ray Jaeger Zipkin CloudWatch Prometheus X-Ray Jaeger Zipkin Vendors Raw storage enrich, transform, ...
@rakyll Container Insights now collected by OpenTelemetry.
@rakyll What do we use? Specification Context Propagation Semantic Conventions
Data Model Protocol (OTLP) Collector Client Libraries
@rakyll What works well? Flexible Composable Lightweight enough Holistic Legacy
protocol friendly Community
@rakyll What challenges us? Stability Custom builds Compatibility (Prometheus &
CloudWatch) Boilerplate in client libraries
@rakyll What are we working on next?
@rakyll Prometheus
@rakyll Prometheus Drop-in replacement for Prometheus Data model changes Remote
write compliance Discovery + scrape config compliance Kubernetes operator
@rakyll Components Container Insights receivers and processors CloudWatch histogram compatibility
CloudWatch Logs exporter S3 exporter
@rakyll Propagation Adopting 128-bit trace IDs in X-Ray Context propagation
in SQL
@rakyll Platforms EC2 ECS EKS Lambda (and control plane components...)
@rakyll Lambda support
@rakyll Others... eBPF Profiles Real time user monitoring Network diagnostics
Database performance
@rakyll One more thing...
@rakyll Exporting to vendors? Vended data streams CloudWatch Metric Streams
support OTLP CW Metrics S3 (in JSON or OTLP) Kinesis (in JSON or OTLP)
@rakyll It’s not a fork. It’s a snapshot for security,
performance, support.
@rakyll Thank you Jaana Dogan Principal Engineer, AWS
[email protected]