Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Velocity 2017 SJ: Application Tracing
Search
Bryan Liles
June 21, 2017
Programming
2
360
Velocity 2017 SJ: Application Tracing
Workshops slides
Bryan Liles
June 21, 2017
Tweet
Share
More Decks by Bryan Liles
See All by Bryan Liles
DevOps Days MSP 2017
bryanl
2
1.1k
Application Ops 1.0
bryanl
1
200
DevOoops Mastery
bryanl
0
74
Go At Work
bryanl
0
230
The (Ruby) Sims
bryanl
1
140
How Vs Why
bryanl
0
130
ruby -pi -e.bak - Windy City Rails
bryanl
1
280
Arrrr Camp 2012: Simulating the World with Ruby
bryanl
2
520
Other Decks in Programming
See All in Programming
AI Agents: How Do They Work and How to Build Them @ Shift 2025
slobodan
0
100
Performance for Conversion! 分散トレーシングでボトルネックを 特定せよ
inetand
0
3.4k
2025 年のコーディングエージェントの現在地とエンジニアの仕事の変化について
azukiazusa1
24
12k
MCPとデザインシステムに立脚したデザインと実装の融合
yukukotani
4
1.5k
複雑なドメインに挑む.pdf
yukisakai1225
5
1.2k
アルテニア コンサル/ITエンジニア向け 採用ピッチ資料
altenir
0
110
Cache Me If You Can
ryunen344
2
4k
Reading Rails 1.0 Source Code
okuramasafumi
0
250
意外と簡単!?フロントエンドでパスキー認証を実現する WebAuthn
teamlab
PRO
2
780
時間軸から考えるTerraformを使う理由と留意点
fufuhu
16
4.8k
チームのテスト力を鍛える
goyoki
3
920
HTMLの品質ってなんだっけ? “HTMLクライテリア”の設計と実践
unachang113
4
2.9k
Featured
See All Featured
The World Runs on Bad Software
bkeepers
PRO
70
11k
Music & Morning Musume
bryan
46
6.8k
A Modern Web Designer's Workflow
chriscoyier
696
190k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
285
14k
Visualization
eitanlees
148
16k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Making Projects Easy
brettharned
117
6.4k
Designing for humans not robots
tammielis
253
25k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
30
9.7k
Become a Pro
speakerdeck
PRO
29
5.5k
Transcript
Application Tracing Velocity San Jose 2017
Your instructor •Bryan Liles •
[email protected]
•@bryanl
WIFI: OReilly Conf
Agenda • Workstation Setup • Goals • Tracing Introduction •
Exercise 1 • Break • Exercise 2 • Exercise 3 • Beyond the basics • Discussion • Closing
Workshop Setup • https://github.com/bryanl/velocity-sj-2017 • http://bit.ly/vsj2017-apptracing
• Jaeger • Language Specific Exercises • Jaeger Demo App
• Postgres
Today’s applications are complex
Shop
Shop Inventory Management Shipping
Shop Inventory Management Shipping Redis Postgres
How do we know what’s going on?
Shop
Shop Metrics For every resource, check utilization, saturation, and errors.
• Average busy time • Amount of capacity available • Error count
Shop Logging Capture events to help identify incidents and application
specific data • Auth success/failure • Validation failures • So many more
Shop Tracing Capture timing metrics from one or multiple resources
participating in a transaction. • Find latency issues and errors across resources
Shop Tracing
Tracing Request scoped Metrics Aggregates Logging Events Request scoped events
Aggregate events Request scoped metrics
Tracing Request scoped Metrics Aggregates Logging Events Prometheus ELK OpenTracing
Tracing
None
Terminology
Span: A period of time A span contains the following:
* Operation name * Start/Finish timestamps * Tags * Logs * References to other spans
Trace: a directed acyclic graph (DAG) of spans Span A
Span B Span C Span D Span E Span F Span G Span H
Trace: a DAG of spans Time ➡ Span A Span
B Span D Span C Span E Span F Span G Span H
OpenTracing
Google Dapper "We built dapper to provide Google’s developers with
more information about the behavior of complex distributed systems"
Google Dapper Design Goals • Low Overhead • Application-level transparency
• Scalability
Zipkin • Created by Twitter • Zipkin and Dapper are
based on the same principals
OpenTracing isn’t a framework
OpenTracing describes an abstraction for tracing distributed systems
Jaeger: OpenTracing Compatible Implementation
Jaeger Driver OpenTracing API App Jaeger
Standardization Why OpenTracing?
• Standardize span management • Standardize inter-process propagation • Standardize
active span management • Standardize in-band context encoding • Standardize out-of-band trace data encoding
Why Standardize? • Tracing should be easy and unobtrusive •
Competing standards dilute progress • The ecosystem is complex and diverse. It’s easier to drive to a single standard rather than having multiple.
Open Tracing Demo
pip install -U docker-compose
Workshop Setup
Activity: Tracing Concepts
Talking to Jaeger
Reporter Sampler Jaeger
Activity: More Tracing Concepts
Discussion / Lessons Learned
What should I log or tag? https://github.com/opentracing/specification/blob/master/semantic_conventions.md
Instrumenting
Searching for tags or events
Baggage Sometimes, you want to make data available for child
spans
Closing