Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Velocity 2017 SJ: Application Tracing
Search
Bryan Liles
June 21, 2017
Programming
2
360
Velocity 2017 SJ: Application Tracing
Workshops slides
Bryan Liles
June 21, 2017
Tweet
Share
More Decks by Bryan Liles
See All by Bryan Liles
DevOps Days MSP 2017
bryanl
2
1.1k
Application Ops 1.0
bryanl
1
190
DevOoops Mastery
bryanl
0
70
Go At Work
bryanl
0
220
The (Ruby) Sims
bryanl
1
130
How Vs Why
bryanl
0
130
ruby -pi -e.bak - Windy City Rails
bryanl
1
270
Arrrr Camp 2012: Simulating the World with Ruby
bryanl
2
510
Other Decks in Programming
See All in Programming
生成AIコーディングとの向き合い方、AIと共創するという考え方 / How to deal with generative AI coding and the concept of co-creating with AI
seike460
PRO
1
220
try-catchを使わないエラーハンドリング!? PHPでResult型の考え方を取り入れてみよう
kajitack
3
500
eBPFを用いたAIネットワーク監視システム論文の実装 / eBPF Japan Meetup #4
yuukit
3
750
Passkeys for Java Developers
ynojima
3
850
インターフェース設計のコツとツボ
togishima
2
710
ドメインモデリングにおける抽象の役割、tagless-finalによるDSL構築、そして型安全な最適化
knih
10
1.8k
AWS CDKの推しポイント 〜CloudFormationと比較してみた〜
akihisaikeda
3
230
関数型まつり2025登壇資料「関数プログラミングと再帰」
taisontsukada
2
800
XSLTで作るBrainfuck処理系
makki_d
0
190
Go1.25からのGOMAXPROCS
kuro_kurorrr
0
210
Benchmark
sysong
0
140
Cloudflare Realtime と Workers でつくるサーバーレス WebRTC
nekoya3
0
400
Featured
See All Featured
Statistics for Hackers
jakevdp
799
220k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
123
52k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.3k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
45
7.3k
A better future with KSS
kneath
239
17k
The World Runs on Bad Software
bkeepers
PRO
68
11k
Code Review Best Practice
trishagee
68
18k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Why You Should Never Use an ORM
jnunemaker
PRO
56
9.4k
Building Applications with DynamoDB
mza
95
6.4k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Transcript
Application Tracing Velocity San Jose 2017
Your instructor •Bryan Liles •
[email protected]
•@bryanl
WIFI: OReilly Conf
Agenda • Workstation Setup • Goals • Tracing Introduction •
Exercise 1 • Break • Exercise 2 • Exercise 3 • Beyond the basics • Discussion • Closing
Workshop Setup • https://github.com/bryanl/velocity-sj-2017 • http://bit.ly/vsj2017-apptracing
• Jaeger • Language Specific Exercises • Jaeger Demo App
• Postgres
Today’s applications are complex
Shop
Shop Inventory Management Shipping
Shop Inventory Management Shipping Redis Postgres
How do we know what’s going on?
Shop
Shop Metrics For every resource, check utilization, saturation, and errors.
• Average busy time • Amount of capacity available • Error count
Shop Logging Capture events to help identify incidents and application
specific data • Auth success/failure • Validation failures • So many more
Shop Tracing Capture timing metrics from one or multiple resources
participating in a transaction. • Find latency issues and errors across resources
Shop Tracing
Tracing Request scoped Metrics Aggregates Logging Events Request scoped events
Aggregate events Request scoped metrics
Tracing Request scoped Metrics Aggregates Logging Events Prometheus ELK OpenTracing
Tracing
None
Terminology
Span: A period of time A span contains the following:
* Operation name * Start/Finish timestamps * Tags * Logs * References to other spans
Trace: a directed acyclic graph (DAG) of spans Span A
Span B Span C Span D Span E Span F Span G Span H
Trace: a DAG of spans Time ➡ Span A Span
B Span D Span C Span E Span F Span G Span H
OpenTracing
Google Dapper "We built dapper to provide Google’s developers with
more information about the behavior of complex distributed systems"
Google Dapper Design Goals • Low Overhead • Application-level transparency
• Scalability
Zipkin • Created by Twitter • Zipkin and Dapper are
based on the same principals
OpenTracing isn’t a framework
OpenTracing describes an abstraction for tracing distributed systems
Jaeger: OpenTracing Compatible Implementation
Jaeger Driver OpenTracing API App Jaeger
Standardization Why OpenTracing?
• Standardize span management • Standardize inter-process propagation • Standardize
active span management • Standardize in-band context encoding • Standardize out-of-band trace data encoding
Why Standardize? • Tracing should be easy and unobtrusive •
Competing standards dilute progress • The ecosystem is complex and diverse. It’s easier to drive to a single standard rather than having multiple.
Open Tracing Demo
pip install -U docker-compose
Workshop Setup
Activity: Tracing Concepts
Talking to Jaeger
Reporter Sampler Jaeger
Activity: More Tracing Concepts
Discussion / Lessons Learned
What should I log or tag? https://github.com/opentracing/specification/blob/master/semantic_conventions.md
Instrumenting
Searching for tags or events
Baggage Sometimes, you want to make data available for child
spans
Closing