Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Velocity 2017 SJ: Application Tracing
Search
Bryan Liles
June 21, 2017
Programming
2
360
Velocity 2017 SJ: Application Tracing
Workshops slides
Bryan Liles
June 21, 2017
Tweet
Share
More Decks by Bryan Liles
See All by Bryan Liles
DevOps Days MSP 2017
bryanl
2
1.1k
Application Ops 1.0
bryanl
1
200
DevOoops Mastery
bryanl
0
75
Go At Work
bryanl
0
230
The (Ruby) Sims
bryanl
1
150
How Vs Why
bryanl
0
140
ruby -pi -e.bak - Windy City Rails
bryanl
1
290
Arrrr Camp 2012: Simulating the World with Ruby
bryanl
2
520
Other Decks in Programming
See All in Programming
Server Side Kotlin Meetup vol.16: 内部動作を理解して ハイパフォーマンスなサーバサイド Kotlin アプリケーションを書こう
ternbusty
3
260
Towards Transactional Buffering of CDC Events @ Flink Forward 2025 Barcelona Spain
hpgrahsl
0
120
Domain-centric? Why Hexagonal, Onion, and Clean Architecture Are Answers to the Wrong Question
olivergierke
3
980
実践Claude Code:20の失敗から学ぶAIペアプログラミング
takedatakashi
18
9k
The Past, Present, and Future of Enterprise Java
ivargrimstad
0
690
AI Agent 時代的開發者生存指南
eddie
4
2.2k
三者三様 宣言的UI
kkagurazaka
0
280
Ktorで簡単AIアプリケーション
tsukakei
0
110
開発組織の戦略的な役割と 設計スキル向上の効果
masuda220
PRO
10
1.7k
Goで実践するドメイン駆動開発 AIと歩み始めた新規プロダクト開発の現在地
imkaoru
4
920
釣り地図SNSにおける有料機能の実装
nokonoko1203
0
200
CSC509 Lecture 06
javiergs
PRO
0
270
Featured
See All Featured
Embracing the Ebb and Flow
colly
88
4.9k
Bash Introduction
62gerente
615
210k
How to train your dragon (web standard)
notwaldorf
97
6.3k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
249
1.3M
Building Flexible Design Systems
yeseniaperezcruz
329
39k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
34
2.3k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
21
1.2k
Become a Pro
speakerdeck
PRO
29
5.6k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
658
61k
Designing for Performance
lara
610
69k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
253
22k
Balancing Empowerment & Direction
lara
5
700
Transcript
Application Tracing Velocity San Jose 2017
Your instructor •Bryan Liles •
[email protected]
•@bryanl
WIFI: OReilly Conf
Agenda • Workstation Setup • Goals • Tracing Introduction •
Exercise 1 • Break • Exercise 2 • Exercise 3 • Beyond the basics • Discussion • Closing
Workshop Setup • https://github.com/bryanl/velocity-sj-2017 • http://bit.ly/vsj2017-apptracing
• Jaeger • Language Specific Exercises • Jaeger Demo App
• Postgres
Today’s applications are complex
Shop
Shop Inventory Management Shipping
Shop Inventory Management Shipping Redis Postgres
How do we know what’s going on?
Shop
Shop Metrics For every resource, check utilization, saturation, and errors.
• Average busy time • Amount of capacity available • Error count
Shop Logging Capture events to help identify incidents and application
specific data • Auth success/failure • Validation failures • So many more
Shop Tracing Capture timing metrics from one or multiple resources
participating in a transaction. • Find latency issues and errors across resources
Shop Tracing
Tracing Request scoped Metrics Aggregates Logging Events Request scoped events
Aggregate events Request scoped metrics
Tracing Request scoped Metrics Aggregates Logging Events Prometheus ELK OpenTracing
Tracing
None
Terminology
Span: A period of time A span contains the following:
* Operation name * Start/Finish timestamps * Tags * Logs * References to other spans
Trace: a directed acyclic graph (DAG) of spans Span A
Span B Span C Span D Span E Span F Span G Span H
Trace: a DAG of spans Time ➡ Span A Span
B Span D Span C Span E Span F Span G Span H
OpenTracing
Google Dapper "We built dapper to provide Google’s developers with
more information about the behavior of complex distributed systems"
Google Dapper Design Goals • Low Overhead • Application-level transparency
• Scalability
Zipkin • Created by Twitter • Zipkin and Dapper are
based on the same principals
OpenTracing isn’t a framework
OpenTracing describes an abstraction for tracing distributed systems
Jaeger: OpenTracing Compatible Implementation
Jaeger Driver OpenTracing API App Jaeger
Standardization Why OpenTracing?
• Standardize span management • Standardize inter-process propagation • Standardize
active span management • Standardize in-band context encoding • Standardize out-of-band trace data encoding
Why Standardize? • Tracing should be easy and unobtrusive •
Competing standards dilute progress • The ecosystem is complex and diverse. It’s easier to drive to a single standard rather than having multiple.
Open Tracing Demo
pip install -U docker-compose
Workshop Setup
Activity: Tracing Concepts
Talking to Jaeger
Reporter Sampler Jaeger
Activity: More Tracing Concepts
Discussion / Lessons Learned
What should I log or tag? https://github.com/opentracing/specification/blob/master/semantic_conventions.md
Instrumenting
Searching for tags or events
Baggage Sometimes, you want to make data available for child
spans
Closing