Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Velocity 2017 SJ: Application Tracing
Search
Bryan Liles
June 21, 2017
Programming
2
360
Velocity 2017 SJ: Application Tracing
Workshops slides
Bryan Liles
June 21, 2017
Tweet
Share
More Decks by Bryan Liles
See All by Bryan Liles
DevOps Days MSP 2017
bryanl
2
1.1k
Application Ops 1.0
bryanl
1
200
DevOoops Mastery
bryanl
0
74
Go At Work
bryanl
0
230
The (Ruby) Sims
bryanl
1
140
How Vs Why
bryanl
0
140
ruby -pi -e.bak - Windy City Rails
bryanl
1
280
Arrrr Camp 2012: Simulating the World with Ruby
bryanl
2
520
Other Decks in Programming
See All in Programming
大規模アプリのDIフレームワーク刷新戦略 ~過去最大規模の並行開発を止めずにアプリ全体に導入するまで~
mot_techtalk
0
400
CSC305 Lecture 04
javiergs
PRO
0
260
いま中途半端なSwift 6対応をするより、Default ActorやApproachable Concurrencyを有効にしてからでいいんじゃない?
yimajo
2
350
Building, Deploying, and Monitoring Ruby Web Applications with Falcon (Kaigi on Rails 2025)
ioquatix
2
680
Goで実践するドメイン駆動開発 AIと歩み始めた新規プロダクト開発の現在地
imkaoru
4
740
複雑化したリポジトリをなんとかした話 pipenvからuvによるモノレポ構成への移行
satoshi256kbyte
1
830
ソフトウェア設計の実践的な考え方
masuda220
PRO
3
500
XP, Testing and ninja testing ZOZ5
m_seki
3
350
Web技術を最大限活用してRAW画像を現像する / Developing RAW Images on the Web
ssssota
2
1.2k
iOSアプリの信頼性を向上させる取り組み/ios-app-improve-reliability
shino8rayu9
0
160
そのpreloadは必要?見過ごされたpreloadが技術的負債として爆発した日
mugitti9
2
3.1k
GraphQL×Railsアプリのデータベース負荷分散 - 月間3,000万人利用サービスを無停止で
koxya
1
1.2k
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
368
20k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.2k
Principles of Awesome APIs and How to Build Them.
keavy
127
17k
A better future with KSS
kneath
239
17k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.5k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Reflections from 52 weeks, 52 projects
jeffersonlam
352
21k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
189
55k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Why Our Code Smells
bkeepers
PRO
339
57k
Embracing the Ebb and Flow
colly
88
4.8k
Transcript
Application Tracing Velocity San Jose 2017
Your instructor •Bryan Liles •
[email protected]
•@bryanl
WIFI: OReilly Conf
Agenda • Workstation Setup • Goals • Tracing Introduction •
Exercise 1 • Break • Exercise 2 • Exercise 3 • Beyond the basics • Discussion • Closing
Workshop Setup • https://github.com/bryanl/velocity-sj-2017 • http://bit.ly/vsj2017-apptracing
• Jaeger • Language Specific Exercises • Jaeger Demo App
• Postgres
Today’s applications are complex
Shop
Shop Inventory Management Shipping
Shop Inventory Management Shipping Redis Postgres
How do we know what’s going on?
Shop
Shop Metrics For every resource, check utilization, saturation, and errors.
• Average busy time • Amount of capacity available • Error count
Shop Logging Capture events to help identify incidents and application
specific data • Auth success/failure • Validation failures • So many more
Shop Tracing Capture timing metrics from one or multiple resources
participating in a transaction. • Find latency issues and errors across resources
Shop Tracing
Tracing Request scoped Metrics Aggregates Logging Events Request scoped events
Aggregate events Request scoped metrics
Tracing Request scoped Metrics Aggregates Logging Events Prometheus ELK OpenTracing
Tracing
None
Terminology
Span: A period of time A span contains the following:
* Operation name * Start/Finish timestamps * Tags * Logs * References to other spans
Trace: a directed acyclic graph (DAG) of spans Span A
Span B Span C Span D Span E Span F Span G Span H
Trace: a DAG of spans Time ➡ Span A Span
B Span D Span C Span E Span F Span G Span H
OpenTracing
Google Dapper "We built dapper to provide Google’s developers with
more information about the behavior of complex distributed systems"
Google Dapper Design Goals • Low Overhead • Application-level transparency
• Scalability
Zipkin • Created by Twitter • Zipkin and Dapper are
based on the same principals
OpenTracing isn’t a framework
OpenTracing describes an abstraction for tracing distributed systems
Jaeger: OpenTracing Compatible Implementation
Jaeger Driver OpenTracing API App Jaeger
Standardization Why OpenTracing?
• Standardize span management • Standardize inter-process propagation • Standardize
active span management • Standardize in-band context encoding • Standardize out-of-band trace data encoding
Why Standardize? • Tracing should be easy and unobtrusive •
Competing standards dilute progress • The ecosystem is complex and diverse. It’s easier to drive to a single standard rather than having multiple.
Open Tracing Demo
pip install -U docker-compose
Workshop Setup
Activity: Tracing Concepts
Talking to Jaeger
Reporter Sampler Jaeger
Activity: More Tracing Concepts
Discussion / Lessons Learned
What should I log or tag? https://github.com/opentracing/specification/blob/master/semantic_conventions.md
Instrumenting
Searching for tags or events
Baggage Sometimes, you want to make data available for child
spans
Closing