Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Critical Path Analysis
Search
JBD
February 06, 2019
0
520
Critical Path Analysis
JBD
February 06, 2019
Tweet
Share
More Decks by JBD
See All by JBD
eBPF in Microservices Observability at eBPF Day
rakyll
1
2.1k
eBPF in Microservices Observability
rakyll
1
1.7k
OpenTelemetry at AWS
rakyll
1
1.8k
Debugging Code Generation in Go
rakyll
5
1.5k
Are you ready for production?
rakyll
8
2.7k
Servers are doomed to fail
rakyll
3
1.5k
Serverless Containers
rakyll
1
240
Monitoring and Debugging Containers
rakyll
2
1.1k
CPDD
rakyll
0
4.1k
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
364
19k
Bootstrapping a Software Product
garrettdimon
PRO
305
110k
Optimizing for Happiness
mojombo
376
70k
Designing on Purpose - Digital PM Summit 2013
jponch
115
7k
For a Future-Friendly Web
brad_frost
175
9.4k
Thoughts on Productivity
jonyablonski
67
4.3k
Art, The Web, and Tiny UX
lynnandtonic
297
20k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
232
17k
Building Adaptive Systems
keathley
38
2.3k
YesSQL, Process and Tooling at Scale
rocio
169
14k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
38
1.8k
Measuring & Analyzing Core Web Vitals
bluesmoon
4
120
Transcript
@rakyll
@rakyll
@rakyll We use facilities that are not reserved for our
flight but are essential in making it happen.
@rakyll We use facilities that are not reserved for our
flight but are essential in making it happen.
@rakyll
@rakyll Systems? who understands them?
@rakyll Jaana B. Dogan
[email protected]
@rakyll
@rakyll Growing...
@rakyll Tech stack gets fragmented, monoliths are gone...
@rakyll one becomes many failure in isolation escalation in failure?
@rakyll and it may get larger...
@rakyll good guy jeff
@rakyll
@rakyll
@rakyll code search
@rakyll go_library( name = "logs", srcs = ["logs.go"], visibility =
["//visibility:public"], deps = [ …. ], ) References (641 occurrences) - //source/ads/monitoring/BUILD - //source/ads/analysis/BUILD - //source/ads/mobile/BUILD ...
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll frontend server authentication users images memcache blobservice memcache memcache
(metadata) (disks) load balancer critical path
@rakyll CPA (critical path analysis)
@rakyll discover the critical paths make them reliable and fast
make them debuggable
@rakyll How do we get there? (tracing, events, logs)
@rakyll Why? Why? Why? Why? Why?
@rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile
cache.Get mysql.Query images.Filter blobstore.Get
@rakyll bare metal kernel network stack cloud stack libraries frameworks
your code
@rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile
cache.Get mysql.Query images.Filter blobstore.Get not my fault
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get where is the source code?
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get who to call?
@rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter
blobstore.Get cache.Get mysql.Query blob.Get give me the logs, runtime events, profiles...
@rakyll Challenges...
@rakyll This is an organizational problem. CHALLENGE #1:
@rakyll Engineers don’t know where to start. CHALLENGE #2:
@rakyll Infra is still a blackbox. CHALLENGE #3:
@rakyll Instrumentation is expensive. CHALLENGE #4:
@rakyll Dynamic capabilities are underestimated. CHALLENGE #5:
@rakyll
@rakyll A tool to close knowledge gaps (which we don’t
talk about)
@rakyll Fin
[email protected]