Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Monitoring and Debugging Containers
JBD
December 04, 2018
Programming
2
870
Monitoring and Debugging Containers
JBD
December 04, 2018
Tweet
Share
More Decks by JBD
See All by JBD
rakyll
5
1.2k
rakyll
7
1.5k
rakyll
2
1.1k
rakyll
0
120
rakyll
0
110
rakyll
0
3.6k
rakyll
1
190
rakyll
0
100
rakyll
2
1.5k
Other Decks in Programming
See All in Programming
thatjeffsmith
0
430
wasabeef
1
570
fkubota
1
400
momofff
0
170
showwin
0
130
hirotokirimaru
1
430
saki4869
0
190
bkuhlmann
4
620
atskimura
0
300
line_developers_tw
0
1.3k
attsumi
1
440
kazuki19992
0
450
Featured
See All Featured
lemiorhan
626
42k
skipperchong
7
670
sachag
267
17k
paulrobertlloyd
71
3.6k
lara
590
61k
morganepeng
92
14k
sferik
609
54k
bryan
30
3.3k
danielanewman
1
480
davidbonilla
69
3.5k
addyosmani
494
110k
smashingmag
229
18k
Transcript
@rakyll monitoring and debugging containerized systems Jaana B. Dogan, Google
jbd@google.com
@rakyll me overly frustrated engineer 15+ years in networking systems
making systems more reliable
@rakyll the new old monitoring? (maybe)
@rakyll systems are growing... and you are not in control
@rakyll bare metal kernel network stack cloud stack libraries frameworks
your code
@rakyll
@rakyll complexity is inevitable
@rakyll container
@rakyll container
@rakyll container container
@rakyll container container
@rakyll container container message queue
@rakyll container container storage/database
@rakyll container container load balancer location=us-west location=europe-central
@rakyll host host container container load balancer
@rakyll container container container container container orchestrated hot mess
@rakyll areas of issues: - lack of locality - networking
- scheduling - dependencies
@rakyll bare metal kernel network stack cloud stack libraries frameworks
your code
@rakyll “my job is done here”
@rakyll after going to production... 1. monitor 2. alert 3.
troubleshoot 4. fix
@rakyll
@rakyll load balancer
@rakyll load balancer critical path
@rakyll discovering critical paths making them reliable then fast making
them debuggable
@rakyll
@rakyll Latency Numbers Every Programmer Should Know by Jeff Dean
@rakyll
@rakyll ping pong pongservice:6996 project: ping the pong server.
@rakyll opencensus.io
@rakyll not my team!
@rakyll where is the source code?
@rakyll who to page?
@rakyll who to page?
@rakyll give me the logs, runtime events, profiles...
@rakyll
@rakyll
@rakyll
@rakyll http://server:9999/tracez
@rakyll challenges...
@rakyll no wire standards
@rakyll
@rakyll traceparent: <version>-<traceid>-<spanid>-<opts> Example: traceparent: 00-0af7651916cd43dd8448eb211c80319c-b7ad6b7169203331-01
@rakyll no export standards
@rakyll areas of issues: - locality - networking - scheduling
- dependencies
@rakyll fin jbd@google.com