Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Critical Path Analysis

E7526ec3e801f8ba99f6746498a154a6?s=47 JBD
February 06, 2019
0
160

Critical Path Analysis

E7526ec3e801f8ba99f6746498a154a6?s=128

JBD

February 06, 2019
Tweet

More Decks by JBD

See All by JBD
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
880
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
1.4k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
5
1.2k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
8
1.7k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
3
1.2k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
1
140
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
2
900
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
0
3.7k
E7526ec3e801f8ba99f6746498a154a6?s=48 rakyll
2
260

Featured

See All Featured
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
333
16k
Fe6b81005d1553accd6b2a28f6a2bef1?s=48 phodgson
92
4.1k
88bc30284c6a424b63a92aad27d0ba36?s=48 jnunemaker
PRO
43
4.9k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
122
5.1k
864a009ac73600c7c02e1f26629dd989?s=48 paigeccino
0
110
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
91
3.6k
245cee81a9c424266e5e401d844ea881?s=48 lara
175
10k
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
13
980
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
75
3.8k
9375a9529679f1b42b567a640d775e7d?s=48 schacon
152
6.8k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
105
11k
C86443373fbfe92996aa882d0d7a59f8?s=48 imathis
482
150k

Transcript

  1. @rakyll

  2. @rakyll

  3. @rakyll We use facilities that are not reserved for our

    flight but are essential in making it happen.

  4. @rakyll We use facilities that are not reserved for our

    flight but are essential in making it happen.

  5. @rakyll

  6. @rakyll Systems? who understands them?

  7. @rakyll Jaana B. Dogan jbd@google.com

  8. @rakyll

  9. @rakyll Growing...

  10. @rakyll Tech stack gets fragmented, monoliths are gone...

  11. @rakyll one becomes many failure in isolation escalation in failure?

  12. @rakyll and it may get larger...

  13. @rakyll good guy jeff

  14. @rakyll

  15. @rakyll

  16. @rakyll code search

  17. @rakyll go_library( name = "logs", srcs = ["logs.go"], visibility =

    ["//visibility:public"], deps = [ …. ], ) References (641 occurrences) - //source/ads/monitoring/BUILD - //source/ads/analysis/BUILD - //source/ads/mobile/BUILD ...

  18. @rakyll frontend server authentication users images memcache blobservice memcache memcache

    (metadata) (disks) load balancer

  19. @rakyll frontend server authentication users images memcache blobservice memcache memcache

    (metadata) (disks) load balancer critical path

  20. @rakyll frontend server authentication users images memcache blobservice memcache memcache

    (metadata) (disks) load balancer critical path

  21. @rakyll frontend server authentication users images memcache blobservice memcache memcache

    (metadata) (disks) load balancer critical path

  22. @rakyll CPA (critical path analysis)

  23. @rakyll discover the critical paths make them reliable and fast

    make them debuggable

  24. @rakyll How do we get there? (tracing, events, logs)

  25. @rakyll Why? Why? Why? Why? Why?

  26. @rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile

    cache.Get mysql.Query images.Filter blobstore.Get

  27. @rakyll bare metal kernel network stack cloud stack libraries frameworks

    your code

  28. @rakyll GET /timeline edge-lb sched api-server auth.Auth cache.Get mysql.Query user.Profile

    cache.Get mysql.Query images.Filter blobstore.Get not my fault

  29. @rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter

    blobstore.Get cache.Get mysql.Query blob.Get where is the source code?

  30. @rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter

    blobstore.Get cache.Get mysql.Query blob.Get who to call?

  31. @rakyll GET /timeline auth.Auth cache.Get mysql.Query user.Profile cache.Get mysql.Query images.Filter

    blobstore.Get cache.Get mysql.Query blob.Get give me the logs, runtime events, profiles...

  32. @rakyll Challenges...

  33. @rakyll This is an organizational problem. CHALLENGE #1:

  34. @rakyll Engineers don’t know where to start. CHALLENGE #2:

  35. @rakyll Infra is still a blackbox. CHALLENGE #3:

  36. @rakyll Instrumentation is expensive. CHALLENGE #4:

  37. @rakyll Dynamic capabilities are underestimated. CHALLENGE #5:

  38. @rakyll

  39. @rakyll A tool to close knowledge gaps (which we don’t

    talk about)

  40. @rakyll Fin jbd@google.com