production: an owner's manual

production: an owner's manual

from exec(ut) 2018

A4b95be2145cc46f891707b6db9dd82d?s=128

Igor Wiedler

April 23, 2018
Tweet

Transcript

  1. 2.
  2. 4.
  3. 6.
  4. 7.
  5. 8.
  6. 10.

    !

  7. 11.
  8. 15.
  9. 16.
  10. 17.

    app

  11. 18.

    app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber
  12. 20.
  13. 22.
  14. 23.
  15. 24.
  16. 25.
  17. 26.
  18. 27.
  19. 29.
  20. 32.

    "

  21. 33.
  22. 34.
  23. 35.

    "

  24. 38.

    "

  25. 39.

    "

  26. 40.
  27. 41.
  28. 44.
  29. 46.
  30. 51.

    golden signals • latency • traffic • errors • saturation

    0 - 50 [1620]: ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ (74.55%) 50 - 100 [ 447]: ∎∎∎∎∎∎∎∎∎∎ (20.57%) 100 - 150 [ 49]: ∎ (2.25%) 150 - 200 [ 15]: (0.69%) 200 - 250 [ 15]: (0.69%) 250 - 300 [ 10]: (0.46%) 300 - 350 [ 6]: (0.28%) 350 - 400 [ 1]: (0.05%) 400 - 450 [ 0]: (0.00%) 450 - 500 [ 4]: (0.18%)
  31. 54.
  32. 55.
  33. 56.
  34. 60.

    app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber
  35. 61.

    app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans
  36. 62.

    app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans h u m a n s
  37. 64.
  38. 65.
  39. 66.

    • a production system serves real users • users like

    things that work and are fast • epic failure is almost always systemic
  40. 68.