Upgrade to Pro — share decks privately, control downloads, hide ads and more …

production: an owner's manual

A4b95be2145cc46f891707b6db9dd82d?s=47 Igor Wiedler
April 23, 2018
Programming
0
96

production: an owner's manual

from exec(ut) 2018

A4b95be2145cc46f891707b6db9dd82d?s=128

Igor Wiedler

April 23, 2018
Tweet

More Decks by Igor Wiedler

See All by Igor Wiedler
Wide Event Analytics (LISA19)
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
3
850
a day in the life of a request
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
0
85
The Power of 2
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
0
160
LISP 1.5 Programmer's Manual: A Dramatic Reading
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
0
190
The Moral Character of Software
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
1
200
interdisciplinary computing (domcode)
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
0
170
miniKanren (clojure berlin)
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
1
180
End the war on tabs (phpnw14)
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
1
780
Lisp (laraconeu)
A4b95be2145cc46f891707b6db9dd82d?s=48 igorw
7
1.2k

Other Decks in Programming

See All in Programming
microCMS × Shopifyで、ECサイトがリニューアル後急成長した話
1f1d874ed952074278d27fad3fb870b8?s=48 microcms
0
470
WindowsコンテナDojo：第2回 Windowsコンテナアプリのビルド、公開、デプロイ
E5eb221d34d4ffbe973f8542b4c3a00e?s=48 oniak3ibm
PRO
0
150
Airflow1=>Airflow2へのupgrade 事例紹介
A3ae651ab614249880dd9fad4fd0cee7?s=48 reizist
0
120
확장 가능한 테라폼 코드 관리 (Scalable Terraform Code Management)
330c5e37fb238d6b319ae6e18770f44b?s=48 posquit0
1
320
Composing an API with Kotlin (Kotlin Dev Day 2022)
4047c64e3a1e2f81addd4ba675ddc451?s=48 zsmb
0
270
mrubyを1300円のボードで動かそう
9ec05c5a1b9b0ce9cd53ec3a63838b9a?s=48 yuuu
0
190
Kotlin 最新動向2022 #tfcon #techfeed
14c9795d267f5b85abb98ca5e8780646?s=48 ntaro
1
1.1k
The future of trust stores in Python
6638acfdb9c5979d11b4312984292c55?s=48 sethmlarson
0
180
Why declarative UI frameworks?
6233177bc63ec02060206adef9108601?s=48 tkuenneth
0
120
GraphQL+KMM開発でわかったこと / What we learned from GraphQL+KMM development
E505897a79eede1a676f92740261e8f8?s=48 kubode
0
130
Loom is Blooming
F784a8de872a5d98f67ac5ccbd6683d0?s=48 josepaumard
3
550
Unity Localization で多言語対応実装しよう / xrdnk-yokohamaunity-lt10-20220513
270b0c7883545117a9a618dc7ca7cc83?s=48 xrdnk
0
140

Featured

See All Featured
Design by the Numbers
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
271
17k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Fd55de4174accaf3b4f030e43a8a70c6?s=48 marcduiker
3
440
How STYLIGHT went responsive
F716e5f737fcfb03f2cf8d1a184f1dbe?s=48 nonsquared
85
3.9k
YesSQL, Process and Tooling at Scale
D09fad3e36ae6841f54820be0e907f7a?s=48 rocio
157
12k
Six Lessons from altMBA
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
14
1.3k
A Philosophy of Restraint
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
192
14k
The Web Native Designer (August 2011)
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
74
1.9k
Art, The Web, and Tiny UX
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
280
17k
Writing Fast Ruby
1f74b13f1e5c6c69cb5d7fbaabb1e2cb?s=48 sferik
612
57k
Side Projects
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
449
37k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
12
890
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
172
8.3k

Transcript

  1. production: an owner's manual

  2. hello!

  3. broken computers

  4. None

  5. getting sidetracked now so sorry* * not sorry

  6. None
  7. None
  8. None

  9. back to serious business

  10. !

  11. None

  12. a production system is a system that serves real users

  13. the goal of operations is to ensure services are reliable

  14. in order to provide a good user experience

  15. None

  16. failure

  17. app

  18. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber

  19. app linux kernel the cloud

  20. None

  21. • cosmic rays • disk failure • power outages •

    software bugs • ...

  22. entropy

  23. None

  24. capacity

  25. None
  26. None
  27. None

  28. cascading failure

  29. None

  30. system design

  31. redundancy

  32. "

  33. scale

  34. None

  35. "

  36. p1 m3 c1 m2 m1 p2 c2

  37. data storage

  38. "

  39. "

  40. protocols

  41. None

  42. monitoring

  43. many components many req/s

  44. None

  45. measure all the things?

  46. ✅ ⏱

  47. golden signals • latency • traffic • errors • saturation

  48. golden signals • latency • traffic • errors • saturation

  49. golden signals • latency • traffic • errors • saturation

  50. golden signals • latency • traffic • errors • saturation

  51. golden signals • latency • traffic • errors • saturation

    0 - 50 [1620]: ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ (74.55%) 50 - 100 [ 447]: ∎∎∎∎∎∎∎∎∎∎ (20.57%) 100 - 150 [ 49]: ∎ (2.25%) 150 - 200 [ 15]: (0.69%) 200 - 250 [ 15]: (0.69%) 250 - 300 [ 10]: (0.46%) 300 - 350 [ 6]: (0.28%) 350 - 400 [ 1]: (0.05%) 400 - 450 [ 0]: (0.00%) 450 - 500 [ 4]: (0.18%)

  52. golden signals • latency • traffic • errors • saturation

  53. saturation traffic latency errors

  54. None

  55. humans

  56. None

  57. oops, deleted the database

  58. bad human!

  59. why does this button even exist?

  60. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber

  61. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans

  62. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans h u m a n s

  63. epic failure is almost always systemic

  64. failure

  65. recap

  66. • a production system serves real users • users like

    things that work and are fast • epic failure is almost always systemic

  67. thx @igorwhilefalse

  68. None