Building Scalable Restaurants

Transcript

1. BUILDING SCALABLE RESTAURANTS Victor "Frodo" Martinez - lend.tech - January/2023
2. 2 DISCLAIMER • "In practice…" • "The real world…" ⚠
3. 3 WHO AM I? Where's the f*cking ring? Victor "Frodo" Martinez 31 y'old Pythonista - Coffee Lover - Backender A bit of everything at
4. 4 WHY?
5. 5 WHY? Architecture Interview Whiteboards Technical Discussions Boilerplate Guilds …
6. A RESTAURANT IS ALL ABOUT SOFTWARE… …I CAN SHOW YOU.
7. KITCHEN HOST DINNER CASHIER WAITING ROOM BATHROOM BAR
8. 8 ARCHITECTURE DESIGN Discrete services VS Monolithic design
9. KITCHEN HOST DINNER CASHIER WAITING ROOM BATHROOM BAR
10. COZINHA HOST JANTAR CAIXA SALA DE ESPERA BANHEIRO BAR RESTAURANT SERVICE
11. BATHROOM SERVICE KITCHEN SERVICE BAR SERVICE HOST SERVICE WAIT SERVICE DINNER SERVICE CASHIER SERVICE
12. 12 vs Microservices Monolit ARCHITECTURE DESIGN
13. 13 vs Microservices Monolit ARCHITECTURE DESIGN
14. 14 • Bounded Contexts (DDD) • Different scalability necessities • Allow custom resource allocation ◦ Bathroom vs Dinner ◦ I/O Bound vs CPU Bound • … ARCHITECTURE DESIGN
15. 15 PERFORMANCE VS SCALABILITY
16. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰳖 ⁉
17. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ Time to get and order ready 󰳖 ⁉
18. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 🍳 󰞽 󰳖 ⁉ How many cooks available?
19. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 🍳 󰞽 How many clients per hour? 󰳖 ⁉
20. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 🍳 󰞽 How many orders per hour? 󰳖 ⁉
21. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 🍳 󰞽 👨 👩 👨 👩 👨 How many reservations per hour? 󰳖 ⁉
22. KITCHEN HOST DINNER CASHIER WAITING ROOM BATHROOM BAR PERFORMANCE SCALABILITY VS
23. KITCHEN HOST DINNER CASHIER WAITING ROOM BATHROOM BAR PERFORMANCE RESPONSE TIME → How much time takes a single request? Time to get an order ready
24. KITCHEN HOST DINNER CASHIER WAITING ROOM BATHROOM BAR PERFORMANCE RESPONSE TIME → How much time takes a single request? Time to get an order ready SCALABILITY LOAD → Number of requests per period of time. Number of cooks available.
25. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨
26. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨
27. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨
28. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 󰳖 ⁉
29. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 󰳖 ⁉ 1. How many orders per second? 2. How many contain errors? 3. How long do they take?
30. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 󰳖 ⁉ METRICS Traffic-based services (R.E.D.)
31. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 󰳖 ⁉ METRICS Traffic-based services (R.E.D.) RATE - ERROR - DURATION How many requests per second [RATE] Error percentage [ERROR] Duration/latency of each request [DURATION]
32. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 👩 👨 󰳖 ⁉ METRICS Traffic-based services (R.E.D.) RATE - ERROR - DURATION How many requests per second [RATE] Error percentage [ERROR] Duration/latency of each request [DURATION] OBS: Context is important (e.g. bad request)
33. 33 󰞽 ✋ 🔥 FAILURE
34. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥
35. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 ❌ UNAVAILABLE & NOT RESILIENT
36. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 󰠉 RESILIENT
37. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰠉
38. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰠉 HIGH AVAILABILITY 99.99% uptime Weak Redundancy Gateway Layer APP ❌ APP
39. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥
40. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽
41. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽 󰞽 FAULT TOLERANCE 100% uptime Strong Redundancy Gateway Layer APP ❌ APP APP APP
42. 42 HIGH AVAILABILITY & FAULT TOLERANCE Application runs all the time without any system degradation.
43. 43 ISOLATION STATE - SPACE - TIME - FAILURE
44. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ❌
45. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR API API
46. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ISOLATION OF STATE A service should not access another's database directly. A service should not access another's database directly. A B Well-defined API.
47. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾 󰞽
49. ISOLATION OF SPACE A service should not care where others are placed. A B A A A A A B More services A does not imply into B.
50. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂
51. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾
52. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 󰞽
53. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 󰞽 ISOLATION OF TIME A service should not use sync & blocking requests. A B Message-driven & Eventual Consistency
54. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🕛
55. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🕛 ✅ ✅ ✅ ✅ ✅
56. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🕛 ✅ ✅ ✅ ✅ ✅ ISOLATION OF FAILURE A service failure should not cause another to fail. A B Bulkheading - Circuit Breakers - Message Driven - Autonomy ✅
57. 57 ADDRESSING ISOLATION BULKHEADING - CIRCUIT BREAKERS - MESSAGE-DRIVEN - GATEWAY - AUTONOMY
58. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥
59. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 ❌
60. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 ❌ ✅ ✅ ✅ ✅ ✅ ✅
61. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 󰞽 ✋ 🔥 ❌ ✅ ✅ ✅ ✅ ✅ ✅ BULKHEADING Failures are isolated into zones.
62. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ❌
63. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ❌ ♂ ✅
64. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ❌ ♂ ✅ GATEWAY GATEWAY SERVICE A SERVICE B SERVICE C
65. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾🧾
66. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 🧾
67. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾
68. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾
69. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾
70. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾 ❌
71. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾 ❌ CIRCUIT-BREAKER A B CB
72. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾 ❌ CIRCUIT-BREAKER A B CB
73. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR ♂ 🧾 ♂ 🧾 ♀ ♀ 🧾🧾🧾 ❌ CIRCUIT-BREAKER A B CB CLOSED OPEN HALF- OPEN
74. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾
75. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾 MESSAGE-DRIVEN Services should be able to send non-blocking async messages A B
76. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾🧾 🧾 ♂ 🧾 🧾
77. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾🧾 🧾 🧾 🧾 🧾 ♂ 🧾 🧾
78. KITCHEN HOST DINNER CASHIER WAITING HALL BATHROOM BAR 🧾🧾 🧾 🧾 🧾 🧾 ♂ 🧾 🧾 AUTONOMY & EVENTUAL CONSISTENCY After stopping receiving notifications all parts eventually converge to the same state. The only guarantee is that, at some point in the future, something good will happen. Data replication (when needed) Prevent long-running transactions [Saga] Compensation Actions vs Rollbacks
79. 79 IN A NUTSHELL
80. 80 IN A NUTSHELL A scalable restaurant handles an increase in the number of clients as it responds to the necessities in a quick and efficient manner.
81. 81 IN A NUTSHELL A scalable restaurant handles an increase in the number of clients as it responds to the necessities in a quick and efficient manner. How about software?
82. 82 IN A NUTSHELL A scalable system handles an increase in the load as it responds to requests fast and efficiently.
83. 83 HOW TO BUILD A SCALABLE RESTAURANT? More nodes.
84. 84 HOW TO BUILD A SCALABLE RESTAURANT? More nodes. Isolation • Message-driven • Performance • Microservices • Bulkheading • Circuit Breakers • Gateways • Autonomy …
85. 85 HOW TO BUILD A SCALABLE RESTAURANT? More nodes. Isolation • Message-driven • Performance • Microservices • Bulkheading • Circuit Breakers • Gateways • Autonomy … More nodes.
86. 86 WHY?
87. 87 WHY? RESPONSIVE experience under several conditions.
88. 88 WHY? From 10 to 10 million users Use resources according to the load Failures cause a few or no effect in user experience Applications spread over hundreds/thousands of nodes RESPONSIVE experience under several conditions.
90. 90 ELASTIC RESILIENT RESPONSIVE MESSAGE DRIVEN MAINTAINABLE EXTENSIBLE VALUE FORM MEANS
91. 91 ELASTIC RESILIENT RESPONSIVE MESSAGE DRIVEN MAINTAINABLE EXTENSIBLE VALUE FORM MEANS RESPONSIVE ⌛ Time to serve people.
92. 92 ELASTIC RESILIENT RESPONSIVE MESSAGE DRIVEN MAINTAINABLE EXTENSIBLE VALUE FORM MEANS ELASTIC 󰞽 Increase/decrease number of employees.
93. 93 ELASTIC RESILIENT RESPONSIVE MESSAGE DRIVEN MAINTAINABLE EXTENSIBLE VALUE FORM MEANS RESILIENT 🔥 Replace employee in case of failure.
94. 94 ELASTIC RESILIENT RESPONSIVE MESSAGE DRIVEN MAINTAINABLE EXTENSIBLE VALUE FORM MEANS MESSAGE DRIVEN 🧾 Take orders through async & non-blocking messages.
95. 95 THERE STILL MUCH WORK TO BE DONE TRAFFIC-BASED MONITORING TRACES SHARDING CACHING CONTENTION RETRY IDEMPOTENCY …
96. BUILDING SCALABLE & REACTIVE RESTAURANTS Victor "Frodo" Martinez - lend.tech - January/2023
97. 97 THANKS. Victor "Frodo" Martinez - lend.tech - January/2023