Resilience Engineering: Why break your software with Chaos Engineering?

Transcript

1. WOMEN TECH GLOBAL CONFERENCE 2020 JUNE 10-12 VIRTUAL Unite 100 000 Women in Tech to Drive Change with Purpose and Impact.
3. @yurynino Garagoa Boyacá Colombia https://www.yurynino.dev
4. Resilience Engineering • Miracle on the Hudson River • Recording, tracking, and solving incidents • Why Resilience matters? • 4 Capabilities ◦ Ability to Respond ◦ Ability to Monitor ◦ Ability to Anticipate ◦ Ability to Learn • Resilience & Reliability • Reliability & Chaos Engineering • Resilient & Reliable Engineering Teams
5. US Airways Flight 1549 ditched into the Hudson River New York January 15th 2009 This emergency ditching and evacuation, with the loss of no lives, was a heroic and unique aviation achievement
6. Resilience Engineering • To be able to construct a mental representation of the situation. • To be able to assess risk and threats as relevant for the flight. • To be able to switch from a situation under control. • To be able to maintain a relevant level of confidence. • To be able to make a decision in a complex.
7. Resilience Engineering • To be able to make an intelligent usage of procedures. • To be able to use available technical and human resources. • To be able to manage time and time pressure. • To be able to cooperate with, crew members and other staff. • To be able to properly use and manage information.
8. What can we learn from Aviation?
9. Recording, triaging, tracking, and measure the incidents that impact our applications is difficult, time-consuming, and requires talent and experienced engineering.
10. Resilience is the intrinsic ability of a system to adjust its functioning prior to, during, or following changes and disturbances, so that it can sustain required operations under both expected and unexpected conditions. Erik Hollnagel
11. Resilience is the ability of a system to adapt itself due to changes, failures, and anomalies.
12. Resilience Engineering 4 Essential Capabilities 4 Sets of answers to construct resilience profile
13. This is the capability to address the actual Knowing what to do, or being able to respond to regular and irregular variability. Rate it as being so serious it is necessary to know how and when to respond The system must first detect that something has happened, then recognise the event.
14. This is the capability to address the factual Knowing what has happened to learn from experience, in particular to learn the right lessons. Learning is generally defined as ‘a change in behaviour as a result of experience’. The future performance only can be improved if something is learned from past performance.
15. This is the capability to address the critical Knowing what to look for, or being able to monitor that which changes, or may change Monitoring enables the system to address possible near-term threats and opportunities before they become reality. A resilient system must be able flexibly to monitor its own performance as well as changes in the environment.
16. This is the capability to address the potencial Knowing what to expect, or being able to anticipate developments, threats, and opportunities. The anticipation of future has little support in current methods, although it is considered just as important as the search for threats. Risk assessment focuses on future threats and is suitable for systems where the principles of functioning are known
17. What is the relation with Reliability?
18. Resilience means that the critical parts of a system can mitigate, survive, and/or recover from high impact threats. A distributed system on production needs to be resilient in order to be reliable! Reliability means that the lights always come on when you throw the switch.
19. What is the relation with Chaos Engineering?
20. Chaos Engineering introduces the injection of failures as a discipline for building confidence in the resilience capability of the systems.
21. What is Chaos Engineering? It is the discipline of experimenting failures in production in order to reveal their weakness and to build confidence in their resilience capability. https://principlesofchaos.org/
22. Hypothesize about Steady State Run Experiments Vary Real-World Events Automate Experiments
23. Chaos Monkey Chaos Toolkit Gremlin Chaos Mesh
25. Review
28. https://chaosengineering.slack.com https://github.com/dastergon/ awesome-chaos-engineering https://www.infoq.com/chaos-engineering
29. If we want to have distributed systems, highly available, reliable and resilient! We must be reliable and resilient! Take care of yourself!
30. Thanks for attending! @yurynino
31. https://markmanson.net/resilience https://medium.com/search?q=resilience%20engineering https://medium.com/faun/resilience--and-devops-part-ii-a-deeper-dive-into-resilience-engineering-in-it-61b 84831a2d6 https://medium.com/faun/resilience-engineering-devops-part-i-where-complex-systems-fail-ec8419b345ef https://thechief.io/c/editorial/resilience-engineering-devops-part-i-where-complex-systems-fail/ https://thechief.io/c/editorial/resilience-engineering-and-devops-part-ii-deeper-dive-resilience-engineering-i t/ https://medium.com/@jpaulreed/chaos-engineered-or-otherwise-is-not-enough-ad5792309ecf https://medium.com/@allspaw/social-issues-in-postmortems-d48dde624d18