Serverless chaos: Blast radius containment Expanding the latency injection to multiple functions

Serverless Chaos Demo – Last video

Serverless Chaos Demo – Last video • We added the Chaos Injection layer to one of the functions. • Parameter in Parameter Store enables/disables and configures the latency. • Defined and called delay() in the function code.

Serverless Chaos Demo – Larger

Containing the blast radius “Experimenting in production has the potential to cause unnecessary customer pain. While there must be an allowance for some short-term negative impact, it is the responsibility and obligation of the Chaos Engineer to ensure the fallout from experiments are minimized and contained.” principlesofchaos.org • Design the smallest possible experiment to effectively test the system. • By starting small, even if things go wrong, it shouldn’t cause an outage. • Understand how failure plays out, then scale it up as confidence in the system grows.

Serverless Chaos Demo – Larger

Serverless Chaos Demo – Larger

Serverless Chaos Demo – Larger

To do • Fork Adrian Hornsby’s LatencyInjectionLayer repository. • Add support for separate parameters per function. • Make the layer easy deployable using Serverless Framework. • Update the Serverless Chaos Demo Large App with the new layer. • Add parameters for each function. • Try it out!

Containing the blast radius “Experimenting in production has the potential to cause unnecessary customer pain. While there must be an allowance for some short-term negative impact, it is the responsibility and obligation of the Chaos Engineer to ensure the fallout from experiments are minimized and contained.” principlesofchaos.org • Design the smallest possible experiment to effectively test the system. • By starting small, even if things go wrong, it shouldn’t cause an outage. • Understand how failure plays out, then scale it up as confidence in the system grows.

@serverlesschaos #chaosengineering