Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Failure Is An Option

Failure Is An Option

Presented at Velocity Santa Clara 2015: http://velocityconf.com/devops-web-performance-2015/public/schedule/detail/41680

Despite our best efforts, we fail. From bugs to delivery failures, product planning problems to complex system failures, even the most experienced people in our industry are accustomed to failure. If we accept that failure is indeed inevitable, and embrace it rather than rail against it, how does that change our approach to work?

I’ll begin by talking about failure and its ensuing and varied costs, and compare our instinctive reactions (slow down) and Etsy’s approach (trust and speed), and what we’ve learned along the way.

I’ll cover the advantages of keeping things fast, and how we use technology to help us do that (and stay that way), and also what we do when things do go wrong (as they inevitably will).

I won’t present a one-size-fits-all Royal Road to Safety, because there isn’t one. Instead, I’ll aim to kickstart conversations you can have with your colleagues about your organisation’s attitude to risk, and what changes you might want to make to cope with your own future failures.

Ian Malpass

May 28, 2015
Tweet

More Decks by Ian Malpass

Other Decks in Technology

Transcript

  1. FAILURE
    is an option
    IAN MALPASS · @indec
    etsy

    View full-size slide

  2. you will create
    BUGS

    View full-size slide

  3. you will build the
    WRONG
    THING

    View full-size slide

  4. you will not foresee the
    UNEXPECTED

    View full-size slide

  5. failure has a
    COST

    View full-size slide

  6. failure is
    INEVITABLE

    View full-size slide

  7. expensive
    failure is
    NOT

    View full-size slide

  8. just

    SPEED

    View full-size slide

  9. just

    TRUST

    View full-size slide

  10. DEPLOY
    DEPLOY
    DEPLOY
    DEPLOY
    DEPLOY

    View full-size slide

  11. code

    REVIEWS

    View full-size slide

  12. manual
    TESTING

    View full-size slide

  13. call
    SECURITY

    View full-size slide

  14. automated
    TESTING

    View full-size slide

  15. TRY

    (try again)

    View full-size slide

  16. saved by the

    PRINCESS

    View full-size slide

  17. watch the
    GRAPHS

    View full-size slide

  18. watch the
    LOGS

    View full-size slide

  19. feature
    FLAGS

    View full-size slide

  20. testing the
    1%

    View full-size slide

  21. testing the
    2%

    View full-size slide

  22. testing the
    10%

    View full-size slide

  23. testing the
    50%

    View full-size slide

  24. testing the
    100%

    View full-size slide

  25. MINIMUM-ISH
    viable product

    View full-size slide

  26. STAFF
    testing

    View full-size slide

  27. expect the
    UNEXPECTED

    View full-size slide

  28. PARTIAL
    failure

    View full-size slide

  29. we still
    FAIL

    View full-size slide

  30. LEARN
    from failure

    View full-size slide

  31. FRANK
    analysis

    View full-size slide

  32. ⭐️⭐️⭐️⭐️

    View full-size slide

  33. push the
    ENVELOPE

    View full-size slide