Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Testing in Production for the Bold and True

Rob Crowley
November 15, 2018

Testing in Production for the Bold and True

Microservices and containers have transformed application design and deployment patterns. Modern cloud native architectures - which underpin many of the world's ground-breaking tech companies such as Uber, Netflix and Airbnb - afford unparalleled levels of agility and scale but are not without trade-offs. Testing in particular poses a significant challenge. With a complex adaptive system that can fail in myriad different ways, what confidence can we really gain from proving it works in a test environment with a certain data set at one particular point in time? Faced with such challenges, "testing in production" has become an attractive approach for enabling the safe deployment and release of software systems at speed.

In this talk, we will explore the gamut of techniques that comprise testing in production including: traffic shadowing at deploy time; feature flags and canarying at release time; as well as chaos testing, A/B tests and tracing post release. Additionally, we will see through a series of live demonstrations how Kubernetes and Istio, a leading open source service mesh, can bring these advanced techniques within reach of mere mortals.

By the end of the session, you will not only understand the techniques involved in safely testing in production but also have the knowledge to put them into practice.

Rob Crowley

November 15, 2018
Tweet

More Decks by Rob Crowley

Other Decks in Programming

Transcript

  1. View Slide





  2. View Slide

  3. View Slide

  4. View Slide

  5. Customers don’t measure you on how
    hard you tried. They measure you on
    what you deliver.

    View Slide

  6. View Slide

  7. View Slide

  8. View Slide

  9. View Slide

  10. View Slide

  11. View Slide

  12. View Slide

  13. View Slide

  14. View Slide

  15. View Slide

  16. If something goes wrong with the release
    now then at least we know that we’ve
    done everything we could.

    View Slide


  17. View Slide

  18. View Slide

  19. View Slide

  20. View Slide

  21. View Slide

  22. View Slide

  23. View Slide

  24. View Slide

  25. View Slide

  26. View Slide

  27. View Slide

  28. View Slide

  29. View Slide

  30. View Slide

  31. View Slide

  32. View Slide

  33. View Slide

  34. View Slide

  35. We shape our tools and thereafter our
    tools shape us.

    View Slide

  36. View Slide

  37. View Slide

  38. View Slide

  39. Deploy
    Debug
    Write

    View Slide

  40. View Slide

  41. View Slide

  42. View Slide

  43. View Slide

  44. View Slide

  45. View Slide

  46. View Slide

  47. View Slide

  48. View Slide

  49. View Slide

  50. View Slide

  51. View Slide

  52. X

    View Slide

  53. View Slide

  54. View Slide

  55. X

    View Slide

  56. View Slide

  57. View Slide

  58. View Slide



  59. View Slide

  60. View Slide

  61. View Slide

  62. View Slide











  63. View Slide