What really happens when you deliver software quickly

https://stareast.techwell.com/
StarEast Keynote 2017

Transcript

1. Prepared by Sally Goble, Head of quality What really happens when you deliver software quickly?
2. • www.theguardian.com • >100 releases a day • 9m visitors a day • 2 What really happens when you deliver software quickly? StarEast 2017 • Pulitzer prize in 2014 • 23.4m on 9 November ‘16
3. • The team 3 What really happens when you deliver software quickly? StarEast 2017
4. • To convince you that the changing model of delivery of software 
 means that we should fundamentally change the way we think about testing Aim 4 What really happens when you deliver software quickly? StarEast 2017
5. What has changed in the model of delivery? How did that change make you reevaluate the role of QA/testing? What do you do now? 5 What really happens when you deliver software quickly? StarEast 2017
6. What has changed in the model? 6 What really happens when you deliver software quickly? StarEast 2017
7. The (g)olden days of software delivery... • 7 What really happens when you deliver software quickly? StarEast 2017
8. Software had to be 
 ‘perfect’ 8 What really happens when you deliver software quickly? StarEast 2017
9. The non negotiable rhythm of delivery of software dictated the need for perfect software 9 What really happens when you deliver software quickly? StarEast 2017
10. While we were busy creating perfect software, something happened… 10 What really happens when you deliver software quickly? StarEast 2017
11. The Internet came along 11 What really happens when you deliver software quickly? StarEast 2017
12. The Internet changed the ability to ship 12 What really happens when you deliver software quickly? StarEast 2017
13. How did that change the role of QA/ testing? 13 What really happens when you deliver software quickly? StarEast 2017
14. 14 What really happens when you deliver software quickly? StarEast 2017 2000 2016 Slow delivery Continuous delivery Fastish delivery 2010
15. 15 6 years ago… StarEast 2017 What really happens when you deliver software quickly?
16. • 16 What really happens when you deliver software quickly? StarEast 2017
17. 17 StarEast 2017 What really happens when you deliver software quickly? We needed to speed up…
18. Our eureka moment! 18 StarEast 2017 What really happens when you deliver software quickly?
19. 19 What we did next… StarEast 2017 What really happens when you deliver software quickly? “light touch” testing
20. • “Not wrong long” 20 StarEast 2017 What really happens when you deliver software quickly?
21. 21 A risky approach? StarEast 2017 What really happens when you deliver software quickly?
22. • • Single feature releases • Aggressive caching • Feature switches • Canary releases • Monitoring and alerting … and • Post release techniques • Beta programmes 22 Minimizing risk: A toolbox of techniques include... StarEast 2017 What really happens when you deliver software quickly?
23. • 23 StarEast 2017 What really happens when you deliver software quickly? What do you do now?
24. • testing != quality 24 StarEast 2017 What really happens when you deliver software quickly?
25. • 25 StarEast 2017 What really happens when you deliver software quickly? What do you do now? • Enable teams to improve quality
26. 26 StarEast 2017 What really happens when you deliver software quickly? Enabled teams to improve quality - exposed metrics to all
27. • 27 Enabled teams to improve quality - the “device wall” StarEast 2017 What really happens when you deliver software quickly?
28. 28 StarEast 2017 What really happens when you deliver software quickly? Enabled teams to improve quality - setting standards
29. • 29 StarEast 2017 What really happens when you deliver software quickly? Enabled teams to improve quality - innovative tooling
30. • 30 StarEast 2017 What really happens when you deliver software quickly? What do you do now? • Enable teams to improve quality • Find problems in production quickly
31. 31 StarEast 2017 What really happens when you deliver software quickly? Find problems in production quickly - TiP Tool
32. 32 StarEast 2017 What really happens when you deliver software quickly? Find problems in production quickly - synthetic monitoring
33. 33 StarEast 2017 What really happens when you deliver software quickly? Find problems in production quickly - operational metrics
34. • 34 StarEast 2017 What really happens when you deliver software quickly? What do you do now? • Enable teams to improve quality • Find problems in production quickly • Crowdsource our users
35. 35 StarEast 2017 What really happens when you deliver software quickly? Crowdsourcing our users - replacing testing with betas
36. 36 StarEast 2017 What really happens when you deliver software quickly? Crowdsourcing our users - incorporating our user help team
37. • 37 StarEast 2017 What really happens when you deliver software quickly? What are the benefits of this approach?
38. • To convince you that the changing model of delivery of software 
 means that we should fundamentally change the way we think about testing (or quality!) 38 What really happens when you deliver software quickly? StarEast 2017 Aim
39. •http://www.famousinventors.org/henry-ford If we’d asked the customers 
 what they wanted, they’d just 
 have said ‘faster horses’ 39 What really happens when you deliver software quickly? StarEast 2017
40. • Don’t ask for faster horses 40 StarEast 2017 What really happens when you deliver software quickly?
41. Thank you… 
 
 sally.goble@theguardian.com
 @sallygoble
 41 StarEast 2017 What really happens when you deliver software quickly?