Continuous Load Testing from the Cloud

I explore some of the definitions of continuous load testing as well as two popular approaches for simulating protocol level users and browser level users on flood.io from the cloud.

Transcript

1. Continuous LOAD TESTING from the cloud @tim_koopmans CMG CloudXchange
2. WHY DO WE CARE SO MUCH ABOUT CONTINUOUS TESTING?
4. h"ps://danashby.co.uk/2016/10/19/con6nuous-tes6ng-in-devops/
5. / lōd test / load test verb gerund or present participle: load testing simulate demand on a system and measure it for performance “he was load testing in production, what could go wrong?”
6. / kənˈtinyo͞o / con·tin·ue verb persist in an activity or process “she was able to continue the load test effort”
7. / kənˈtinyo͞oəs / con·tin·u·ous adjective forming an unbroken whole; without interruption “I heard that you are doing continuous load testing”
8. Decisions/Year
9. Decisions/Week
10. L R
11. L R
12. L R
13. L R
14. L R
15. WHY DO WE CARE SO MUCH ABOUT CONTINUOUS LOAD TESTING?
16. Performance
17. Availability
18. Availability
20. Reliability
21. Reliability
22. Scalability
23. Scalability
24. Scalability
25. HOW?
26. Simulate demand Measure performance
27. Measure Simulate ?
28. A BRIEF HISTORY OF PROTOCOL LEVEL USERS
31. 1997 2015 2006 2011 2014 INNOVATION curve
32. 1997 HTTP 1.1 2015 HTTP 2.0 2006 XHR jQuery 2011 WebSocket iOS Android 2014 HTML5 ReactJS … COMPLEXITY curve
33. Simulating behavior
34. Simulating users
35. Emulating browsers
36. flood.io
37. Protocol testing
39. So you want to visit amazon.com How many requests will that take? Browser testing
40. 1 Visit +300 Requests Browser Level Protocol Level
41. Protocol level traps
42. Protocol level recording
43. Protocol level testing
44. Comparing two runs
45. Header differences
46. Cookie differences
47. Session differences
48. POST data differences
49. 6 documents 45 requests 27 static assets 1 XHR 307 header values 39 post values 155 differences 78 cookie values 10 X-CSRF tokens
50. Protocol level debt Lots of code Isolated assets Fragile frameworks
51. Reinventing browser testing
52. Browser Level Protocol Level
54. Take the best of two breeds + = element.flood.io
61. Run it locally
62. Run it remotely
64. Event ticketing for some of the world's most successful touring acts like the Eagles and Harry Styles means you have to be ready for big traffic spikes and meet the high expectations of customers as well as eminent partners such as American Express and Ticketmaster. Tricentis Flood was exactly what we needed: a cloud-based load testing platform that would let us distribute both protocol-level testing and browser-level testing. Josh Cronemeyer, CTO of LaneOne We love how Flood lets us quickly and efficiently get about the business of load testing …
65. Never too early Never too late Continuous
66. Simulation Simulating User Behavior Avoid emulating a browser
67. Leverage Cloud Resources Don’t try this at home Cloud
68. Questions?