AutoDevOpsQA – Continues Performance Testing of Deployments

Continues Performance Testing of Deployments from GitLab's CI/CD Pipelines. Hold at https://www.meetup.com/de-DE/DevOps-am-Dom/events/258121828/

Transcript

1. DevOps am Dom
2. EXPLICIT EVOLVING PARENTAL ADVISORY
3. EHLO1 • Lars Wolff
 @larsvegas • Development, Agile Coaching, Consulting, Performance • Agility and ship it!!!!1 • AWS UserGroup Cologne • (WebPerfMeetup CGN) • Co-founder & CEO StormForger.com 1https://www.ietf.org/rfc/rfc2821.txt
4. Performance Testing SaaS for DevOps StormForger empowers organizations to embrace 
 continuous performance testing
5. AutoDevOpsQA
6. Continues Performance Testing of Deployments
7. AutoDevOpsQA
9. AutoDevOpsQA
10. DevOps
11. Development & Operations
12. Two hard things
13. - Phil Karlton “There are only two hard things in Computer Science:
 
 cache invalidation
 and naming things.” https://martinfowler.com/bliki/TwoHardThings.html
14. Development & Operations
15. QA?!?
16. https://en.wikipedia.org/wiki/DevOps
17. –Johnny Appleseed “Type a quote here.”
18. DevOpsQA!!!
19. Automated Functional Testing ✅
20. Automated Non-functional Testing
21. Performance Testing
22. Performance Tests • Collection of 
 non-functional test methods • Not to be defined with 
 absolute selectivity • Different goals and perspectives Load Testing Stress Testing Spike Testing Soak Testing Endurance Testing Resilience Testing Configuration Testing Scalability Testing
24. – Physics “Complex systems are systems with high interdependency.”
25. scaling resources
 ≠ scaling applications
26. Performance Testing
27. Understand your systems behaviour • Individual usage • System & software architecture • Cloud/runtime environment • Used services and their behaviour
28. Check non-functional requirements • e.g. 99% of all requests are served in under 500ms • e.g. 95% of all calls to /graphql are served in under 250ms • e.g. The User Journey XYZ has a error rate of ZERO at 200% of production traffic
29. Test Definition definition.session("sign-up-with-token", function(session) { session.get("/status"); session.wait(2); var users = session.ds.loadStructured("users.csv"); var user = session.ds.pickFrom(users); session.post("/users/sign_up", { payload: { email: user.email(), password: user.password(), ref_token: session.pick("referrer_token"), phone: "+4917" + session.pick("phone"), } }); session.wait(60); // … });
30. Test Execution
31. Continuous Performance Testing • Launch via Forge WebUI • Scheduling • forge Command Line Client
32. Launch Load Test from GitLab CI/CD Pipeline
33. Hold my Beer
34. Performance Testing SaaS for DevOps StormForger empowers organizations to embrace 
 continuous performance testing Thanks Q&A Lars Wolff @larsvegas support@stormforger.com https://stormforger.com