Richard Friedman

Open Source Load Testing delivered at FossCon2015

Transcript

1. #1 Load Tes+ng #2 Open Source las+ng legacy #3 Con+nuous Load Tes+ng #4 Let’s build one and scale it RedLine13.com (Almost) Free Load Tes+ng Richard Friedman rich@redline13.com @richardfriedman @redlinethirteen
2. The Common Sense of Load Tes+ng •  Everyone expects it to scale •  Always run a load test •  Start simple •  Model User Behavior •  Set realis+c goals •  Load Tests expose issues, they don’t fix them
3. Performance and Throughput Tes+ng Performance ms Load per sec Stress redline Soak leaks Find BoPleneck. Performance Throughput
4. Build, [Run, Analyze, Fix] Record or create Play on single machine Scale on single agent Run at scale tests Analyze Fix Tweak Configure Scratch Head Define Requirements Build Test Environment
5. Load Tes+ng is Boring Tedious Detailed Precise Then it becomes hard, +me consuming, and frustra+ng Fun Create Run Data And at some point it becomes very rewarding, personally and for users.
6. Load Tes+ng priority AYer QA, During Beta Launch When it falls over Con+nuous Investment in Opera+ons and Development Invest as needed
7. user grinder How it used to work? Minions Start Your Test Plan Servers grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder grinder user
8. How it should work Launch Test Plan Servers You
9. Analyzing with Open Source Monitoring Launch Test Plan Monitoring & Logs Produc+on
10. Open Source Load Tes+ng And every script you ever wrote. Tsung Gatling Seige Tank JMeter clif Yandex locust iago The Grinder TwiPer 10+ 15+ 12+ 15+ 14+ 15+ 4-5 2-3 3-4 1.60 7/2015 1.60 7/2015 2.17 7/2015 1.7.13 6/2015 2.13 3/2015 ab hPperf 2.2.1 10/2014 0.7.3 9/2014 0.6.14 2/2014 3.11 10/2012 GPL 2 GPL 3 LGPL 2.1 APACHE LGPL 2 MIT APACHE BSD-STYLE APACHE X X X X X X X X X X X X X X X X X X X X X X X X X X X X ½ X ½ X X X X X X python java java c erlang java scala python scala 15+ 15+ 2/2015 2/2011 APACHE GPL 2 6/2015 distributed recorder charts plugins graphite jenkins X BeesWithMG 3-4 MIT 1/2013 python
11. Con+nuous Delivery •  Faster Itera+ons •  Master Loca+on of data •  Performance Trend Lines •  Recorded Tests = Work Done •  Agile Development Process •  Unit Performance Tests
12. Why is it interes;ng?
13. Time Perminng •  Anyone want to build a test? – Record JMeter Test •  (or hand build) – Run Locally – Scale Locally – Scale in cloud
14. Thank You RedLine13.com (Almost) Free Load Tes+ng Richard Friedman rich@redline13.com @richardfriedman @redlinethirteen