Performance testing with Multi-Mechanize

Presentation to DC Python on Feb 7, 2012 about Multi-Mechanize, a performance testing framework.

Transcript

1. Rich Leland DC Python - February 7, 2012 PERFORMANCE TESTING WITH
2. WHAT IS MULTI-MECHANIZE?
3. WHAT IS PERFORMANCE TESTING?
4. UNDERSTAND AND DEFINE YOUR GOALS
5. WRITE TESTS, RUN. RINSE & REPEAT.
7. OBLIGATORY BILL MURRAY PHOTO
8. NOW WHAT?
10. USE THEM ALL
11. WHY USE MULTI-MECHANIZE?
12. IT’S PYTHON OH, AND IT CAN TEST MORE THAN JUST WEBS
13. PAGES
14. FORMS
15. APIs
16. DATABASES
17. CACHE
18. ANYTHING YOU CAN WRITE USING PYTHON
19. HOW DO I USE IT?
20. pip install multi-mechanize
21. multimech-newproject <myproject>
22. myproject ├── test_scripts │ └── example.py └── config.cfg multimech-newproject myproject
23. [global] run_time: 30 rampup: 0 results_ts_interval: 10 progress_bar: on console_logging: off xml_report: off [user_group-1] threads: 3 script: example.py [user_group-2] threads: 3 script: example.py
24. import requests import time class Transaction(object): def run(self): start = time.time() url = 'http://www.treehugger.com/' r = requests.get(url) latency = time.time() - start self.custom_timers['Home_Page'] = latency time.sleep(1)
25. multimech-run <myproject>
26. $ multimech-run . user_groups: 2 threads: 20 [================100%==================] 60s/60s transactions: 232 timers: 464 errors: 0 waiting for all requests to finish... analyzing results... created results/results_2012.02.06_23.11.01/results.html done.
27. RESULTS
28. myproject ├── results │ ├── results_2012.02.05_00.16.23 │ │ ├── config.cfg │ │ ├── results.csv │ │ └── results.html │ └── static ├── test_scripts └── config.cfg Results output
31. AIGHT, COOL. HOW ABOUT SOME OTHER EXAMPLES?
32. import requests import time class Transaction(object): def run(self): start = time.time() url = 'http://example.com/api/v1/articles/' r = requests.get(url) latency = time.time() - start self.custom_timers['API_Articles'] = latency time.sleep(1)
33. import time from sqlalchemy import create_engine class Transaction(object): def __init__(self): self.custom_timers = {} conn_info = 'postgresql+psycopg2://rleland@localhost/th' self.engine = create_engine(conn_info) def run(self): start = time.time() self.engine.execute("SELECT COUNT(*) FROM cms_entry") latency = time.time() - start self.custom_timers['Entries_Count'] = latency
34. import memcache import random import time NODES = ['192.168.10.2:11211',] DATA_SIZE = 30000 WAIT_TIME = .1 KEY_RANGE = (1, 1000000) class Transaction(object): def __init__(self): self.mc = memcache.Client(NODES) self.custom_timers = {} def run(self): key = str(random.randint(*KEY_RANGE)) data = '*' * DATA_SIZE start_timer = time.time() self.mc.set(key, data) stop_timer = time.time() self.custom_timers['SET'] = stop_timer - start_timer start_timer = time.time() self.mc.get(key) stop_timer = time.time() self.custom_timers['GET'] = stop_timer - start_timer time.sleep(WAIT_TIME)
36. SET GOALS WRITE TESTS RUN TESTS ANALYZE RESPOND REPEAT
37. THANK YOU
38. Docs http://testutils.org/multi-mechanize/ Code http://github.com/cgoldberg/multi-mechanize Twitter @multimechanize IRC #multimech NOW GO GET YOU SOME