Magento 2 performance test toolkit

Magento 2 beta developer forum, Berlin, January 21st to January 22nd 2015.

Transcript

1. Magento is an eBay Inc. company. © 2015 Magento, Inc. All rights reserved. #20: Add a new performance test using the performance test toolkit Marko Martinović, Backend Developer & Team Lead at Inchoo
2. © 2015 Magento, Inc. Page | 2 Bundled test data profiles: • small.xml (0.85K products, 30 categories, 20 customers) • medium.xml (17K products, 300 categories, 200 customers) • large.xml (425K products, 1000 categories, 2000 customers) • extra_large.xml (850K products, 3000 categories, 5000 customers) Performance Toolkit - Test Data Generator cd $MAGENTO_DIR/dev/tools/performance-toolkit/ php -f generate.php -- --profile=profiles/<profile>
3. © 2015 Magento, Inc. Page | 3 Performance Toolkit - jMeter Test Plan sh $JMETER_DIR/bin/jmeter -n \ -t $MAGENTO_DIR/dev/tools/performance-toolkit/benchmark.jmx \ -l $OUTPUT_DIR/results.jtl \ -Jreport_save_path=$OUTPUT_DIR \ -Jhost=$HOST \ -Jbase_path=$BASE_PATH \ -Jusers=$USERS \ -Jramp_period=$RAMP_PERIOD \ -Jloops=$LOOPS \ -Jadmin_user=$ADMIN_USER \ -Jadmin_password=$ADMIN_PASSWORD
4. © 2015 Magento, Inc. Page | 4 Bundled tests threads: • setUp • Category page • Product page (+ adding items to cart) • Guest checkout (+ adding items to cart) • Customer checkout (+ adding items to cart) • Pull Request #961: Catalog search (+ layered navigation) • tearDown Performance Toolkit - jMeter Test Plan
5. © 2015 Magento, Inc. Page | 5 M2 beta 3 w/o cache vs EE 1.14.1.0 w/o cache
6. © 2015 Magento, Inc. Page | 6 M2 beta 3 Built-In vs EE 1.14.1.0 FPC
7. © 2015 Magento, Inc. Page | 7 M2 beta 3 Varnish vs EE 1.14.1.0 FPC
8. © 2015 Magento, Inc. Page | 8 What I liked... • We now have the official performance testing toolkit. • Bundled test data generator works very well. • Stable and mature load testing tool Apache jMeter was selected. • Adding new tests to bundled jMeter test plan is relatively straightforward.
9. © 2015 Magento, Inc. Page | 9 What I think we can do better… • Magento 2 is a large step back from Magento Enterprise Edition performance-wise. • jMeter test plan does not simulate Ajax requests required for fetching dynamic/private content in the context of Page Cache.
10. © 2015 Magento, Inc. Page | 10 What I think are open questions… • Considering performance charts I just presented, is it realistic to expect that goal of increasing Magento performance and scalability with 2.0 version will be achieved before general availability of Magento 2?
11. © 2015 Magento, Inc. Page | 11 Thank you! @MarkoTechyTalk Team Lead/MCD+ at Inchoo