Magento 2 performance test toolkit

Slide 1

Slide 1 text

Slide 2

Slide 2 text

© 2015 Magento, Inc. Page | 2 Bundled test data profiles: ● small.xml (0.85K products, 30 categories, 20 customers) ● medium.xml (17K products, 300 categories, 200 customers) ● large.xml (425K products, 1000 categories, 2000 customers) ● extra_large.xml (850K products, 3000 categories, 5000 customers) Performance Toolkit - Test Data Generator cd $MAGENTO_DIR/dev/tools/performance-toolkit/ php -f generate.php -- --profile=profiles/

Slide 3

Slide 3 text

© 2015 Magento, Inc. Page | 3 Performance Toolkit - jMeter Test Plan sh $JMETER_DIR/bin/jmeter -n \ -t $MAGENTO_DIR/dev/tools/performance-toolkit/benchmark.jmx \ -l $OUTPUT_DIR/results.jtl \ -Jreport_save_path=$OUTPUT_DIR \ -Jhost=$HOST \ -Jbase_path=$BASE_PATH \ -Jusers=$USERS \ -Jramp_period=$RAMP_PERIOD \ -Jloops=$LOOPS \ -Jadmin_user=$ADMIN_USER \ -Jadmin_password=$ADMIN_PASSWORD

Slide 4

Slide 4 text

© 2015 Magento, Inc. Page | 4 Bundled tests threads: ● setUp ● Category page ● Product page (+ adding items to cart) ● Guest checkout (+ adding items to cart) ● Customer checkout (+ adding items to cart) ● Pull Request #961: Catalog search (+ layered navigation) ● tearDown Performance Toolkit - jMeter Test Plan

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

© 2015 Magento, Inc. Page | 8 What I liked... ● We now have the official performance testing toolkit. ● Bundled test data generator works very well. ● Stable and mature load testing tool Apache jMeter was selected. ● Adding new tests to bundled jMeter test plan is relatively straightforward.

Slide 9

Slide 9 text

© 2015 Magento, Inc. Page | 9 What I think we can do better… ● Magento 2 is a large step back from Magento Enterprise Edition performance-wise. ● jMeter test plan does not simulate Ajax requests required for fetching dynamic/private content in the context of Page Cache.

Slide 10

Slide 10 text

© 2015 Magento, Inc. Page | 10 What I think are open questions… ● Considering performance charts I just presented, is it realistic to expect that goal of increasing Magento performance and scalability with 2.0 version will be achieved before general availability of Magento 2?