Magento 2 performance test toolkit

Magento 2 performance test toolkit

Magento 2 beta developer forum, Berlin, January 21st to January 22nd 2015.

C41af9ffd040338b7a61fa010ecd0fa7?s=128

Marko Martinović

January 22, 2015
Tweet

Transcript

  1. Magento is an eBay Inc. company. © 2015 Magento, Inc.

    All rights reserved. #20: Add a new performance test using the performance test toolkit Marko Martinović, Backend Developer & Team Lead at Inchoo
  2. © 2015 Magento, Inc. Page | 2 Bundled test data

    profiles: • small.xml (0.85K products, 30 categories, 20 customers) • medium.xml (17K products, 300 categories, 200 customers) • large.xml (425K products, 1000 categories, 2000 customers) • extra_large.xml (850K products, 3000 categories, 5000 customers) Performance Toolkit - Test Data Generator cd $MAGENTO_DIR/dev/tools/performance-toolkit/ php -f generate.php -- --profile=profiles/<profile>
  3. © 2015 Magento, Inc. Page | 3 Performance Toolkit -

    jMeter Test Plan sh $JMETER_DIR/bin/jmeter -n \ -t $MAGENTO_DIR/dev/tools/performance-toolkit/benchmark.jmx \ -l $OUTPUT_DIR/results.jtl \ -Jreport_save_path=$OUTPUT_DIR \ -Jhost=$HOST \ -Jbase_path=$BASE_PATH \ -Jusers=$USERS \ -Jramp_period=$RAMP_PERIOD \ -Jloops=$LOOPS \ -Jadmin_user=$ADMIN_USER \ -Jadmin_password=$ADMIN_PASSWORD
  4. © 2015 Magento, Inc. Page | 4 Bundled tests threads:

    • setUp • Category page • Product page (+ adding items to cart) • Guest checkout (+ adding items to cart) • Customer checkout (+ adding items to cart) • Pull Request #961: Catalog search (+ layered navigation) • tearDown Performance Toolkit - jMeter Test Plan
  5. © 2015 Magento, Inc. Page | 5 M2 beta 3

    w/o cache vs EE 1.14.1.0 w/o cache
  6. © 2015 Magento, Inc. Page | 6 M2 beta 3

    Built-In vs EE 1.14.1.0 FPC
  7. © 2015 Magento, Inc. Page | 7 M2 beta 3

    Varnish vs EE 1.14.1.0 FPC
  8. © 2015 Magento, Inc. Page | 8 What I liked...

    • We now have the official performance testing toolkit. • Bundled test data generator works very well. • Stable and mature load testing tool Apache jMeter was selected. • Adding new tests to bundled jMeter test plan is relatively straightforward.
  9. © 2015 Magento, Inc. Page | 9 What I think

    we can do better… • Magento 2 is a large step back from Magento Enterprise Edition performance-wise. • jMeter test plan does not simulate Ajax requests required for fetching dynamic/private content in the context of Page Cache.
  10. © 2015 Magento, Inc. Page | 10 What I think

    are open questions… • Considering performance charts I just presented, is it realistic to expect that goal of increasing Magento performance and scalability with 2.0 version will be achieved before general availability of Magento 2?
  11. © 2015 Magento, Inc. Page | 11 Thank you! @MarkoTechyTalk

    Team Lead/MCD+ at Inchoo