Enterprise Performance Testing Using Cloud

This presentation is among the Top 27 Best Papers/Practice/Tutorials selected, out of 460+ submissions received, to be presented @STC 2012.

Presentation Abstract

Performance Testing involves significant investments in terms of infrastructure, licenses and tools. To avoid the costs and complexities of traditional performance testing methods, organizations across the globe are moving to cloud infrastructure. The Cloud can help organizations scale for higher volume, higher transactions and higher concurrency, quickly and affordably.

Though cloud offers lots of advantages, there are a many challenges that need to be addressed, before performance testing can become fully viable. The session will describe ways to overcome these challenges by using suitable cloud models along with some best practices. This talk will also share various models that have been used for customers with varied performance challenges.

Performance engineers worldwide are harnessing the infinite computing power of cloud to test the performance of their web, mobile and cloud applications. Given this immense popularity of cloud-enabled performance testing we will discuss how it helps in overcoming the limitations of a test strategy that relies entirely on on-premise performance testing.

About the Author

Shirish Bhale heads the Performance Engineering practice at Impetus. He has been involved in various initiatives and R&D in this domain and has played a pivotal role in design and development of SandStorm, Impetus’ enterprise performance testing tool. For the past sixteen years, Shirish has been actively involved in performance engineering and testing space, seeing the software industry move from client server to an ASP to a SaaS and now to a cloud model. He is also in charge of account management, project deliveries, and enduring customer relationships.

Shirish is a certified SCRUM Master and is a regular speaker and contributor at technology conferences (including SQE), forums, workshops and webinars. He has also delivered trainings on Performance Engineering to mid-level engineers.

Transcript

1. Enterprise P Enterprise P Testing using Cloud Author: Shirish Bhale Performance Performance Testing using Cloud Author: Shirish Bhale
2. Outline • On-premise performance • On-premise performance Limitations • Cloud-based performance Benefits and challenges • Current cloud-enabled solutions • Our recommended approach Outline performance testing performance testing performance testing Benefits and challenges enabled solutions Our recommended approach
3. Key Drivers Key Drivers
4. Limitations of On Performance Testing • Test environment set up Hardware and software procurement Maintenance Variation in load generators Shared between teams Shared between teams • Simulating realistic tests Limitations of On-premise Performance Testing Test environment set up Hardware and software procurement Variation in load generators Shared between teams Shared between teams Simulating realistic tests
5. Cloud- Performance Testing • Test environment set up Automated provisioning of load generators • Affordable, Pay-as-you- • Scalability and Elasticity • Scalability and Elasticity On-demand load generation -based Performance Testing Test environment set up Automated provisioning of load generators -go model demand load generation
6. Cloud- Performance Testing • Tests entire delivery chain Simulate multiple geographies Realistic network conditions • Anytime, anywhere access -based Performance Testing Tests entire delivery chain Simulate multiple geographies Realistic network conditions Anytime, anywhere access
7. Challenges of Cloud-based Approach • Data security • Data security • Testing intranet applications • Repeatability of tests • Identifying bottlenecks and debugging capabilities • Application monitoring • Test assets management Challenges of based Approach Testing intranet applications Identifying bottlenecks and debugging capabilities Test assets management
8. Current Cloud-enabled Solutions • Moving on-premise tools on cloud • Cloud provisioned solutions • Hybrid solutions • Hybrid solutions enabled Solutions premise tools on cloud Cloud provisioned solutions
9. Moving On-premise Tools on Cloud premise Tools on Cloud
10. Cloud Provisioned Solutions Cloud Provisioned Solutions
11. Hybrid Solutions Hybrid Solutions
12. Recommendation: Two Approach Recommendation: Two-phase Approach
13. Recommendation: Two Approach Recommendation: Two-phase Approach
14. Best Practices • Secure communication using SSL • Optimized load generators • Automated provisioning to scale high concurrency • Automated provisioning to scale high concurrency Best Practices Secure communication using SSL Optimized load generators Automated provisioning to scale high concurrency Automated provisioning to scale high concurrency
15. Best Practices • Integrated solution • Integrated solution On-premise and cloud • Repeatability of tests • • Create and validate scripts locally • Support for multiple clouds Best Practices premise and cloud-based Create and validate scripts locally Support for multiple clouds
16. Comparing Cloud Solutions Comparing Cloud Solutions
17. Q&A Q&A
18. Follow us on Twitter @impetustech Follow us on Twitter @impetustech