Performance testing with machine learning

Доклад затрагивает такую важную часть, как нагрузочное тестирование. В докладе будет рассмотрены процессы по внедрению в пайплайн, уменьшению ручной работы по анализу и подготовке данных, а так же применение машинного обучения для анализа результатов по части квантилей.

Transcript

1. Align Technology, Inc. 1 © 2019 Align Technology, Inc. 1 Confidential – For Internal Use Only New part of pipeline Performance testing with machine learning
2. Align Technology, Inc. 2 Agenda • Basic problems of performance testing • Why did we decide to move forward? • Architectural solution • What have we improved already? • What are we going to do after?
3. Align Technology, Inc. 3 Basic problems of performance testing
4. Align Technology, Inc. 4 Daily routine of performance engineers ENV x (S + DU + RG + RA) = DT Test dependency environments test data Test results results analyzing results gathering Build dependency scaling BD x DT = ?
5. Align Technology, Inc. 5 Test dependency
6. Align Technology, Inc. 6 Scaling and data Monitoring System Performance test Get test variables Load for requests ENV config Cache Service Test data
7. Align Technology, Inc. 7 Build dependency
8. Align Technology, Inc. 8 Build CI Run script Test run MS Docker container Gathering Analyzing PASS/FAIL Tests results
9. Align Technology, Inc. 9 Test results gathering
10. Align Technology, Inc. 10 Jmeter Logs Service Custom Service Interface of java class from custom JAR Client side as 90% percentiles Server Monitoring Service Generate Results Server side as 90% percentiles Errors from logs Send metrics for visualization
11. Align Technology, Inc. 11 • Results analyzing
12. Align Technology, Inc. 12 Machine learning
13. Align Technology, Inc. 13 We mark a build as passed 90% percentiles from client side and server side are ok There are no errors from logs service There are no degradation from DB
14. Align Technology, Inc. 14 • What is the next?
15. Align Technology, Inc. 15 DB check from the client side with python plots Postgre connections HikariPool connections
16. Align Technology, Inc. 16