Markets Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com 3 London Stock Exchange Group • A leading diversified international exchange and infrastructure group with assets across the entire exchange value chain • The Group can trace its history back to 1698 • Headquartered in the United Kingdom, with significant global operations, the Group employs approximately 5,500 people • Post trade and risk management services are a significant part of the Group’s business operations • Through FTSE Russell, the Group is a global leader in financial indexing, benchmarking and analytic services with approximately $10 trillion benchmarked to its indexes
Markets Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com 4 Open Access Software Testing Exactpro is: • A specialist firm operating an open access model with focus on functional and operational testing of securities data distribution, trading systems, risk management, market surveillance and post- trade infrastructures. • A UK company with operations in the US and four QA & software development centres in Russia • Part of London Stock Exchange Group as of May 29, 2015 • Incorporated in 2009 with 10 people, our company has experienced significant growth as satisfied clients require more services; now employing over 350 specialists Clients Worldwide:
Markets Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com 11 Question Everything Do not Trust: • Test Tools • Average Metrics and Percentiles • Load Shape is Right • System Requirements • Anything
Markets Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com 12 Keep Calm Have No Fear: • Annihilate the System Under Test • Repeat the Same Tests Many Times • Load Levels that Exceed Presumed Production • Make no Assumptions About Extrapolating Test Results into More Scalable Environments
Markets Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com 14 Achieving Diverse and Relevant Load 1. Random load “Pace Maker” 2. Variety of Passive Liquidity 3. “Agressors” try to interact with the market to increase the number of test cases happening in the environment 4. Analyse the situation in retrospective. Make sure that what happened is correct. Tick checkboxes against tests that were actually executed Updated test library