Exactpro Non-Functional Testing at London Stock Exchange

Slide 1

Slide 1 text

Non-Functional Testing at London Stock Exchange 5 April 2017 Iosif Itkin, Exactpro CEO & Co-Founder London Stock Exchange Group Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com

Slide 2

Slide 2 text

2 Clients Worldwide: Software Quality Assurance experts for global financial markets enjoying steady growth thanks to expertise and unparalleled service Exactpro is:

Slide 3

Slide 3 text

3 London Stock Exchange Group 1/8 of employees working in QA 128m of transactions per day near Brexit and US elections 84 microseconds equity markets roundtrip times

Slide 4

Slide 4 text

4 No Trust No Fear No Begging Question Everything. Keep Calm. Be Confident.

Slide 5

Slide 5 text

5 Build Software to Test Software

Slide 6

Slide 6 text

6 Heavy Load - Easy

Slide 7

Slide 7 text

7 Heavy Load - Easy Finding Functional Problems - Difficult

Slide 8

Slide 8 text

8 Latency Measurement

Slide 9

Slide 9 text

9 Latency Measurement

Slide 10

Slide 10 text

10 Testing Methods 1. 3. Simulate real trading participants 2.

Slide 11

Slide 11 text

11 Diverse and Relevant Load / Validation 1. Random load “Pace Maker” 2. Variety of Passive Liquidity 3. “Aggressors” try to interact with the market to increase the number of test cases happening in the environment 4. Analyze the situation in retrospect. Make sure that what happened is correct. Tick checkboxes against tests that were actually executed Updated test library

Slide 12

Slide 12 text

12 Failover Tests and Catching In-Flight Transactions

Slide 13

Slide 13 text

13 Have No Fear

Slide 14

Slide 14 text

14 Keep Calm • Unrealistic Scenarios • Annihilate the System Under Test • Repeat the Same Tests Many Times • Load Levels that Exceed Presumed Production

Slide 15

Slide 15 text

15 Multiple Failover Scenarios

Slide 16

Slide 16 text

16 • Test Tools • Confirmation that PROD is Configured as TEST • Max Load Figure • Load Scenarios for Existing Production System • All Test Scenarios in Advance • Constant Support Do Not Beg For:

Slide 17

Slide 17 text

17 “Train Hard, Fight Easy” (A. Suvorov) http://img-fotki.yandex.ru/get/31286/15397073.5e9/0_167068_902ac8e_XL http://gsvu.mvd.ru/upload/site142/folder_page/temp/__1429820772_866/fb3fa781009c14 b1cfb62847cf9f9485.jpg Suvorov battling his way through the snow-capped Alps

Slide 18

Slide 18 text

18 Open Access Software Testing www.exactpro.com

Slide 19

Slide 19 text

19 Questions & Answers https://ru.linkedin.com/in/iosifitkin The seventh EXTENT conference will take place in London, UK. Find out more: www.extentconf.com – LSEG Technology and Quality Assurance – Risk controls and FPGA – Market Surveillance systems – Blockchain and trading technology trends – Artificial intelligence