Slide 1

Slide 1 text

Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com Non-Functional Testing: a Quest for the Big Button 29 June 2017 Anna Khristenok, Head of Non-Functional Testing Department, Exactpro, London Stock Exchange Group

Slide 2

Slide 2 text

2 Defining NFT

Slide 3

Slide 3 text

3

Slide 4

Slide 4 text

4 Test Preparation

Slide 5

Slide 5 text

5 • Production-like • Stress The Dilemma

Slide 6

Slide 6 text

6 MiFID II Article 14 1. Trading venues shall, in the context of the self-assessment to be performed in accordance with Article 2, evaluate the performance and capacity of their algorithmic trading systems and associated processes for governance, accountability, approval and business continuity arrangements. 2. As part of the evaluation referred to in paragraph 1, trading venues shall perform stress tests where they simulate adverse scenarios to verify the performance of the hardware, software and communications and identify the scenarios under which the trading system or parts of the trading system perform their functions with systems failures, outages or errors in matching transactions. 3. Stress tests shall cover all trading phases, trading segments and types of instruments traded by the trading venue and shall simulate members' activities with the existing connectivity set-up. 4. The adverse scenarios referred to in paragraph 2 shall be based on the following: a) an increased number of messages received, starting at the highest number of messages managed by the trading venue's system during the previous five years; b) unexpected behaviour of the trading venue's operational functions; c) random combination of stressed and normal market conditions and unexpected behaviour of the trading venue's operational functions.

Slide 7

Slide 7 text

7 Passed/Failed?

Slide 8

Slide 8 text

8 Subject to the Auditing • Test scenario • Implementation • Test data • Load profile and distribution • System settings • Hardware/firmware setup • The phase of the Moon 

Slide 9

Slide 9 text

9 Results Processing

Slide 10

Slide 10 text

10 Build Software to Test Software

Slide 11

Slide 11 text

11 Specific Test – Specific Test Tool Capacity & Stress Testing Failover Latency Daily Life Cycle

Slide 12

Slide 12 text

12 Thank You!