Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com Innovation in Quality Assurance – What is the Impact on Trading technology? Iosif Itkin, Co-Founder and CEO Exactpro London Stock Exchange Group Trading Show New York October 2015

Exactpro Systems Exactpro is: Clients Worldwide: 2 Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com A specialist firm focused on functional and non functional testing of systems that process wholesale financial products, particularly market infrastructure A UK company with operations in the US and four QA & software development centres in Russia Part of London Stock Exchange Group as of May 29, 2015 Incorporated in 2009 with 10 people, our company has experienced significant growth as satisfied clients require more services - now employing over 310 specialists

3 FrAgile Process Crowd-sourced Testing Formal Verification Methodologies Cognitive Technology Quality Assurance Trends Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

4 FrAgile Process Test is Dead Ideas before Products Happy Software Developers Software Engineer in Test Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

5 Crowd-Sourced Testing Immediate Feedback from Diverse User Base Instrumentation is Required to Process Data Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

6 Formal Methods Model Checking Theorem Proving Static Analysis Verification http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?id=2006-001A Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

7 What’s Next? Can We Learn from Other Industries? Be Both Faster and Safe Who Had the Most Severe Problems with Technology? Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

8 Proposed Approach Build Software to Test Software Test Tool Sophistication should Match Platform’s Complexity A Good Robot is Required to Survive in Robot Apocalypse Summer Glau - The Sarah Connor Chronicles Grace Park - Battlestar Galactica Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

9 Trading Systems Testing Instruments, Risk Control and Monitoring Tools should have the Same Priority as the Trading Platform Testability is Required for Agile Process and Continuous Integration SET = Building Software to Test Software No Formal Artefacts from Agile Process. Parallel Stream for Test Harness Formal Verification can Improve Quality The Software will Break Anyway The Absence of Adequate Monitoring and Kill Switches is What Turns a Problem into a Disaster Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

10 Passive Testing Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

11 Assembling Test Infrastructure Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

12 Test Harness for Algo Trading Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

13 Achieving Efficiency Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com

14 Thank you November 11 November 12 – 14 Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com