QA Financial Singapore: Deliberate Practice of Software Testing in Agile World

Slide 1

Slide 1 text

1 Deliberate Practice of Software Testing in Agile World 25 May 2017 Iosif Itkin, Exactpro CEO & Co-Founder London Stock Exchange Group Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com

Slide 2

Slide 2 text

2 London Stock Exchange Group is a leading diversified international exchange and infrastructure group with assets across the entire exchange value chain. Real time data Primary Markets Cash Equities Derivatives Fixed Income IDEM RNS MOT X2M Technology Monte Titoli CC&G ORB ExtraMOT LSEDM IDEX GlobeSettle Unavista Hosting and Connectivity Information Services Post Trade Capital Markets SEDOL Business Services Academy Events &Studios

Slide 3

Slide 3 text

3 Deliberate Practice of Software Testing

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

8 No Trust No Fear No Begging Nobel Prize in literature in 1970 Author “The Gulag Archipelago”

Slide 9

Slide 9 text

9 NO TRUST

Slide 10

Slide 10 text

10 Complex and Stable

Slide 11

Slide 11 text

11 • A specialist firm focused on functional and non functional testing of systems that process wholesale financial products, particularly market infrastructures • A UK company with operations in the US and four QA & software development centres in Russia • Part of London Stock Exchange Group as of May 29, 2015 • Incorporated in 2009 with 10 people, our company has experienced significant growth as satisfied clients require more services; now employing 515 specialists Exactpro is: Front Office Listed Derivatives CRM Dark Pool T2S Clearing FX Fixed Income SEF Reconciliation Onboarding Ticker Plant Commodities Smart Order Router Trading Desktops Index Dissemination FPGA Equities Connectivity Exchange MTF Swaptions Now employing 515 specialists

Slide 12

Slide 12 text

12 Automated testing Compares intended and received results Automated end 2 end clearing system testing Automated monitoring, analysis and reporting 75K messages / second from a single CPU core Measures latencies in microsecond range A variety of algoes simulating end-clients will run and see how system performs Build Software to Test Software

Slide 13

Slide 13 text

Slide 14

Slide 14 text

14 Automate Everything?

Slide 15

Slide 15 text

15 Senseless Iterations Deliberate Practice

Slide 16

Slide 16 text

16 Testing Our Markets

Slide 17

Slide 17 text

17 Collocate Test Automation

Slide 18

Slide 18 text

18 Post-Trade

Slide 19

Slide 19 text

19 Client Network

Slide 20

Slide 20 text

20 New Platform

Slide 21

Slide 21 text

21 Broken Links

Slide 22

Slide 22 text

22 Latency Measurement

Slide 23

Slide 23 text

23 Clients Onboarding Crowdsource Testing

Slide 24

Slide 24 text

24 Focus and Excellence

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

27 Things Can Go Wrong

Slide 28

Slide 28 text

28 1/8 of employees working in QA 128m of transactions per day near Brexit and US elections 84 microseconds equity markets roundtrip times

Slide 29

Slide 29 text

29 Extreme Load Testing

Slide 30

Slide 30 text

30 1. Random load “Pace Maker” 2. Variety of Passive Liquidity 3. “Aggressors” try to interact with the market to increase the number of test cases happening in the environment 4. Analyze the situation in retrospect. Make sure that what happened is correct. Tick checkboxes against tests that were actually executed Updated test library Minirobots

Slide 31

Slide 31 text

31 1. 3. Simulate real trading participants 2.

Slide 32

Slide 32 text

32 Have No Fear

Slide 33

Slide 33 text

33 • Unrealistic Scenarios • Annihilate the System Under Test • Defects Leaking out of a Sprint Have No Fear

Slide 34

Slide 34 text

Slide 35

Slide 35 text

35 Makes Your Projects

Slide 36

Slide 36 text

36 Defects in Production

Slide 37

Slide 37 text

37 • Confirmation that PROD is Configured as TEST • Tested Drops out of Development • Things that You Do Not Trust NO BEGGING

Slide 38

Slide 38 text

38 Agile Software Testing

Slide 39

Slide 39 text

39 https://ru.linkedin.com/in/iosifitkin The seventh EXTENT conference will take place in London, UK. Find out more: www.extentconf.com – LSEG Technology and Quality Assurance – Risk controls and FPGA – MiFID2 Software Testing Challenges – Blockchain and Trading Technology Trends – Learning from Other Industries