QA Financial Singapore: Deliberate Practice of Software Testing in Agile World

QA Financial Forum Singapore 2017. Event is fully dedicated to quality assurance in financial services software.
25 May 2017
Iosif Itkin, Exactpro CEO
London Stock Exchange Group

Transcript

1. 1 Deliberate Practice of Software Testing in Agile World 25 May 2017 Iosif Itkin, Exactpro CEO & Co-Founder London Stock Exchange Group Open Access Quality Assurance & Related Software Development for Financial Markets Tel: +7 495 640 2460, +1 415 830 38 49 www.exactpro.com
2. 2 London Stock Exchange Group is a leading diversified international exchange and infrastructure group with assets across the entire exchange value chain. Real time data Primary Markets Cash Equities Derivatives Fixed Income IDEM RNS MOT X2M Technology Monte Titoli CC&G ORB ExtraMOT LSEDM IDEX GlobeSettle Unavista Hosting and Connectivity Information Services Post Trade Capital Markets SEDOL Business Services Academy Events &Studios
3. 3 Deliberate Practice of Software Testing
8. 8 No Trust No Fear No Begging Nobel Prize in literature in 1970 Author “The Gulag Archipelago”
9. 9 NO TRUST
10. 10 Complex and Stable
11. 11 • A specialist firm focused on functional and non functional testing of systems that process wholesale financial products, particularly market infrastructures • A UK company with operations in the US and four QA & software development centres in Russia • Part of London Stock Exchange Group as of May 29, 2015 • Incorporated in 2009 with 10 people, our company has experienced significant growth as satisfied clients require more services; now employing 515 specialists Exactpro is: Front Office Listed Derivatives CRM Dark Pool T2S Clearing FX Fixed Income SEF Reconciliation Onboarding Ticker Plant Commodities Smart Order Router Trading Desktops Index Dissemination FPGA Equities Connectivity Exchange MTF Swaptions Now employing 515 specialists
12. 12 Automated testing Compares intended and received results Automated end 2 end clearing system testing Automated monitoring, analysis and reporting 75K messages / second from a single CPU core Measures latencies in microsecond range A variety of algoes simulating end-clients will run and see how system performs Build Software to Test Software
14. 14 Automate Everything?
15. 15 Senseless Iterations Deliberate Practice
16. 16 Testing Our Markets
17. 17 Collocate Test Automation
18. 18 Post-Trade
19. 19 Client Network
20. 20 New Platform
21. 21 Broken Links
22. 22 Latency Measurement
23. 23 Clients Onboarding Crowdsource Testing
24. 24 Focus and Excellence
27. 27 Things Can Go Wrong
28. 28 1/8 of employees working in QA 128m of transactions per day near Brexit and US elections 84 microseconds equity markets roundtrip times
29. 29 Extreme Load Testing
30. 30 1. Random load “Pace Maker” 2. Variety of Passive Liquidity 3. “Aggressors” try to interact with the market to increase the number of test cases happening in the environment 4. Analyze the situation in retrospect. Make sure that what happened is correct. Tick checkboxes against tests that were actually executed Updated test library Minirobots
31. 31 1. 3. Simulate real trading participants 2.
32. 32 Have No Fear
33. 33 • Unrealistic Scenarios • Annihilate the System Under Test • Defects Leaking out of a Sprint Have No Fear
35. 35 Makes Your Projects
36. 36 Defects in Production
37. 37 • Confirmation that PROD is Configured as TEST • Tested Drops out of Development • Things that You Do Not Trust NO BEGGING
38. 38 Agile Software Testing
39. 39 https://ru.linkedin.com/in/iosifitkin The seventh EXTENT conference will take place in London, UK. Find out more: www.extentconf.com – LSEG Technology and Quality Assurance – Risk controls and FPGA – MiFID2 Software Testing Challenges – Blockchain and Trading Technology Trends – Learning from Other Industries