The next generation of testing tools for exchanges

The next generation of testing tools for exchanges

5206c19df417b8876825b5561344c1a0?s=128

Exactpro

March 24, 2015
Tweet

Transcript

  1. The Next Generation of Testing Tools for Exchanges Iosif Itkin

    Exactpro Systems 24 March 2015
  2. Test Tools Typology • Connectivity Testing • Test Automation •

    Load Testing 2
  3. Generic Test Tools • No Connectivity Layer • No Session

    Layer • No Framework for Messages 3
  4. Trading Test Tool 4

  5. Test Tools Evolution 5 Passive Testing – investigating the behavior

    of a system without affecting its operations Generic Trading +Passive
  6. Passive Testing 6

  7. Test Tools Evolution 7 Passive Testing – invaluable for Client

    onboarding and certification Generic Trading +Passive
  8. Ideal Passive Testing Tool 8

  9. Production Monitoring System 9

  10. Ideal Active Testing Tool 10

  11. Production Algo Trading Engine 11

  12. Test Tools Evolution 12 Testing at the Confluence of Functional

    and Non-Functional Generic Trading +Passive Production
  13. Test Tools Evolution Generic 13 Trading +Passive Production Mutated and

    Deformed Next Generation
  14. 14 Human Intelligence is Still Required

  15. Build Software to Test Software 15 ClearTH: • Post-Trade testing

    tool • Verifies each stage of the DLC • Integrated schedule • Automated matrices • Can create multiple days test scenarios • Concurrent multiple tests • Integrated simulators • SWIFT ISO protocol support Minirobots: • Executes multithreaded java code • Complexity of test algorithms is defined by the test developer • Supports multiple client fix connections, order entry and market data via FIX • Can use GUI to iterate through sent and received messages Dolphin: • Model-based testing of market surveillance systems • Production-scale capacity and throughput • Interactive real-time alerts and reports Shsha: • Post-transactional tool • Analyzes clients' activity and forecasts system response • Parses and displays logs in a user-friendly way • Parses messages and then puts each to a data base table where each column corresponds to each message field • Allows making summarized reports, etc • Easy to understand GUI Load Injector: • Simulates multiple client connections with a specified load shape for each connection or a group of connections • Up to 75K messages / second from a single CPU core • Measures latencies in microsecond range • Performance test reports Sailfish: • Can test Order Entry, Market Data and Post Trade connections in one test scenario • Each test scenario is independent • Allows running test scripts in any sequence • Simulation of multiple user connections • Server simulators • All messages are stored into a data base • Generates test reports
  16. Thank You 16