Software testing. Sailfish

MOST Working Group, FIX Trading Community
22 October 2020

To learn more about Exactpro, visit our website https://exactpro.com/
EXTENT Conference website: https://extent.exactpro.com/
Follow us on
LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/

Subscribe to Exactpro YouTube channel https://www.youtube.com/c/exactprosystems

Transcript

1. 1 Build Software to Test Software
   exactpro.com
   Software testing
   Sailfish
   Exactpro
   MOST Working Group, FIX Trading Community
   22 October 2020
   

   View Slide

2. 2 Build Software to Test Software
   exactpro.com
   A specialist firm focused on functional
   and non-functional testing of
   exchanges, clearing houses,
   depositories, trade repositories and
   other financial market infrastructures.
   Exactpro Overview
   Headquartered in the UK with
   operations in the US and Eastern
   Europe. The clients are regulated by
   the FCA, Bank of England and their
   counterparts from other countries.
   Exactpro provides software testing services for mission critical technology that underpins global financial
   markets. The firm is experienced with trading and clearing and settlement platforms, market data systems,
   collateral management and risk management systems, central data warehouses, regulatory reporting, etc.
   Incorporated in 2009 with 10 people,
   Exactpro is now employing over 600
   specialists.
   Part of the London Stock Exchange
   Group (LSEG) from May 2015 until
   January 2018, when the Exactpro
   management proceeded through the
   buyout of the company from LSEG.
   

   View Slide

3. 3 Build Software to Test Software
   exactpro.com
   

   View Slide

4. 4 Build Software to Test Software
   exactpro.com
   Linear test automation of the functional flows is usually a step-by-step scenario execution and validation. It can be easily
   automated through the available API interfaces.
   Sailfish is an active real-time tool used for exchange, MTF and broker systems testing. It can also be used as an exchange
   simulator for testing post-trade systems or smart derivatives. Sailfish is a web-based application which supports simultaneous
   connections of multiple users for both incoming and outgoing streams. It is written in Java.
   Sailfish test tool is used for test script development and automation:
   - Tests Order Entry, Market Data and Post-Trade connections in one test scenario
   - Executes test scripts in any order
   - Simulates multiple user connections
   - Simulates servers
   - Stores all messages in a database
   - Generates test reports
   Sailfish can be customized to support various other protocols on a par with FIX, e.g. OUCH, ITCH, Omnet, WebSocket.
   Linear test automation
   

   View Slide

5. 5 Build Software to Test Software
   exactpro.com
   Sailfish GUI (Environment tab)
   Sailfish
   

   View Slide

6. 6 Build Software to Test Software
   exactpro.com
   Sailfish GUI (Dictionaries tab)
   Sailfish
   

   View Slide

7. 7 Build Software to Test Software
   exactpro.com
   Sailfish (YAML script example)
   Sailfish
   

   View Slide

8. 8 Build Software to Test Software
   exactpro.com
   Sailfish (csv-format script example)
   Sailfish
   

   View Slide

9. 9 Build Software to Test Software
   exactpro.com
   Sailfish GUI (Test scripts tab)
   Sailfish
   

   View Slide

10. 10 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Run - Report - Passed)
    Sailfish
    

    View Slide

11. 11 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Run - Report - Failed)
    Sailfish
    

    View Slide

12. 12 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Messages tab)
    Sailfish
    

    View Slide

13. 13 Build Software to Test Software
    exactpro.com
    Sailfish (Test Execution Procedure)
    Sailfish
    The steps to run the scripts in Sailfish:
    - Upload the Services to the ‘Environment’ tab
    - Upload the Scripts (.yaml, .csv) to the ‘Test Scripts’ tab
    - Select the scripts required to be executed (if all scripts are to be executed, select main ‘Name’ checkbox) on the ‘Test Scripts’ tab
    - Select the options in the bottom left corner, like ‘Auto Start’ for services and ‘Continue if Failed’
    - Select the environment services to define the environment to run the test (e.g. ‘appl02’ on Slide 7 )
    - Press the ‘Run All’ or the ‘Run Selected’ button
    - Wait till the tests are executed
    - Check the results via the ‘Report’ link for a specific script
    - The results can be downloaded via the ‘Get Zip’ link
    

    View Slide

14. 14 Build Software to Test Software
    exactpro.com
    Web
    Binary
    FIX
    Market Data
    Database
    Sailfish Exactpro has donated Sailfish to Open source:
    Watch on Exactpro's YouTube channel
    

    View Slide

15. 15 Build Software to Test Software
    exactpro.com
    A Lot of E2E test Scenarios
    Participant
    Structure
    Asset
    Classes
    Matching
    Engine
    Rules
    System
    Components
    distribution
    OrderTypes/
    TIFs
    Markets/
    Trading
    Sessions
    ...
    Multiply your tests against possible permutations
    in your system
    Sailfish / Big Button
    Sailfish /
    BIG BUTTON
    

    View Slide

16. 16 Build Software to Test Software
    exactpro.com
    Combine tests into a "Big Button" run
    Sailfish / Big Button
    Sailfish /
    BIG BUTTON
    

    View Slide

17. 17 Build Software to Test Software
    exactpro.com
    Sailfish Big Button
    Sailfish /
    BIG BUTTON
    

    View Slide

18. Business
    Analysis
    Process
    Mining
    Chaos
    Engineering
    Models
    Monitoring and
    Observation
    Capacity
    detection
    Testing
    @ confluence
    FT/NFT
    Fuzzing
    Negative
    Testing
    Exploratory
    Testing
    Linear Test
    Automation
    Automated
    generation of test
    scenarios
    Rules-based
    checking
    Model based
    checking
    Load Injection
    Automated
    Management of
    Test environment
    Business Analysts
    Systems Analysts
    Software Developers in Test
    Discovery Mass Processing Repetition
    Ideas
    Tools
    People
    DevOps / TestOps
    Load Injector / Woodpecker Sailfish / ClearTH
    Sailjector / Minirobots
    Shsha
    Whaleshark NFTest Manager
    Cradle
    Book Checker / Enum Checker / Process Miner
    th2
    BIG BUTTON
    Test Data Collection
    Machine Learning
    Continuity
    Simulation of
    multiple endpoints
    

    View Slide

19. 19 Build Software to Test Software
    exactpro.com
    To find out more about test tools:
    https://exactpro.com/test-tools/sailfish
    or contact us:
    info@exactpro.com +44 (0) 20 3319 1644 +1 (646) 340 3000
    Automation Technology Project of
    the Year: Exactpro and R3
    The QA Financial Software and
    App Awards 2020
    Thank you!
    

    View Slide

20. 20 Build Software to Test Software
    exactpro.com
    https://www.youtube.com/c/exactprosystems
    

    View Slide