$30 off During Our Annual Pro Sale. View Details »

Software testing. Sailfish

Software testing. Sailfish

MOST Working Group, FIX Trading Community
22 October 2020

To learn more about Exactpro, visit our website https://exactpro.com/
EXTENT Conference website: https://extent.exactpro.com/
Follow us on
LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/

Subscribe to Exactpro YouTube channel https://www.youtube.com/c/exactprosystems

Exactpro
PRO

October 22, 2020
Tweet

More Decks by Exactpro

Other Decks in Technology

Transcript

  1. 1 Build Software to Test Software
    exactpro.com
    Software testing
    Sailfish
    Exactpro
    MOST Working Group, FIX Trading Community
    22 October 2020

    View Slide

  2. 2 Build Software to Test Software
    exactpro.com
    A specialist firm focused on functional
    and non-functional testing of
    exchanges, clearing houses,
    depositories, trade repositories and
    other financial market infrastructures.
    Exactpro Overview
    Headquartered in the UK with
    operations in the US and Eastern
    Europe. The clients are regulated by
    the FCA, Bank of England and their
    counterparts from other countries.
    Exactpro provides software testing services for mission critical technology that underpins global financial
    markets. The firm is experienced with trading and clearing and settlement platforms, market data systems,
    collateral management and risk management systems, central data warehouses, regulatory reporting, etc.
    Incorporated in 2009 with 10 people,
    Exactpro is now employing over 600
    specialists.
    Part of the London Stock Exchange
    Group (LSEG) from May 2015 until
    January 2018, when the Exactpro
    management proceeded through the
    buyout of the company from LSEG.

    View Slide

  3. 3 Build Software to Test Software
    exactpro.com

    View Slide

  4. 4 Build Software to Test Software
    exactpro.com
    Linear test automation of the functional flows is usually a step-by-step scenario execution and validation. It can be easily
    automated through the available API interfaces.
    Sailfish is an active real-time tool used for exchange, MTF and broker systems testing. It can also be used as an exchange
    simulator for testing post-trade systems or smart derivatives. Sailfish is a web-based application which supports simultaneous
    connections of multiple users for both incoming and outgoing streams. It is written in Java.
    Sailfish test tool is used for test script development and automation:
    - Tests Order Entry, Market Data and Post-Trade connections in one test scenario
    - Executes test scripts in any order
    - Simulates multiple user connections
    - Simulates servers
    - Stores all messages in a database
    - Generates test reports
    Sailfish can be customized to support various other protocols on a par with FIX, e.g. OUCH, ITCH, Omnet, WebSocket.
    Linear test automation

    View Slide

  5. 5 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Environment tab)
    Sailfish

    View Slide

  6. 6 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Dictionaries tab)
    Sailfish

    View Slide

  7. 7 Build Software to Test Software
    exactpro.com
    Sailfish (YAML script example)
    Sailfish

    View Slide

  8. 8 Build Software to Test Software
    exactpro.com
    Sailfish (csv-format script example)
    Sailfish

    View Slide

  9. 9 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Test scripts tab)
    Sailfish

    View Slide

  10. 10 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Run - Report - Passed)
    Sailfish

    View Slide

  11. 11 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Run - Report - Failed)
    Sailfish

    View Slide

  12. 12 Build Software to Test Software
    exactpro.com
    Sailfish GUI (Messages tab)
    Sailfish

    View Slide

  13. 13 Build Software to Test Software
    exactpro.com
    Sailfish (Test Execution Procedure)
    Sailfish
    The steps to run the scripts in Sailfish:
    - Upload the Services to the ‘Environment’ tab
    - Upload the Scripts (.yaml, .csv) to the ‘Test Scripts’ tab
    - Select the scripts required to be executed (if all scripts are to be executed, select main ‘Name’ checkbox) on the ‘Test Scripts’ tab
    - Select the options in the bottom left corner, like ‘Auto Start’ for services and ‘Continue if Failed’
    - Select the environment services to define the environment to run the test (e.g. ‘appl02’ on Slide 7 )
    - Press the ‘Run All’ or the ‘Run Selected’ button
    - Wait till the tests are executed
    - Check the results via the ‘Report’ link for a specific script
    - The results can be downloaded via the ‘Get Zip’ link

    View Slide

  14. 14 Build Software to Test Software
    exactpro.com
    Web
    Binary
    FIX
    Market Data
    Database
    Sailfish Exactpro has donated Sailfish to Open source:
    Watch on Exactpro's YouTube channel

    View Slide

  15. 15 Build Software to Test Software
    exactpro.com
    A Lot of E2E test Scenarios
    Participant
    Structure
    Asset
    Classes
    Matching
    Engine
    Rules
    System
    Components
    distribution
    OrderTypes/
    TIFs
    Markets/
    Trading
    Sessions
    ...
    Multiply your tests against possible permutations
    in your system
    Sailfish / Big Button
    Sailfish /
    BIG BUTTON

    View Slide

  16. 16 Build Software to Test Software
    exactpro.com
    Combine tests into a "Big Button" run
    Sailfish / Big Button
    Sailfish /
    BIG BUTTON

    View Slide

  17. 17 Build Software to Test Software
    exactpro.com
    Sailfish Big Button
    Sailfish /
    BIG BUTTON

    View Slide

  18. Business
    Analysis
    Process
    Mining
    Chaos
    Engineering
    Models
    Monitoring and
    Observation
    Capacity
    detection
    Testing
    @ confluence
    FT/NFT
    Fuzzing
    Negative
    Testing
    Exploratory
    Testing
    Linear Test
    Automation
    Automated
    generation of test
    scenarios
    Rules-based
    checking
    Model based
    checking
    Load Injection
    Automated
    Management of
    Test environment
    Business Analysts
    Systems Analysts
    Software Developers in Test
    Discovery Mass Processing Repetition
    Ideas
    Tools
    People
    DevOps / TestOps
    Load Injector / Woodpecker Sailfish / ClearTH
    Sailjector / Minirobots
    Shsha
    Whaleshark NFTest Manager
    Cradle
    Book Checker / Enum Checker / Process Miner
    th2
    BIG BUTTON
    Test Data Collection
    Machine Learning
    Continuity
    Simulation of
    multiple endpoints

    View Slide

  19. 19 Build Software to Test Software
    exactpro.com
    To find out more about test tools:
    https://exactpro.com/test-tools/sailfish
    or contact us:
    [email protected] +44 (0) 20 3319 1644 +1 (646) 340 3000
    Automation Technology Project of
    the Year: Exactpro and R3
    The QA Financial Software and
    App Awards 2020
    Thank you!

    View Slide

  20. 20 Build Software to Test Software
    exactpro.com
    https://www.youtube.com/c/exactprosystems

    View Slide