Complex Post-Trade Systems: Requirements Traceability and the Illusion of Control

EXTENT TALKS: Tbilisi
20.04.2019

Luba Konnova, QA Project Manager, Exactpro
Artem Berko, QA Analyst, Exactpro

Website https://extent.exactpro.com/

Linkedin https://www.linkedin.com/company/exactpro-systems-llc
Instagram https://www.instagram.com/qatbilisi/
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/qatbilisi/
Youtube Channel https://www.youtube.com/c/exactprosystems

Transcript

1. 20 April 2019, Tbilisi, Georgia
   Complex Post-Trade Systems: Requirements
   Traceability and the Illusion of Control
   Luba Konnova, QA Project Manager, Exactpro
   Artem Berko, QA Analyst, Exactpro
   

   View Slide

2. 20 April 2019, Tbilisi, Georgia 2
   Click to watch
   

   View Slide

3. 20 April 2019, Tbilisi, Georgia
   Software Testing of Trading Systems
   Trading systems have very
   low-latency (within hundreds
   of microseconds) ,...
   ...have significant
   throughput &
   capacity,....
   …and they should be resilient,
   have the ability to recover from
   outages and have no single
   point of failure
   3
   

   View Slide

4. 20 April 2019, Tbilisi, Georgia
   Trading vs. Post-Trade
   4
   

   View Slide

5. 20 April 2019, Tbilisi, Georgia
   Key Technical Challenges in Delivering Large
   Post-Trade Initiatives
   Challenges:
   A typical clearing system has
   highly complex features requiring
   high degree of accuracy and
   skilled resources:
   1. Reference data;
   2. Risk management;
   3. The schedule (explained
   further in the presentation).
   5
   

   View Slide

6. 20 April 2019, Tbilisi, Georgia
   Key Technical Challenges in Delivering Large
   Post-Trade Initiatives (continued)
   ● The number of components of complex post trade
   infrastructures is very high;
   ● Upstream and downstream systems dependency;
   ● The participant structure is very complex;
   ● Trade/Xfer/Position/Account life cycle;
   ● The number of Asset Classes may vary;
   ● The complexity of the Risk calculation process;
   ● Access via a set of API endpoints.
   The challenges and their parameterizations lead to a significant
   number of test scenarios.
   6
   

   View Slide

7. 20 April 2019, Tbilisi, Georgia
   Complex Post-Trade System During Replacement Process
   7
   

   View Slide

8. 20 April 2019, Tbilisi, Georgia
   Congruence bias
   Confirmation
   bias
   Law of triviality
   Zero-risk bias
   Anthropocentric
   thinking
   Illusion of control
   Cognitive Biases Affecting Software Testing
   8
   

   View Slide

9. 20 April 2019, Tbilisi, Georgia
   Salman, I. (2016). Cognitive biases in software quality and testing.
   Proceedings of the 38th International Conference on Software
   Engineering Companion - ICSE ’16. Pp. 823-826.
   9
   

   View Slide

10. 20 April 2019, Tbilisi, Georgia
    Mohanani, R., Salman, I., Turhan, B., Rodríguez, P., & Ralph, P. (2018).
    Cognitive Biases in Software Engineering: A Systematic Mapping Study.
    IEEE Transactions on Software Engineering
    10
    

    View Slide

11. 20 April 2019, Tbilisi, Georgia
    Congruence Bias
    Direct
    Testing
    Indirect
    Testing
    Indirect
    Testing
    11
    

    View Slide

12. 20 April 2019, Tbilisi, Georgia
    Indirect Testing Methods
    Information
    extraction and
    Machine learning
    End-to-End
    Automated Test
    Library
    Whatever it
    takes!
    Test execution
    data and log
    analysis
    Passive Testing
    Whatever it
    takes!
    12
    

    View Slide

13. 20 April 2019, Tbilisi, Georgia
    Anthropocentric bias
    We should not
    humanize computers.
    13
    

    View Slide

14. 20 April 2019, Tbilisi, Georgia
    Anthropocentric bias
    They dislike it a lot!
    14
    

    View Slide

15. 20 April 2019, Tbilisi, Georgia
    Anthropocentric Bias: Testing Mine-Defusing Robot
    15
    

    View Slide

16. 20 April 2019, Tbilisi, Georgia
    Anthropocentric Bias: Why We Treat Robots like Humans
    Darling, Kate and Nandy, Palash and Breazeal,
    Cynthia “Empathic Concern and the Effect of
    Stories in Human-Robot Interaction” (2015).
    Proceedings of the IEEE International Workshop
    on Robot and Human Communication (ROMAN),
    2015. 6 p.
    https://www.ted.com/talks/kate_darling_why_we_h
    ave_an_emotional_connection_to_robots
    16
    

    View Slide

17. 20 April 2019, Tbilisi, Georgia
    Anthropocentric Bias and Software Testing
    17
    

    View Slide

18. 20 April 2019, Tbilisi, Georgia
    Ruthless and Cold-Hearted
    18
    

    View Slide

19. 20 April 2019, Tbilisi, Georgia
    ClearTH - An Innovative Way to Test Post-Trade Systems
    19
    

    View Slide

20. 20 April 2019, Tbilisi, Georgia
    Law of Triviality (Bike-Shed Effect)
    20
    

    View Slide

21. 20 April 2019, Tbilisi, Georgia
    What is the Difference Between a Problem and a Catastrophe
    21
    

    View Slide

22. 20 April 2019, Tbilisi, Georgia
    Zero-Risk Bias
    22
    

    View Slide

23. 20 April 2019, Tbilisi, Georgia
    Test Management Systems and Requirements Traceability
    23
    

    View Slide

24. 20 April 2019, Tbilisi, Georgia
    Illusion of Control and Happiness
    Sherman, G. D., Lee, J. J., Cuddy, A. J. C., Renshon, J., Oveis, C., Gross, J. J., &
    Lerner, J. S. (2012). Leadership is associated with lower levels of stress.
    Proceedings of the National Academy of Sciences, 109(44), 17903–17907.
    24
    

    View Slide

25. 20 April 2019, Tbilisi, Georgia
    Fenton-O’Creevy, M., Nicholson, N., Soane,
    E., & Willman, P. (2003). “Trading on
    illusions: Unrealistic perceptions of control
    and trading performance”. Journal of
    Occupational and Organizational
    Psychology, 76(1), 53–68.
    Illusion of Control and Performance
    25
    

    View Slide

26. 20 April 2019, Tbilisi, Georgia
    Software testing is relentless
    learning, continuous improvement
    and keeping abreast of
    cutting-edge technologies.
    The research and development
    team at Exactpro uses machine
    learning methods of intellectual
    data analysis to create next-
    generation program analysis
    tools.
    We work in an agile environment
    collaborating with a multinational
    team of software developers.
    R&D Case Study: Test Database for Machine Learning
    26
    

    View Slide

27. 20 April 2019, Tbilisi, Georgia
    EXTENT - Software Testing and Trading Technology Trends
    September 17, 2019
    Leadenhall Building, London
    Join us in discussing the newest fintech trends and
    solutions to the challenges in mission-critical trading
    and post trade systems!
    27
    

    View Slide

28. 20 April 2019, Tbilisi, Georgia
    EXTENT - Software Testing and Trading Technology Trends
    September 17
    Leadenhall Building,
    London, 2019
    Join us in discussing the newest fintech trends
    and solutions to the challenges in
    mission-critical trading and post trade systems!
    28
    

    View Slide

29. 20 April 2019, Tbilisi, Georgia
    Thank you! Questions?
    29
    

    View Slide