Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Exactpro Software Testing for R3 Blockchain

Exactpro Software Testing for R3 Blockchain

Exactpro Software Testing for R3 Blockchain

Iosif Itkin
co-CEO & co-founder, Exactpro

QA Financial Forum
12 March 2020, London

Video: https://youtu.be/Qn1Lf-z-Z0M

To learn more about Exactpro, visit our website https://exactpro.com/

Follow us on
LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/

Subscribe to Exactpro Vimeo channel https://vimeo.com/exactpro
Subscribe to Exactpro YouTube channel https://www.youtube.com/c/exactprosystems

Exactpro

March 12, 2020
Tweet

More Decks by Exactpro

Other Decks in Technology

Transcript

  1. Build Software to Test Software
    exactpro.com
    Software testing for R3
    Corda Blockchain
    Iosif Itkin, CEO and co-founder,
    Exactpro

    View full-size slide

  2. 2 Build Software to Test Software exactpro.com
    A specialist firm focused on functional
    and non-functional testing of exchanges,
    clearing houses, depositories, trade
    repositories and other financial market
    infrastructures.
    About Exactpro
    Headquartered in the UK with
    operations in the US and Eastern
    Europe. The clients are regulated by
    the FCA, Bank of England and their
    counterparts from other countries.
    Exactpro provides software testing services for mission critical technology that underpins global financial
    markets. The firm is experienced with trading and clearing and settlement platforms, market data systems,
    collateral management and risk management systems, central data warehouses, regulatory reporting, etc.
    Incorporated in 2009 with 10 people,
    Exactpro is now employing over 580
    specialists.
    Part of the London Stock Exchange
    Group (LSEG) from May 2015 until
    January 2018, when the Exactpro
    management proceeded through the
    buyout of the company from LSEG.

    View full-size slide

  3. 3 Build Software to Test Software exactpro.com
    Exactpro Client Network

    View full-size slide

  4. 4 Build Software to Test Software exactpro.com
    Exactpro Partners
    Exactpro partners with numerous global organisations on multiple projects worldwide
    Exactpro has initiated and is now co-chairing the FIX MOST Working Group (Monitoring, Onboarding and Software Testing).
    The group’s goal is to define testing standards and best practices.

    View full-size slide

  5. 5 Build Software to Test Software exactpro.com
    5 Build Software to Test Software exactpro.com
    New FIX Working Group

    View full-size slide

  6. 6 Build Software to Test Software exactpro.com
    6 Build Software to Test Software exactpro.com

    View full-size slide

  7. 7 Build Software to Test Software exactpro.com
    7 Build Software to Test Software exactpro.com
    • Platforms
    • People
    • Processes
    • Security

    View full-size slide

  8. 8 Build Software to Test Software exactpro.com
    Is Blockchain Financial Plumbing Still Years Away?
    https://www.coindesk.com/exactpro-dlt-post-trade-software-testing
    25 March 2019

    View full-size slide

  9. 9 Build Software to Test Software exactpro.com
    Journalism vs. Activism /
    Software Testing vs. Proof of Concept

    View full-size slide

  10. 10 Build Software to Test Software exactpro.com
    No Testing for Conversational Assistants
    Chatbot

    View full-size slide

  11. 11 Build Software to Test Software exactpro.com
    Public Relations Disaster vs. Research Breakthrough

    View full-size slide

  12. 12 Build Software to Test Software exactpro.com
    Meena is Unavailable to Talk
    Quote:
    “Also, tackling safety and bias in
    the models is a key focus area for
    us, and given the challenges
    related to this, we are not
    currently releasing an external
    research demo”

    View full-size slide

  13. 13 Build Software to Test Software exactpro.com
    Meet Corda Enterprise

    View full-size slide

  14. 14 Build Software to Test Software exactpro.com
    This is what I think
    I am owed
    This is what is
    owed
    Duplication of data
    High fragmentation
    Expensive reconciliations
    Today
    Financial Services

    View full-size slide

  15. 15 Build Software to Test Software exactpro.com
    Reconciliations were Related to Major Outages

    View full-size slide

  16. 16 Build Software to Test Software exactpro.com
    Reduced data costs
    Reduced operational risk
    No inter-entity
    reconciliations
    Tomorrow
    This is what I think I
    am owed
    Financial Services

    View full-size slide

  17. 17 Build Software to Test Software exactpro.com
    Traditional blockchains
    This is what we
    owe each other
    This is what A
    owes B!
    This is what A
    owes B!
    No Privacy

    View full-size slide

  18. 18 Build Software to Test Software exactpro.com
    This is what we
    owe each other
    Channels
    This is what we
    owe each other
    Segregation

    View full-size slide

  19. 19 Build Software to Test Software exactpro.com
    The Corda approach
    I know facts
    1, 2 and 4
    I know facts
    1, 3 and 5
    I know facts
    2, 3 and 5
    I know facts
    2, 4 and 5
    I know facts
    3, 4 and 5
    Enterprise Grade Blockchain

    View full-size slide

  20. 20 Build Software to Test Software exactpro.com
    Our Greatest Weaknesses are Extensions of Our Strengths

    View full-size slide

  21. 21 Build Software to Test Software exactpro.com
    Typical Requirements for an Exchange System
    Daily capacity - 100+ mln transactions
    Peak rates - 40k+ transactions per second
    Average round-trip latency - <100 microseconds
    Availability - 100%
    3000 trx 2.5 cm <1 mm

    View full-size slide

  22. 22 Build Software to Test Software exactpro.com
    https://www.youtube.com/c/exactprosystems

    View full-size slide

  23. 23

    23

    Testing in the fast chain
    Dr. Moray Grieve, Head of QA

    View full-size slide

  24. Enterprise grade blockchain platform enabling
    distrusting parties to form and maintain consensus
    about the existence, status and evolution of a set of
    shared facts.
    24

    View full-size slide

  25. Key Concepts
    States
    States are immutable objects that
    represent shared facts such as a
    financial agreement or contract at a
    specific point in time
    Transactions
    Transactions consume input states and
    create output states. Newly created
    output states replace the input states
    which are marked as historic
    Contracts
    Contracts control the evolution of
    states by allowing relevant
    participants to check for transaction
    validity
    Flows
    Flows are light-weight processes used
    to coordinate interactions required for
    peers to create and agree transactions

    View full-size slide

  26. What it is What it does
    Trust
    Root
    The single, long-term cryptographic
    key which all network‘s identity
    (X509) certificates root back to
    It provides the basis of trust in the
    provenance of data, recognised by
    participants
    Identity
    Manager
    Admits new members onto the
    network via granting an identity
    certificate
    Performs 3 checks on new
    certificate requests and grants
    based on passing the checks
    Network
    Map
    A list of IP addresses and legal entity
    names of each participant on the
    network, which all participants can
    access
    Acts as a Corda Network ‘phone
    directory’
    Notary Node or cluster of notary nodes Prevents double-spend of input
    states
    nodes
    notary
    A Corda Network
    The Network
    Permissioned network with public identities allowing nodes to communicate
    directly with each other

    View full-size slide

  27. Testing challenges
    • Platform technology (build CorDapps to test the full API)
    • Highly distributed (complexity in test automation)
    • Heterogeneous networks (combinatorial explosion)
    • Highly secure (cryptography, ledger consistency is everything)
    • Eventually consistent (transaction flows can be complex)
    • Evolutionary lifecycle (platform and CorDapp upgrades)
    • Highly available (resiliency testing)
    • Temporal (performance testing)

    View full-size slide

  28. Testing challenges
    • Platform technology (build CorDapps to test the full API)
    • Highly distributed (complexity in test automation)
    • Heterogeneous networks (combinatorial explosion)
    • Highly secure (cryptography, ledger consistency is everything)
    • Eventually consistent (transaction flows can be complex)
    • Evolutionary lifecycle (platform and CorDapp upgrades)
    • Highly available (resiliency testing)
    • Temporal (performance testing)

    View full-size slide

  29. 29 Build Software to Test Software exactpro.com
    Testing the Core Network
    System
    under
    test
    Test
    Library

    View full-size slide

  30. 30 Build Software to Test Software exactpro.com
    Testing Distributed Applications
    System
    under
    test
    Test
    Library

    View full-size slide

  31. 31 Build Software to Test Software exactpro.com
    31 Build Software to Test Software exactpro.com
    Multi-Threaded Distributed Applications

    View full-size slide

  32. 32 Build Software to Test Software exactpro.com
    EXACTPRO
    AI and Software Testing
    There are three chapters with examinable content. The top-level heading for each
    chapter specifies the time for the chapter; timing is not provided below chapter level.
    For the A4Q AI and Software Testing Foundation training course, the syllabus
    requires a minimum of 17 hours, 10 minutes of instruction, distributed across the
    three chapters as follows:
    Chapter 1: AI and Software Testing Background 360 minutes
    Chapter 2: Testing Artificial Intelligence Systems 400 minutes
    Chapter 3: Using AI to Support Testing 270 minutes
    https://www.gasq.org/en/exam-modules/a4q-ai-and-software-testing.html

    View full-size slide

  33. 33 Build Software to Test Software exactpro.com
    EXACTPRO
    AI Testing Software Challenges
    Non-Deterministic Probabilistic Non-Testable Oracle Problem

    View full-size slide

  34. 34 Build Software to Test Software exactpro.com
    Non-deterministic Systems: Financial Market Infrastructures

    View full-size slide

  35. 35 Build Software to Test Software exactpro.com
    EXACTPRO
    Indirect Testing Methods
    Information
    extraction and
    Machine learning
    End-to-End
    Automated Test
    Library
    Whatever it
    takes!
    Test execution
    data and log
    analysis
    Passive Testing

    View full-size slide

  36. 36 Build Software to Test Software exactpro.com
    EXACTPRO
    Ability to Generalize:
    Scope of End-to-End and Negative Testing

    View full-size slide

  37. 37 Build Software to Test Software exactpro.com
    PEAS Model

    View full-size slide

  38. 38 Build Software to Test Software exactpro.com
    AGENT
    Actuators
    Sensors
    Performance
    Environment
    PEAS Model

    View full-size slide

  39. 39 Build Software to Test Software exactpro.com
    Actuators

    View full-size slide

  40. 40 Build Software to Test Software exactpro.com
    AGENT
    Sensors
    Environment
    Sensors

    View full-size slide

  41. 41 Build Software to Test Software exactpro.com
    Lively Debate

    View full-size slide

  42. 42 Build Software to Test Software exactpro.com
    AGENT
    Actuators
    Sensors
    Performance
    Environment
    PEAS Model

    View full-size slide

  43. 43 Build Software to Test Software exactpro.com
    Software Testers

    View full-size slide

  44. 44 Build Software to Test Software exactpro.com
    Data Lake

    View full-size slide

  45. 45 Build Software to Test Software exactpro.com
    1
    Larva
    2
    Pupa
    3
    Adult
    Approach: Metamorphic Testing
    sin(x) = sin(x + 2)
    sin(x) = sin( - x)

    View full-size slide

  46. 46 Build Software to Test Software exactpro.com
    https://www.youtube.com/c/exactprosystems

    View full-size slide

  47. 47 Build Software to Test Software exactpro.com
    Thank you

    View full-size slide