Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Principles of Deep Testing

The Principles of Deep Testing

Exactpro
PRO

April 20, 2019
Tweet

More Decks by Exactpro

Other Decks in Technology

Transcript

  1. 20 April 2019, Tbilisi, Georgia
    The Principles of Deep Testing
    Alexey Zverev, CEO and co-founder of Exactpro

    View Slide

  2. 20 April 2019, Tbilisi, Georgia
    What is Deep Testing?

    View Slide

  3. 20 April 2019, Tbilisi, Georgia
    Features of Complex Systems

    View Slide

  4. 20 April 2019, Tbilisi, Georgia
    Commodity Testing
    Analyze
    Requirements
    Automate Test
    Cases
    Write Test
    Cases in QC
    Execute Test
    Cases
    Provide Report to
    Management
    TRACEABILITY!
    PASS/FAIL
    RATIO

    View Slide

  5. 20 April 2019, Tbilisi, Georgia
    Why do we need Deep Testing?
    https://www.coindesk.com/exactpro-dlt-post-trade-software-testing

    View Slide

  6. 20 April 2019, Tbilisi, Georgia
    1. Exploration and Experimentation
    2. Challenging Assumptions
    3. Development Mindset
    4. Equality of Complexity
    5. Avoidance of Simplification
    6. Mental Model
    7. Instrumentation
    8. Preference of Variety
    9. Large Number of Tests Expectation
    10. Observations Priority
    11. Test Data Orientation
    Principles

    View Slide

  7. 20 April 2019, Tbilisi, Georgia
    Exploration and Experimentation

    View Slide

  8. 20 April 2019, Tbilisi, Georgia
    Challenging Assumptions

    View Slide

  9. 20 April 2019, Tbilisi, Georgia
    Development Mindset

    View Slide

  10. 20 April 2019, Tbilisi, Georgia
    System
    under
    test
    Test
    Library
    Equality of Complexity

    View Slide

  11. 20 April 2019, Tbilisi, Georgia
    Avoidance of Simplification
    https://www.coindesk.com/exactpro-dlt-post-trade-software-testing

    View Slide

  12. 20 April 2019, Tbilisi, Georgia
    Mental Model

    View Slide

  13. 20 April 2019, Tbilisi, Georgia
    Complex System – Simple Tools
    Instrumentation
    Complex System – Complex Tools

    View Slide

  14. 20 April 2019, Tbilisi, Georgia
    Preference of Variety

    View Slide

  15. 20 April 2019, Tbilisi, Georgia
    Large Number of Tests Expectation
    A B
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    A x B

    View Slide

  16. 20 April 2019, Tbilisi, Georgia
    Observations Priority

    View Slide

  17. 20 April 2019, Tbilisi, Georgia
    Test Data Orientation
    12
    10
    8
    6
    4
    2
    0
    -2 0 2 4 6 8 10 12

    View Slide

  18. 20 April 2019, Tbilisi, Georgia
    Questions?

    View Slide