The Principles of Deep Testing

EXTENT TALKS: Tbilisi
20.04.2019

Alexey Zverev, CEO and co-founder of Exactpro

Website https://extent.exactpro.com/

Linkedin https://www.linkedin.com/company/exactpro-systems-llc
Instagram https://www.instagram.com/qatbilisi/
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/qatbilisi/
Youtube Channel https://www.youtube.com/c/exactprosystems

Transcript

1. 20 April 2019, Tbilisi, Georgia
   The Principles of Deep Testing
   Alexey Zverev, CEO and co-founder of Exactpro
   

   View Slide

2. 20 April 2019, Tbilisi, Georgia
   What is Deep Testing?
   

   View Slide

3. 20 April 2019, Tbilisi, Georgia
   Features of Complex Systems
   

   View Slide

4. 20 April 2019, Tbilisi, Georgia
   Commodity Testing
   Analyze
   Requirements
   Automate Test
   Cases
   Write Test
   Cases in QC
   Execute Test
   Cases
   Provide Report to
   Management
   TRACEABILITY!
   PASS/FAIL
   RATIO
   

   View Slide

5. 20 April 2019, Tbilisi, Georgia
   Why do we need Deep Testing?
   https://www.coindesk.com/exactpro-dlt-post-trade-software-testing
   

   View Slide

6. 20 April 2019, Tbilisi, Georgia
   1. Exploration and Experimentation
   2. Challenging Assumptions
   3. Development Mindset
   4. Equality of Complexity
   5. Avoidance of Simplification
   6. Mental Model
   7. Instrumentation
   8. Preference of Variety
   9. Large Number of Tests Expectation
   10. Observations Priority
   11. Test Data Orientation
   Principles
   

   View Slide

7. 20 April 2019, Tbilisi, Georgia
   Exploration and Experimentation
   

   View Slide

8. 20 April 2019, Tbilisi, Georgia
   Challenging Assumptions
   

   View Slide

9. 20 April 2019, Tbilisi, Georgia
   Development Mindset
   

   View Slide

10. 20 April 2019, Tbilisi, Georgia
    System
    under
    test
    Test
    Library
    Equality of Complexity
    

    View Slide

11. 20 April 2019, Tbilisi, Georgia
    Avoidance of Simplification
    https://www.coindesk.com/exactpro-dlt-post-trade-software-testing
    

    View Slide

12. 20 April 2019, Tbilisi, Georgia
    Mental Model
    

    View Slide

13. 20 April 2019, Tbilisi, Georgia
    Complex System – Simple Tools
    Instrumentation
    Complex System – Complex Tools
    

    View Slide

14. 20 April 2019, Tbilisi, Georgia
    Preference of Variety
    

    View Slide

15. 20 April 2019, Tbilisi, Georgia
    Large Number of Tests Expectation
    A B
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    ( , )
    A x B
    

    View Slide

16. 20 April 2019, Tbilisi, Georgia
    Observations Priority
    

    View Slide

17. 20 April 2019, Tbilisi, Georgia
    Test Data Orientation
    12
    10
    8
    6
    4
    2
    0
    -2 0 2 4 6 8 10 12
    

    View Slide

18. 20 April 2019, Tbilisi, Georgia
    Questions?
    

    View Slide