20 April 2019, Tbilisi, Georgia
The Principles of Deep Testing
Alexey Zverev, CEO and co-founder of Exactpro
Slide 2
Slide 2 text
20 April 2019, Tbilisi, Georgia
What is Deep Testing?
Slide 3
Slide 3 text
20 April 2019, Tbilisi, Georgia
Features of Complex Systems
Slide 4
Slide 4 text
20 April 2019, Tbilisi, Georgia
Commodity Testing
Analyze
Requirements
Automate Test
Cases
Write Test
Cases in QC
Execute Test
Cases
Provide Report to
Management
TRACEABILITY!
PASS/FAIL
RATIO
Slide 5
Slide 5 text
20 April 2019, Tbilisi, Georgia
Why do we need Deep Testing?
https://www.coindesk.com/exactpro-dlt-post-trade-software-testing
Slide 6
Slide 6 text
20 April 2019, Tbilisi, Georgia
1. Exploration and Experimentation
2. Challenging Assumptions
3. Development Mindset
4. Equality of Complexity
5. Avoidance of Simplification
6. Mental Model
7. Instrumentation
8. Preference of Variety
9. Large Number of Tests Expectation
10. Observations Priority
11. Test Data Orientation
Principles
Slide 7
Slide 7 text
20 April 2019, Tbilisi, Georgia
Exploration and Experimentation
Slide 8
Slide 8 text
20 April 2019, Tbilisi, Georgia
Challenging Assumptions
Slide 9
Slide 9 text
20 April 2019, Tbilisi, Georgia
Development Mindset
Slide 10
Slide 10 text
20 April 2019, Tbilisi, Georgia
System
under
test
Test
Library
Equality of Complexity
Slide 11
Slide 11 text
20 April 2019, Tbilisi, Georgia
Avoidance of Simplification
https://www.coindesk.com/exactpro-dlt-post-trade-software-testing
Slide 12
Slide 12 text
20 April 2019, Tbilisi, Georgia
Mental Model
Slide 13
Slide 13 text
20 April 2019, Tbilisi, Georgia
Complex System – Simple Tools
Instrumentation
Complex System – Complex Tools
Slide 14
Slide 14 text
20 April 2019, Tbilisi, Georgia
Preference of Variety
Slide 15
Slide 15 text
20 April 2019, Tbilisi, Georgia
Large Number of Tests Expectation
A B
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
( , )
A x B
Slide 16
Slide 16 text
20 April 2019, Tbilisi, Georgia
Observations Priority
Slide 17
Slide 17 text
20 April 2019, Tbilisi, Georgia
Test Data Orientation
12
10
8
6
4
2
0
-2 0 2 4 6 8 10 12