Slide 1

Slide 1 text

20 April 2019, Tbilisi, Georgia The Principles of Deep Testing Alexey Zverev, CEO and co-founder of Exactpro

Slide 2

Slide 2 text

20 April 2019, Tbilisi, Georgia What is Deep Testing?

Slide 3

Slide 3 text

20 April 2019, Tbilisi, Georgia Features of Complex Systems

Slide 4

Slide 4 text

20 April 2019, Tbilisi, Georgia Commodity Testing Analyze Requirements Automate Test Cases Write Test Cases in QC Execute Test Cases Provide Report to Management TRACEABILITY! PASS/FAIL RATIO

Slide 5

Slide 5 text

20 April 2019, Tbilisi, Georgia Why do we need Deep Testing? https://www.coindesk.com/exactpro-dlt-post-trade-software-testing

Slide 6

Slide 6 text

20 April 2019, Tbilisi, Georgia 1. Exploration and Experimentation 2. Challenging Assumptions 3. Development Mindset 4. Equality of Complexity 5. Avoidance of Simplification 6. Mental Model 7. Instrumentation 8. Preference of Variety 9. Large Number of Tests Expectation 10. Observations Priority 11. Test Data Orientation Principles

Slide 7

Slide 7 text

20 April 2019, Tbilisi, Georgia Exploration and Experimentation

Slide 8

Slide 8 text

20 April 2019, Tbilisi, Georgia Challenging Assumptions

Slide 9

Slide 9 text

20 April 2019, Tbilisi, Georgia Development Mindset

Slide 10

Slide 10 text

20 April 2019, Tbilisi, Georgia System under test Test Library Equality of Complexity

Slide 11

Slide 11 text

20 April 2019, Tbilisi, Georgia Avoidance of Simplification https://www.coindesk.com/exactpro-dlt-post-trade-software-testing

Slide 12

Slide 12 text

20 April 2019, Tbilisi, Georgia Mental Model

Slide 13

Slide 13 text

20 April 2019, Tbilisi, Georgia Complex System – Simple Tools Instrumentation Complex System – Complex Tools

Slide 14

Slide 14 text

20 April 2019, Tbilisi, Georgia Preference of Variety

Slide 15

Slide 15 text

20 April 2019, Tbilisi, Georgia Large Number of Tests Expectation A B ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) A x B

Slide 16

Slide 16 text

20 April 2019, Tbilisi, Georgia Observations Priority

Slide 17

Slide 17 text

20 April 2019, Tbilisi, Georgia Test Data Orientation 12 10 8 6 4 2 0 -2 0 2 4 6 8 10 12

Slide 18

Slide 18 text

20 April 2019, Tbilisi, Georgia Questions?