Large Scale Infrastructure Intervention and Fake Testing

Slide 1

Slide 1 text

Build Software to Test Software exactpro.com Large Scale Infrastructure Intervention and Fake Testing April 25, 2018 Iosif Itkin, Exactpro

Slide 2

Slide 2 text

Build Software to Test Software exactpro.com Introduction  Iosif Itkin  Started his IT career 20 years ago as a software developer  Moved into performance and load testing in 2006  Co-founded Exactpro on 9th September 2009  Organized TMPA and EXTENT QA conferences  Working on a Build Software to Test Software Initiative  Prior to January 2018 led a management buyout of Exactpro from London Stock Exchange Group

Slide 3

Slide 3 text

Build Software to Test Software exactpro.com Large Scale Infrastructures

Slide 4

Slide 4 text

Build Software to Test Software exactpro.com We have a global software Quality Assurance client network

Slide 5

Slide 5 text

Build Software to Test Software exactpro.com What is Fake Testing? It can happen anywhere around you, so how can we define it?

Slide 6

Slide 6 text

Build Software to Test Software exactpro.com Software Testing That You Dislike FAKE TESTING

Slide 7

Slide 7 text

Build Software to Test Software exactpro.com Software Testing Definition Providing objective, independent information about software quality Process, tools and methods

Slide 8

Slide 8 text

Build Software to Test Software exactpro.com No Testing vs. Fake Testing Right Left

Slide 9

Slide 9 text

Build Software to Test Software exactpro.com Software Testing is Relentless Learning

Slide 10

Slide 10 text

Build Software to Test Software exactpro.com What if you are not interested in getting real feedback?

Slide 11

Slide 11 text

Build Software to Test Software exactpro.com Have you ever seen a film where a software tester saves the world?

Slide 12

Slide 12 text

Build Software to Test Software exactpro.com Fake Testing vs. Real Testing

Slide 13

Slide 13 text

Build Software to Test Software exactpro.com Live Fire Test Burton strove for combat "realism" in tests and was focused on casualty prevention, urging Ballistic Research Laboratory (BRL) to conduct tests where the Bradley would stand, fully loaded and engine running, against overmatches- attacks with U.S. and Russian munitions that would clearly destroy the vehicle. BRL, on the other hand, wanted to test individual Bradley components in measured, incremental units using computerized vulnerability models. Burton also favored random angle ballistics testing, disagreeing with BRL’s method of testing against a computerized system and also with their rationale of conserving ammunition and "preventing extensive duplication" by using "preplanned shots to gather maximum information about selected vulnerabilities”. BradleyFightingVehicle-Scenario.pdf

Slide 14

Slide 14 text

Build Software to Test Software exactpro.com Carefully Selected Ammunition  Romanian rocket launcher with a smaller calibre was used instead of Soviet version  It is forbidden to investigate the target for an hour after the test is completed  Can it be that something is wrong with the test procedure?  Why use a smaller missile when you do your testing?

Slide 15

Slide 15 text

Build Software to Test Software exactpro.com Carefully Selected Ammunition Happens in every test injector products by the systems vendor

Slide 16

Slide 16 text

Build Software to Test Software exactpro.com Preparing All Test Scenarios in Advance

Slide 17

Slide 17 text

Build Software to Test Software exactpro.com What is Testability?

Slide 18

Slide 18 text

Build Software to Test Software exactpro.com Real Testability

Slide 19

Slide 19 text

Build Software to Test Software exactpro.com Testing in Large Infrastructures

Slide 20

Slide 20 text

Build Software to Test Software exactpro.com Fake Testability in a Complex System

Slide 21

Slide 21 text

Build Software to Test Software exactpro.com Testing Conditions

Slide 22

Slide 22 text

Build Software to Test Software exactpro.com What is the fuel of the modern economy?

Slide 23

Slide 23 text

Build Software to Test Software exactpro.com Fake Functional Testing  New release – New Test Plan  Fake Traceability

Slide 24

Slide 24 text

Build Software to Test Software exactpro.com Fake Regression Testing  Parallel Run – Replay Historical Data  Garbage In – Garbage Out  No idea about the actual test coverage  Omission of rare events

Slide 25

Slide 25 text

Build Software to Test Software exactpro.com Test Harness and The Law of Requisite Variety

Slide 26

Slide 26 text

Build Software to Test Software exactpro.com Test Harness Team

Slide 27

Slide 27 text

Build Software to Test Software exactpro.com Test Coverage – Exitus Acta Probat

Slide 28

Slide 28 text

Build Software to Test Software exactpro.com People Acting Irrationally  Xhosa cattle-killing movement  Nongqawuse met three spirits  1854 – 1858  At least 40,000 people starved to death

Slide 29

Slide 29 text

Build Software to Test Software exactpro.com Fake Testing will Turn into Sand

Slide 30

Slide 30 text

Build Software to Test Software exactpro.com Build Software to Test Software

Slide 31

Slide 31 text

Build Software to Test Software exactpro.com Topics to be discussed: Thank You • Post-Trade Complexity and Disruptive Testing • TestOps Environments and Monitoring • Software Testing and Machine Learning • Agile Cargo-Cult and Fake Testing extent.exactpro.com