Large Scale Infrastructure Intervention and Fake Testing

The QA Financial Forum: Chicago 2018

Iosif Itkin, co-Founder, co-CEO, Exactpro

Transcript

1. Build Software to Test Software exactpro.com Large Scale Infrastructure Intervention and Fake Testing April 25, 2018 Iosif Itkin, Exactpro
2. Build Software to Test Software exactpro.com Introduction  Iosif Itkin  Started his IT career 20 years ago as a software developer  Moved into performance and load testing in 2006  Co-founded Exactpro on 9th September 2009  Organized TMPA and EXTENT QA conferences  Working on a Build Software to Test Software Initiative  Prior to January 2018 led a management buyout of Exactpro from London Stock Exchange Group
3. Build Software to Test Software exactpro.com Large Scale Infrastructures
4. Build Software to Test Software exactpro.com We have a global software Quality Assurance client network
5. Build Software to Test Software exactpro.com What is Fake Testing? It can happen anywhere around you, so how can we define it?
6. Build Software to Test Software exactpro.com Software Testing That You Dislike FAKE TESTING
7. Build Software to Test Software exactpro.com Software Testing Definition Providing objective, independent information about software quality Process, tools and methods
8. Build Software to Test Software exactpro.com No Testing vs. Fake Testing Right Left
9. Build Software to Test Software exactpro.com Software Testing is Relentless Learning
10. Build Software to Test Software exactpro.com What if you are not interested in getting real feedback?
11. Build Software to Test Software exactpro.com Have you ever seen a film where a software tester saves the world?
12. Build Software to Test Software exactpro.com Fake Testing vs. Real Testing
13. Build Software to Test Software exactpro.com Live Fire Test Burton strove for combat "realism" in tests and was focused on casualty prevention, urging Ballistic Research Laboratory (BRL) to conduct tests where the Bradley would stand, fully loaded and engine running, against overmatches- attacks with U.S. and Russian munitions that would clearly destroy the vehicle. BRL, on the other hand, wanted to test individual Bradley components in measured, incremental units using computerized vulnerability models. Burton also favored random angle ballistics testing, disagreeing with BRL’s method of testing against a computerized system and also with their rationale of conserving ammunition and "preventing extensive duplication" by using "preplanned shots to gather maximum information about selected vulnerabilities”. BradleyFightingVehicle-Scenario.pdf
14. Build Software to Test Software exactpro.com Carefully Selected Ammunition  Romanian rocket launcher with a smaller calibre was used instead of Soviet version  It is forbidden to investigate the target for an hour after the test is completed  Can it be that something is wrong with the test procedure?  Why use a smaller missile when you do your testing?
15. Build Software to Test Software exactpro.com Carefully Selected Ammunition Happens in every test injector products by the systems vendor
16. Build Software to Test Software exactpro.com Preparing All Test Scenarios in Advance
17. Build Software to Test Software exactpro.com What is Testability?
18. Build Software to Test Software exactpro.com Real Testability
19. Build Software to Test Software exactpro.com Testing in Large Infrastructures
20. Build Software to Test Software exactpro.com Fake Testability in a Complex System
21. Build Software to Test Software exactpro.com Testing Conditions
22. Build Software to Test Software exactpro.com What is the fuel of the modern economy?
23. Build Software to Test Software exactpro.com Fake Functional Testing  New release – New Test Plan  Fake Traceability
24. Build Software to Test Software exactpro.com Fake Regression Testing  Parallel Run – Replay Historical Data  Garbage In – Garbage Out  No idea about the actual test coverage  Omission of rare events
25. Build Software to Test Software exactpro.com Test Harness and The Law of Requisite Variety
26. Build Software to Test Software exactpro.com Test Harness Team
27. Build Software to Test Software exactpro.com Test Coverage – Exitus Acta Probat
28. Build Software to Test Software exactpro.com People Acting Irrationally  Xhosa cattle-killing movement  Nongqawuse met three spirits  1854 – 1858  At least 40,000 people starved to death
29. Build Software to Test Software exactpro.com Fake Testing will Turn into Sand
30. Build Software to Test Software exactpro.com Build Software to Test Software
31. Build Software to Test Software exactpro.com Topics to be discussed: Thank You • Post-Trade Complexity and Disruptive Testing • TestOps Environments and Monitoring • Software Testing and Machine Learning • Agile Cargo-Cult and Fake Testing extent.exactpro.com