TMPA-2015: Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications

Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications

Pavel Drobintsev, Vsevolod Kotlyarov, Nikita Voinov, Peter The Great Saint Petersburg Polytechnic University, Saint Petersburg

Transcript

1. Nikita Voinov Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications 14.11.2015 14 November 2015
2. 2 Information and Control System Department of ICST • Software development methods: • Model Driven Development (MDD) • Model Driven Software Development (MDSD) • Model Driven Engineering (MDE) • Software testing methods: • Model Driven Testing (MDT) • Model Based Testing (MBT) Introduction
3. 3 Information and Control System Department of ICST Model Oriented Approach • Benefits: • Reduction of software development cost via automation • Simplification of test development process • Involving of customer into development process • Issues: • A shortage of engineers with MDT expertise • Different levels of abstraction • The problem of test suite explosion • Necessity to customize MDT approaches in projects from different areas of industry
4. 4 Information and Control System Department of ICST Fragment of Telecom Project in UCM Notation
5. 5 Information and Control System Department of ICST Fragment of Multi Concurrent Model in UCM Notation
6. 6 Information and Control System Department of ICST Verification and Testing Within Single Technology • Test Coverage criteria • Functional coverage • Responsibility coverage • Branches coverage • Paths coverage • Verification techniques (performed by VRS toolset) • Model checking • Symbolic verification • Searching of equivalence classes
7. 7 Information and Control System Department of ICST Non Deterministic Behavior: active alternative Direction of the signals in Req1 and Req2: from test to SUT. Two linear tests shall be used.
8. 8 Information and Control System Department of ICST Non Deterministic Behavior: passive alternative Direction of the signals in Req1 and Req2: from SUT to test. Linear tests can not be used, adding of “alt” construction is required.
9. 9 Information and Control System Department of ICST Concurrent Behavior: linear traces Correctness of the test strictly depends on the direction of the signals.
10. 10 Information and Control System Department of ICST Concurrent Behavior: solution Par construction can be automatically added into particular test based on syntax analysis of high level formal model.
11. 11 Information and Control System Department of ICST Concurrent Behavior: example
12. 12 Information and Control System Department of ICST Results Project BP number Non linear BP, % Test scenario number (Linear) Test scenario number (Linear + non linear) Reduce of test suite, % SMTP 30 10 10 8 20 CDMA 205 43 1171 615 48 Satellite terminal 191 15 396 291 27 Examples of not huge projects: average reduction of test suite with usage of suggested approach is near 30%
13. Thank You
14. 14 Information and Control System Department of ICST Proved Model of System Under Test