Nikita Voinov Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications 14.11.2015 14 November 2015

2 Information and Control System Department of ICST • Software development methods: • Model Driven Development (MDD) • Model Driven Software Development (MDSD) • Model Driven Engineering (MDE) • Software testing methods: • Model Driven Testing (MDT) • Model Based Testing (MBT) Introduction

3 Information and Control System Department of ICST Model Oriented Approach • Benefits: • Reduction of software development cost via automation • Simplification of test development process • Involving of customer into development process • Issues: • A shortage of engineers with MDT expertise • Different levels of abstraction • The problem of test suite explosion • Necessity to customize MDT approaches in projects from different areas of industry

4 Information and Control System Department of ICST Fragment of Telecom Project in UCM Notation

5 Information and Control System Department of ICST Fragment of Multi Concurrent Model in UCM Notation

6 Information and Control System Department of ICST Verification and Testing Within Single Technology • Test Coverage criteria • Functional coverage • Responsibility coverage • Branches coverage • Paths coverage • Verification techniques (performed by VRS toolset) • Model checking • Symbolic verification • Searching of equivalence classes

7 Information and Control System Department of ICST Non Deterministic Behavior: active alternative Direction of the signals in Req1 and Req2: from test to SUT. Two linear tests shall be used.

8 Information and Control System Department of ICST Non Deterministic Behavior: passive alternative Direction of the signals in Req1 and Req2: from SUT to test. Linear tests can not be used, adding of “alt” construction is required.

9 Information and Control System Department of ICST Concurrent Behavior: linear traces Correctness of the test strictly depends on the direction of the signals.

10 Information and Control System Department of ICST Concurrent Behavior: solution Par construction can be automatically added into particular test based on syntax analysis of high level formal model.

11 Information and Control System Department of ICST Concurrent Behavior: example

12 Information and Control System Department of ICST Results Project BP number Non linear BP, % Test scenario number (Linear) Test scenario number (Linear + non linear) Reduce of test suite, % SMTP 30 10 10 8 20 CDMA 205 43 1171 615 48 Satellite terminal 191 15 396 291 27 Examples of not huge projects: average reduction of test suite with usage of suggested approach is near 30%

Thank You

14 Information and Control System Department of ICST Proved Model of System Under Test