MODEL DRIVEN TESTING FOR A LARGE END TO END TESTING PROGRAM Vikas Verma, Head - E2E Testing, TechMahindra 

 Dynamic Market with major innovations over the past 20 years (Broadband, Mobile phone, TV, Smartphones, etc)  Strong historical market positions (from the time when they had monopolistic position)  High maturity in the management of their vendors E2E Testing of a Tier1 UK-Based Telecom Operator 

TechM Global Test Factory  Factory portal, Tools - RAPID, eConvergence  Workbook hierarchy  Clear escalation paths  Organisation stakeholder mapping  Real time reporting structure Customer Engagement  ADAPTIVE  INTELLIGENT  HIGH PERFORMANCE  LEAN TOOLS  SHARED SERVICES  ENGAGE RIGHT TALENT  STANDARDIZATION  KNOWLEDGE MANAGEMENT  BUSINESS ASSURANCE  STEP CHANGE IN COST  NEW REVENUE STREAMS  OPERATING MODEL IMPROVEMENT  E2E Test  User Acceptance Test  Operational Readiness Test  Security Testing  Non Functional Testing  Network Testing  Stub Development  System / Continuous Integration Testing  Customer Experience Factory Offerings Factory Principles 

Life Cycle Automation Through Innovation 

Why Model Based Testing ? Objectives & Benefits Triggers for MBT MBT Lack of defect detection in Early cycle Manual & Automation scripting in Silo Ever increasing Business Demands High Quality at Optimised cost High maintenance efforts Low Reusability Consistency 

What is MBT and How it Works ?  Model-based testing is a test DESIGN solution  It combines a method (based on modeling) and a tool (automatic test case generation)  Formalization and graphical representation of the requirements and expected behavior  Automatic test case generation with the MBT tool  Automatic publication of the tests into the test repository (ex: QC) • Ready-to-execute manual test cases • Frame work for automation • Requirement traceability matrix  When requirements change, model is to be updated; then, impacts are computed and propagated automatically 

Selection of MBT solution • Smartesting • Conformiq Evaluated solutions • Workshops • Proof of Concepts • Observed Benefits • Integration with existing environment (QC, SCM tools, QTP, Greybox ) Evaluation process • More adapted to End-to-End testing through the use of business-oriented modeling language (BPMN) • Test Optimization Techniques • Easy-to-adopt / easy-to-use / easy-to-integrate • Customizable publication output • Flexible licensing model Choice of Tool (Smartesting) 

Implementation of MBT using Smartesting  Smartesting tool uses BPMN and UML modeling • BPMN is Business Process Model Notation which provides the E2E flow for a particular process • Behavior of the system , test data , pre requisites and post condition would be modeled using UML (Unified Modeling Language) • Business rules are modeled using decision tables (or a simple programing language called OCL)  Core team is responsible for developing the models required across all the products / teams 

•Import & formalize business process models •Models verification and simulation •Models creation wizard •Test strategy definition - risks, requirements , coverage, pairwise Smart Asset™ •Coverage report with RBT user defined views •Systematic Requirement-to-tests traceability •Automated Impact analysis for any change requirements •Coverage+Tests Documentation creation for BAs Smart Coverage™ •Test cases & test scripts automated generation •Optimized number of tests for targeted objectives •Test generation dashboard with user defined views •Automated synchronization of tests and requirements in ALM solutions for maintenance Smart Engine™ Key takeaways of the Smartesting MBT solution 

CFT – HL scenario CIT Model from E2E Flow Final E2E LLTC Business Demand Requirement E2E Design E2E model Component Model Component Design Continuous Integration Test Cases IVVT test cases Repository MBT as a Collaborative Tool 

 Frist time efforts spent on the developing the models is high in MBT  Due to reusability of basic models , approximately 40% less efforts compared to manual test planning  Approximately 18 – 20 % effort saved in E2E Test Life Cycle Manual Vs MBT 

Learning's Leaders to be Change Agent Detailed & defined implementation strategy Implementation in the area of high reusability Defined & Consistent Modeling Frame work Formation of Core team (SME’s) for Implementation and Trainings Build library of reusable Models CM of models 

Thank You