Slide 1

Slide 1 text

Pairwise Framework in ERP Application ~ ShriRam Paidi & Kanaka Durga Bandaru

Slide 2

Slide 2 text

Agenda • What is Pairwise Testing? • What is ERP? • Pairwise Implementation in ERP • Pairwise Implementation in ERP • Value and Benefit

Slide 3

Slide 3 text

Observation in ERP Application It is an observation in ERP Application that most faults are caused by interactions of two parameters caused by interactions of two parameters

Slide 4

Slide 4 text

Root Cause Analysis for Customer Bugs One Parameter Two Parameters Three Parameters Other

Slide 5

Slide 5 text

Pairwise Testing Pairwise Testing

Slide 6

Slide 6 text

Pairwise Testing Pairwise testing is an effective test case generation technique that ensures that every parameter pair is tested at least once ensures that every parameter pair is tested at least once

Slide 7

Slide 7 text

Example 1 2 3 4 Person Type (A) Employee (a1) Contingent Worker (a2) Termination (B) Retirement (b1) Voluntary (b2) Force (b3) Deceased (b4) Benefits (C) PF (c1) Gratuity (c2) Pension (c3) (2) (4) (3) Number of Parameter Values Exhaustive Pair Combinations 2 * 4 * 3 = 24 Optimum Pair Combinations = max(X) * max [X \ max(X)] i.e. Optimum Pair Combinations = max(X) * next max (X) i.e. Optimum Pair Combinations = 4 * 3 = 12 Note: X is a set which contains number of parameter values, i.e. X = {2, 4, 3}

Slide 8

Slide 8 text

Create Exhaustive Pair Combinations 2 * 4 * 3 = 24 Create Empty Set for Optimum Pair Combinations 4 * 3 = 12 Create Empty Set for Optimum Pair Combinations 4 * 3 = 12

Slide 9

Slide 9 text

Start Moving AB unused Pair Combination to Empty Set

Slide 10

Slide 10 text

Move all AB unused Pair Combination to Empty Set

Slide 11

Slide 11 text

Start Moving BC unused Pair Combination to Empty Set

Slide 12

Slide 12 text

Move all BC unused Pair Combination to Empty Set

Slide 13

Slide 13 text

Move all AC unused Pair Combination to Empty Set

Slide 14

Slide 14 text

Optimum Pair Combinations

Slide 15

Slide 15 text

Another Example 1 2 3 Person Type Employee (a1) Contingent Worker (a2) Applicant (a3) Gender Male (b1) Female (b2) Unknown (b3) Job Trainee (c1) Engineer (c2) Manager (c3) (3) (3) (3) Number of Parameter Values Exhaustive Pair Combinations 3 * 3 * 3 = 27 Exhaustive Pair Combinations 3 * 3 * 3 = 27 Optimum Number of Test Cases = max(X) * next max (X) i.e. Optimal Pair Combinations 3 * 3 = 9 Note: X is a set which contains number of parameters, i.e. X = {3, 3, 3}

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

ERP System

Slide 18

Slide 18 text

No content

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

Pairwise in ERP Application

Slide 23

Slide 23 text

Unit Level System Level Integration Level

Slide 24

Slide 24 text

No content

Slide 25

Slide 25 text

Learning Management a ERP Application Learning Management is the product in ERP Application which automates Employee Trainings. Employee Employee Employee Employee Enrolls in a Training Employee Completes the Training Employee Skills are updated

Slide 26

Slide 26 text

Unit Level

Slide 27

Slide 27 text

Unit Level

Slide 28

Slide 28 text

Create a Training Course

Slide 29

Slide 29 text

Identify Field Level Data Create a New Training Course Parameter Data Values Course Offering Online, In a Class, Web Conference, Self Study (4) Course Type Normal Content, Assessment, Both (3) Learner Access Self, Approval, Mandatory (3) Enrollment Limit Limited, Unlimited (2) Waitlist Allowed, Not Allowed (2) Cost Free Course, Priced Course (2) Total Combinations (4 * 3 * 3 * 2 * 2 * 2 = 288)

Slide 30

Slide 30 text

Input Data to Pairwise Algorithm Enter Parameter and Parameter Values Note: We have written a Macro which Generates Test Cases using Pairwise Algorithm

Slide 31

Slide 31 text

Result – Unit Level - Using Pairwise

Slide 32

Slide 32 text

System Level

Slide 33

Slide 33 text

System Level

Slide 34

Slide 34 text

Identify System Level Transactions Parameter Data Values Feed Unit Level Test Cases 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14 (14) Learner (Person) Applicant, Employee, Ex-Employee, Contingent Worker, Ex-Contingent Person Enrolls in a Training Course Learner (Person) Applicant, Employee, Ex-Employee, Contingent Worker, Ex-Contingent Worker (5) Enrollment Self, Manager, Mandatory, Admin Single, Admin Bulk, Approval (6) Enrollment Availability Available, Not Available, Waitlisted (3) Total Combinations (14 * 5 * 6 * 3 = 1260)

Slide 35

Slide 35 text

Result – System Level - Using Pairwise

Slide 36

Slide 36 text

Integration Level

Slide 37

Slide 37 text

Result – Unit Level - Using Pairwise

Slide 38

Slide 38 text

Identify Integration Points Parameter Data Values Employee Completes the Training and Skill are updated in Person Competency Integration Points – Learning Management Interface with Performance & Approvals Parameter Data Values Feed System Test Cases SLTC1, SLTC2, ……., SLTC84 (84) Assessment Score Card Passed in Course, Failed in Course, Not Applicable (3) Person Competency Attach, Do Not Attach (2) Approval Manager Approval, Auto Approve (2) Total Combinations (84 * 3 * 2 * 2 = 1008)

Slide 39

Slide 39 text

Result – Integration Level - Using Pairwise

Slide 40

Slide 40 text

Summary – without Pairwise Total Unit Level Combinations (3 * 4 * 3 * 2 * 2 * 2 = 288) Total System Level Combinations ( 288 * 5 * 6 * 3 = 25,920) Total System Level Combinations ( 288 * 5 * 6 * 3 = 25,920) Total Integration Level Combinations ( 25,920 * 4 * 2 = 2,07,360 )

Slide 41

Slide 41 text

Summary – with Pairwise Total Unit Level Combinations (3 * 4 * 3 * 2 * 2 * 2 = 288) Optimized Unit Level Combinations using Pairwise: 14 Total System Level Combinations (14 * 5 * 6 * 3 = 1260) Optimized System Level Combinations using Pairwise: 84 Total Integration Level Combinations (84 * 3 * 2 * 2 = 1008) Optimized Integration Combinations using Pairwise: 252

Slide 42

Slide 42 text

Summary Ensures that every parameter pair has been Tested at least once Optimizes Test Effort within the Project Time Constraints

Slide 43

Slide 43 text

Trend of Customer Bugs Reported 150 200 250 2009 0 50 100 150 C1 C2 C3 2009 2010 2011

Slide 44

Slide 44 text

Test Environment Configuration

Slide 45

Slide 45 text

Configurations for a ERP Application Browser - IE 8, 9, Firefox 3.5, 10, Safari 4, 5 (6) Client OS – Windows 7, XP, Vista, MAC, iOS (5) Server OS – Windows, Linux (2) Data Base - 10g, 11g (2) Receiving Pages from Difference Servers – Apache, IIS (2) Total Combinations (6 * 5 * 2 * 2 * 2 = 240)

Slide 46

Slide 46 text

Configurations for a ERP Application Creating Configuration is expensive Consumes lot of Time and Effort

Slide 47

Slide 47 text

Value and Benefits

Slide 48

Slide 48 text

Value and Benefits Optimal number of Test Cases for Maximum Test Yield Saves QA Effort in Documentation and Execution Cost to Quality in ERP Comes Down Cost to Quality in ERP Comes Down

Slide 49

Slide 49 text

Thank You