Regression Testing Techniques for Relational Database Applications

1.

Regression Testing Techniques for Relational Database Applications Gregory M. Kapfhammer†
Department of Computer Science Allegheny College http://www.cs.allegheny.edu/∼gkapfham/ University of Ulm – January 23, 2012 †Joint with Mary Lou Soffa (University of Virginia) and Jonathan Miller Kauffman (Allegheny College)

2.

Introduction Database Applications Regression Testing Conclusion Important Points Presenter Introduction:
Gregory M. Kapfhammer test testing software suites prioritization components coverage empirically regression suite applications evaluating algorithm analysis data effectiveness empirical genetic performance understanding using approach commercialofftheshelf comparison comprehensive constrained creation databasecentric environments execution finding framework identifying interactive java methods multiplots mutation party prioritized reduction relational study third timeaware towards 105 adequacy approaches array automatically building call challenges chapter communication compare compressing computer conditional cost cots covering creating criteria database databaseaware databasedriven databases declarative dependable detection devices distributed distributing duringsearchbased dynamic efficiency efficient engineering environment evaluate examination executing experimental family flow forward frameworks free generation greedy gui hamiltonian handbook heaps implementation improve incorporating increase information initial intranode invariant javaspace javaspacebased kernel knapsack linux measurement memory method monitoring operators paths poster potential preliminary primitives prioritizations prioritizers prioritizing problematic receive remote reports resource resourceconstrained results role runtime science searchbased selection solutions solvers space studies studying supported synthetic techniques transmission transparently trees tuple unstructured wrappers Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

3.

Introduction Database Applications Regression Testing Conclusion Software and Data Challenges
Software and Data are Everywhere Computer Server Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

4.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

5.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

6.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

7.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientiﬁc Device Program Household Appliance Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

8.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientiﬁc Device Program Household Appliance Program Network Router Program Scientiﬁc Device Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

9.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

10.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

11.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Program Program Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

12.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Program Program Program Program Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

13.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Program Program Program Program Program Program Program Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

14.

Software and Data are Everywhere Computer Server Program Computer Server Program Desktop Computer Program Desktop Computer Program Mobile Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Household Appliance Program Network Router Program Scientific Device Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Program Program Program Program Program Program Program Program Computer Server Program Desktop Computer Program Mobile Computer Program Household Appliance Program Scientific Device Program Network Router Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

15.

Software Complexity and Data Enormity Computer Software Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

16.

Software Complexity and Data Enormity Computer Software Lines of Code Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

17.

Software Complexity and Data Enormity Computer Software Lines of Code Numerous Features Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

18.

Software Complexity and Data Enormity Computer Software Lines of Code Numerous Features Feature Interactions Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

19.

Software Complexity and Data Enormity Computer Software Lines of Code Numerous Features Feature Interactions Execution Environments Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

20.

Software Complexity and Data Enormity Computer Software Lines of Code Numerous Features Feature Interactions Execution Environments Software entities are more complex for their size than per- haps any other human construct - Frederick P. Brooks, Jr. Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

21.

Software Complexity and Data Enormity Computer Software Lines of Code Numerous Features Feature Interactions Execution Environments Software entities are more complex for their size than per- haps any other human construct - Frederick P. Brooks, Jr. Prediction: in 2011, 1.8 zettabytes (i.e., 1.8 trillion giga- bytes) of data will be created - IDC Digital Universe Study Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

22.

Software and Data are Evolving Execution Environment Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

23.

Software and Data are Evolving Execution Environment Program Execution Environment Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

24.

Software and Data are Evolving Execution Environment Program Execution Environment Program Program Changed because of the addition of a new feature or the correction of a defect Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

25.

Software and Data are Evolving Execution Environment Program Execution Environment Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

26.

Software and Data are Evolving Execution Environment Program Execution Environment Program Execution Environment Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

27.

Software and Data are Evolving Execution Environment Program Execution Environment Program Execution Environment Program Execution Environment Changed due to modiﬁca- tion of a kernel, device driver, or relational database Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

28.

Introduction Database Applications Regression Testing Conclusion Relational Database Challenges An
Interesting Defect Report Database Server Crashes Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

29.

Interesting Defect Report Database Server Crashes When you run a complex query against Microsoft SQL Server 2000, the SQL Server scheduler may stop respond- ing. Additionally, you receive an error message that resem- bles the following: Date Time server Error: 17883 Sever- ity: 1, State: 0 Date Time server Process 52:0 (94c) ... Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

30.

Interesting Defect Report Input-Dependent Defect Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

31.

Interesting Defect Report Input-Dependent Defect This problem occurs when one or more of the following con- ditions are true: The query contains a UNION clause or a UNIONALL clause that affects many columns. The query contains several JOIN statements. The query has a large estimated cost. BUG 473858 (SQL Server 8.0) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

32.

Introduction Database Applications Regression Testing Conclusion Relational Database Challenges Real-World
Defective Database Application The Risks Digest, Volume 22, Issue 64, 2003 Jeppesen reports airspace boundary problems About 350 airspace boundaries contained in Jeppesen Nav- Data are incorrect, the FAA has warned. The error occurred at Jeppesen after a software upgrade when information was pulled from a database containing 20,000 airspace boundaries worldwide for the March NavData update, which takes effect March 20. Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

33.

Introduction Database Applications Regression Testing Conclusion Relational Database Challenges Real-World
Defective Database Application The Risks Digest, Volume 22, Issue 64, 2003 Jeppesen reports airspace boundary problems About 350 airspace boundaries contained in Jeppesen Nav- Data are incorrect, the FAA has warned. The error occurred at Jeppesen after a software upgrade when information was pulled from a database containing 20,000 airspace boundaries worldwide for the March NavData update, which takes effect March 20. Practically all use of databases occurs from within application programs [Silberschatz et al., 2006, pg. 311] Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

34.

Introduction Database Applications Regression Testing Conclusion Relational Databases Structured Query
Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

35.

Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) A schema is a collection of table deﬁnitions: CREATE TABLE person ( id INT, name VARCHAR(100) NOT NULL, age INT(3), PRIMARY KEY (id) ) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

36.

Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) The data manipulation language supports several operations: SELECT name FROM person WHERE age >= 30 AND age <= 40 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

37.

Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) The data manipulation language supports several operations: UPDATE person SET name = Jan WHERE id = 2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

38.

Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) The data manipulation language supports several operations: INSERT INTO person (id, name, age) VALUES (1, John, 38) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

39.

Language The structured query language (SQL) is an established standard and a query and manipulation language for relational database management systems (RDBMS) The data manipulation language supports several operations: DELETE FROM person WHERE id = 2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

40.

Introduction Database Applications Regression Testing Conclusion Relational Databases Relational Database
Tables id name age 1 Chalker Conrad 12 2 Abby Clulow 14 3 David Rogan 18 4 Stacie Reckling 32 5 Megan Hartnup 29 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

41.


42.


43.


44.


45.


46.

Introduction Database Applications Regression Testing Conclusion Programs and Databases Database
Applications Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

47.

Applications Program Relational Database Management System Database State Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

48.

Applications Program Relational Database Management System Relational Database Management System select Database State query Data Manipulation Language (DML) Statements Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

49.

Applications Program Relational Database Management System Relational Database Management System update Database State modify Data Manipulation Language (DML) Statements Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

50.

Applications Program Relational Database Management System Data Manipulation Language (DML) Statements Relational Database Management System insert Database State modify Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

51.

Applications Program Relational Database Management System Data Manipulation Language (DML) Statements Relational Database Management System delete Database State modify Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

52.

Applications Program Relational Database Management System Relational Database Management System create table Database Structure modify Data Deﬁnition Language (DDL) Statements Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

53.

Applications Program Relational Database Management System Relational Database Management System create table Database Structure modify Data Deﬁnition Language (DDL) Statements Can we categorize the dif- ferent ways of implementing database applications? Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

54.

Introduction Database Applications Regression Testing Conclusion Programs and Databases Categorizing
Database Applications Database Applications Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

55.

Database Applications Database Applications Interaction Approach Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

56.

Database Applications Database Applications Interaction Approach Program Location Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

57.

Database Applications Database Applications Interaction Approach Program Location Interface Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

58.

Database Applications Database Applications Interaction Approach Program Location Interface Embedded Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

59.

Database Applications Database Applications Interaction Approach Program Location Interface Embedded Outside RDBMS Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

60.

Database Applications Database Applications Interaction Approach Program Location Interface Embedded Outside RDBMS Inside RDBMS Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

61.

Database Applications Database Applications Interaction Approach Program Location Interface Embedded Outside RDBMS Inside RDBMS Interface Outside RDBMS Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

62.

Database Applications Database Applications Interaction Approach Program Location Interface Embedded Outside RDBMS Inside RDBMS Interface Outside RDBMS Java application that submits SQL strings to HSQLDB using JDBC Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

63.

Introduction Database Applications Regression Testing Conclusion Programs and Databases Evolution
of Database Applications Program Relational Database Management System Relational Database Management System DML Command Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

64.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

65.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Only the database administrator can add new constraints to the schema! Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

66.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure The programmers encode the constraints in the program’s source code! Constraint Ci Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

67.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure The programmers encode the constraints in the program’s source code! Constraint Ci Constraint Cj Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

68.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure The programmers encode the constraints in the program’s source code! Constraint Ci Constraint Cj Constraint Ck Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

69.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Constraint Ci Constraint Cj Constraint Ck Programmers make other changes to the source code of the program Program Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

70.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Constraint Ci Constraint Cj Constraint Ck External programs can change the state of the relational database Database State Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

71.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Constraint Ci Constraint Cj Constraint Ck Database administrator can change the structure of the database Database Structure Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

72.

of Database Applications Program Relational Database Management System Relational Database Management System DML Command Database State Database Structure Constraint Ci Constraint Cj Constraint Ck How can we test a rapidly changing database application? Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

73.

Introduction Database Applications Regression Testing Conclusion Important Techniques Regression Testing
to the Rescue Database Applications Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

74.

to the Rescue Database Applications Pervasive Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

75.

to the Rescue Database Applications Pervasive Complex Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

76.

to the Rescue Database Applications Pervasive Complex Evolving Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

77.

to the Rescue Database Applications Pervasive Complex Evolving Regression Testing supports the efﬁcient construction of database software that is complex and rapidly evolving Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

78.

Introduction Database Applications Regression Testing Conclusion Important Techniques What is
a Test Case? Method Under Test Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

79.

a Test Case? Method Under Test Input Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

80.

a Test Case? Method Under Test Input Output Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

81.

a Test Case? Method Under Test Test Set Up Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

82.

a Test Case? Method Under Test Test Set Up Input Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

83.

a Test Case? Method Under Test Test Set Up Input Output Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

84.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

85.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

86.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

87.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Test Verdict Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

88.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Test Verdict Expected Output Output Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

89.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Test Verdict Expected Output Output Test Verdict The test case passes and the code is correct! Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

90.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Test Verdict Expected Output Output Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

91.

a Test Case? Method Under Test Test Set Up Input Output Test Clean Up Test Oracle Expected Output Test Verdict Expected Output Output Test Verdict The test case fails and a defect is found! Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

92.

a Test Suite? T1 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

93.

a Test Suite? T1 T2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

94.

a Test Suite? T1 T2 T3 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

95.

a Test Suite? T1 T2 T3 T4 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

96.

a Test Suite? T1 T2 T3 T4 . . . Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

97.

a Test Suite? T1 T2 T3 T4 . . . Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

98.

a Test Suite? T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

99.

a Test Suite? T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Tool Support for Software Testing? Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

100.

a Test Suite? T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Tool Support for Software Testing? JUnit Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

101.

a Test Suite? T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Tool Support for Software Testing? JUnit Apache Ant Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

102.

a Test Suite? T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Tool Support for Software Testing? JUnit Apache Ant DBUnit Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

103.

Introduction Database Applications Regression Testing Conclusion Important Techniques Test Suite
Management T1 T2 T3 T4 . . . Tn Organize the Test Cases into a Test Suite Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

104.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

105.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique What if Some Test Cases are More Effective? T3 Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

106.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique What if Some Test Cases are More Effective? T3 Tn Prioritization T3 Tn T1 T4 . . . T2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

107.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique What if Some Test Cases are More Effective? T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

108.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn What if Some Test Cases are Redundant? T1 T2 T3 T4 . . . Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

109.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn What if Some Test Cases are Redundant? T1 T2 T3 T4 . . . Tn Reduction T4 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

110.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn What if Some Test Cases are Redundant? T1 T2 T3 T4 . . . Tn Reduction T4 T1 T2 T3 T4 . . . Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

111.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn T1 T2 T3 T4 . . . Tn Reduction T4 T1 T2 T3 T4 . . . Tn What if Only Certain Tests are Needed? T2 Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

112.

Management T1 T2 T3 T4 . . . Tn Regression Testing Technique T3 Tn Prioritization T3 Tn T1 T4 . . . T2 T1 T2 T3 T4 . . . Tn T1 T2 T3 T4 . . . Tn Reduction T4 T1 T2 T3 T4 . . . Tn What if Only Certain Tests are Needed? T2 Tn Selection T1 T2 T3 T4 . . . Tn Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

113.

Introduction Database Applications Regression Testing Conclusion Important Techniques Model of
Regression Testing Start Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

114.

Regression Testing Start Coverage Report Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

115.

Regression Testing Start Coverage Report Selection Reduction Prioritization Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

116.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

117.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

118.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

119.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

120.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Test Results Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

121.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Test Results End Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

122.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Test Results End Use the Coverage Report During the Next Round of Regression Testing Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

123.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Test Results End Use the Same Test Suite for the Next Round of Regression Testing Standard Repeat Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

124.

Regression Testing Start Coverage Report Selection Reduction Prioritization Original Test Suite Modiﬁed Test Suite Test Suite Execution Test Coverage Monitoring Program Adequacy Criterion Test Results End Standard Repeat Make a New Test Suite for the Next Round of Regression Testing Version Speciﬁc Repeat Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

125.

Adequacy T1 T2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

126.

Adequacy T1 T2 T3 T4 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

127.

Adequacy T1 T2 T3 T4 T5 T6 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

128.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

129.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

130.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

131.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

132.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

133.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

134.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

135.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

136.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

137.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

138.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

139.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 R12 R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

140.

Adequacy T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

141.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

142.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

143.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

144.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 Run Test Case Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

145.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 Passing Test Case: OA = OE Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

146.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

147.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

148.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 Run Test Case Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

149.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

150.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Stop Running T Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

151.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Stop Running T T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

152.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Stop Running T T8 T9 T10 T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

153.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Stop Running T T8 T9 T10 T8 T9 T10 Continue Running T Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

154.

Execution T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks T1 T1 T2 T3 T4 T5 T6 T7 T7 Failing Test Case: OA = OE Stop Running T T8 T9 T10 T8 T9 T10 Continue Running T T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

155.

Introduction Database Applications Regression Testing Conclusion Important Techniques Test Coverage
Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

156.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

157.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks Database-Aware Test Coverage Monitor Proteja Test Suite Manager Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

158.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 JUnit and DBUnit Test Automation Frameworks Database-Aware Test Coverage Monitor Proteja Test Suite Manager T1 Run Test Case Collect Per-Test Case Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

159.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

160.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

161.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

162.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Statement Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

163.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Database Interaction Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

164.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Database Table Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

165.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Database Record Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

166.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Database Attribute Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

167.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Requirements Set R for ... Database Attribute-Value Coverage Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

168.

Monitoring T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 See [Kapfhammer and Soffa, ISEC 2008] for more details Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

169.

Introduction Database Applications Regression Testing Conclusion Important Techniques Greedy Algorithms
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

170.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

171.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

172.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

173.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 R12 R12 R12 R12 R12 R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

174.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

175.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 ratio(T1) = cost(T1) coverage(T1) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

176.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 ratio(T1) = 5 3 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

177.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} R12 ratio(T1) = 1.66 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

178.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

179.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

180.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 R12 ratio(T5) = cost(T5) coverage(T5) Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

181.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 R12 ratio(T5) = 8 3 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

182.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 R12 ratio(T5) = 2.66 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

183.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 2.66 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

184.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 2.66 ratio(T1) < ratio(T5) Prefer T1 over T5 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

185.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 Test Suite T = T1, T2, . . . , T9, T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} 1.66 2.66 Proceed incrementally, picking the test case with the lowest ratio value for the uncovered requirements Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

186.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} T8 T4 T9 T1 T10 T3 T7 T2 T6 T5 Test Suite T = T8, T4, T9, T1, T10, T3, T7, T2, T6, T5 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

187.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} T8 T4 T9 T1 T10 T3 T7 T2 T6 T5 R12 1 2 3 5 2 4 4 6 10 8 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

188.


189.


190.


191.


192.


193.


194.


195.


196.


197.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} T8 T4 T9 T1 T10 T3 T7 T2 T6 T5 T2 T6 T5 Test Suite T = T8, T4, T9, T1, T10, T3, T7 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

198.

T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 R1 R2 R3 R4 R5 R6 R7 R8 R9 R10 R11 R12 Requirements Set R = {R1, R2, . . . , R11, R12} T8 T4 T9 T1 T10 T3 T7 T2 T6 T5 T2 T6 T5 Test Suite T = T8, T4, T9, T1, T10, T3, T7 R12 R12 R12 R12 R12 R12 R12 Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

199.

Introduction Database Applications Regression Testing Conclusion Empirical Results Empirical Results
– Test Suite Reduction Program Rel. Attr. Rec. Attr. Val. All RM (13) (7, .46) (7, .46) (10, .30) (9, .31) (8.25, .37) FF (16) (7, .56) (7, .56) (11, .31) (11, .31) (9, .44) PI (15) (6, .60) (6, .60) (8, .70) (7, .53) (6.75, .55) ST (25) (5, .80) (5, .76) (11, .56) (10, .60) (7.75, .690) TM (27) (14, .48) (14, .48) (15, .45) (14, .48) (14.25, .47) GB (51) (33, .35) (33, .35) (33, .35) (32, .37) (32.75, .36) All (24.5) (12, .51) (12.17, .50) (14.67, .40) (13.83, .44) • Reduction values range from .30 to .80 • Reduction level varies depending on interaction granularity • How will the reduction of a test suite impact defect detection? Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

200.

Introduction Database Applications Regression Testing Conclusion Empirical Results Empirical Results
– Test Suite Reduction Program Rel. Attr. Rec. Attr. Val. All RM (13) (7, .46) (7, .46) (10, .30) (9, .31) (8.25, .37) FF (16) (7, .56) (7, .56) (11, .31) (11, .31) (9, .44) PI (15) (6, .60) (6, .60) (8, .70) (7, .53) (6.75, .55) ST (25) (5, .80) (5, .76) (11, .56) (10, .60) (7.75, .690) TM (27) (14, .48) (14, .48) (15, .45) (14, .48) (14.25, .47) GB (51) (33, .35) (33, .35) (33, .35) (32, .37) (32.75, .36) All (24.5) (12, .51) (12.17, .50) (14.67, .40) (13.83, .44) • Reduction values range from .30 to .80 • Reduction level varies depending on interaction granularity • How will the reduction of a test suite impact defect detection? Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

201.

Introduction Database Applications Regression Testing Conclusion Final Remarks Conclusion Conclusion
• Databases are widely used in real-world applications • Database applications have complex state and structure • Source code, database state, and relational schema evolve • Prioritization techniques can increase effectiveness • Reduction methods can improve the efﬁciency of testing Future Work • New empirical studies of database-aware regression testing • Implement and release free and open source testing tools Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

202.

Introduction Database Applications Regression Testing Conclusion Final Remarks Conclusion Conclusion
• Databases are widely used in real-world applications • Database applications have complex state and structure • Source code, database state, and relational schema evolve • Prioritization techniques can increase effectiveness • Reduction methods can improve the efﬁciency of testing Future Work • New empirical studies of database-aware regression testing • Implement and release free and open source testing tools Kapfhammer Allegheny College Regression Testing Techniques for Relational Database Applications

203.

Regression Testing Techniques for Relational Database Applications Gregory M. Kapfhammer
Department of Computer Science Allegheny College http://www.cs.allegheny.edu/∼gkapfham/ Thank you for your attention! I welcome your questions and comments.

Regression Testing Techniques for Relational Database Applications

Regression Testing Techniques for Relational Database Applications

Want more?

Transcript