Test Scourge of Testing: Test Data Management

Test data management is often a forgotten need. That is until the consequences are of mismanaging or failure to manage come home to roost. In today’s world, IT organizations produce and rely on huge volumes of data. As systems become more complex, so do the test cases needed to validate them as well as the test data needed to execute the test cases. We will discuss the test data management lifecycle and real world examples of test data management gone awry in order to better understand the importance of good test data management practices. It is important to note, that this session is NOT about test case management or about data element profiling or identification techniques. It is about data in terms of data sets and what is needed to support a testing effort.

Transcript

1. www.cohesion.com | 877.774.3001 Test Data Management The Scourge of Testing
2. www.cohesion.com | 877.774.3001 Introducing Joseph Ours About Joseph • Owns development and delivery of Cohesion's Quality Assurance and Testing Services • More than 15 years of IT experience spanning several industries and roles • Notable success managing multi- million dollar initiatives while introducing innovative solutions for Fortune 1000 companies, resulting in improved quality, increased client satisfaction, cost avoidance, on-time delivery, and establishing a true team culture Contacting Me @justjoehere jours@cohesion.com 614.423.5253 www.linkedin.com/in/josephours
3. www.cohesion.com | 877.774.3001 What is this about Purpose of TDM TDM Lifecycle Key TDM Lifecycle Aspects Key TDM Support Roles
4. www.cohesion.com | 877.774.3001 • Company #1 • 42 Systems needed for E2E testing • Systems couldn’t talk because data didn’t match • Project teams added 15% more testing time for test data collection/creation • 10% of tests could not be executed due to bad data • All defects had to be investigated as bad data first • Old data triggered many invalid defects • Some production defects existed because of unique data in production that wasn’t in a test environment • Company #2 • Agile teams (6) • Used automation, ran tests every day/evening • Created business transactions as a part of testing • Transactions had a default renewal date • Actual renewal date hit, test environment came down as it tried to process all the renewals Quick Examples
5. www.cohesion.com | 877.774.3001 You manage test data or test data manages you Test data can impede the overall speed of testing • Performance testing • Security testing Test data affects the ability to conduct types of testing such as: Why Manage Test Data?
6. www.cohesion.com | 877.774.3001 Challenges Associated with Test Data? Labor Skipped tests Availability Security/PII Storage space Freshness of data
7. www.cohesion.com | 877.774.3001 Have you ever tried to test… • Big Data • Data Warehouses • Predictive Analytics
8. www.cohesion.com | 877.774.3001 Reduce ambiguity in data sourcing and control Establish roles and responsibilities around test data Ensure right size test databases that accurately reflect into in business processes Support comprehensive nonfunctional testing to obtain in user confidence in production performance and scalability Allow for managing risks associated with test data Facilitate communicating test data needs Identify SLA’s for test data turnaround Why a Test Data Management Strategy
9. www.cohesion.com | 877.774.3001 Reusable • Standardized • Modular • Managed • Known CIM Consumable • Quality • Self-Serve • Data Catalog • Fast Acquisition Scalable • Competency Center • Operational Efficiency • Traceable • Compliance Mature TDM is…
10. www.cohesion.com | 877.774.3001 Test Data Management Lifecycle Analysis Design Creation Use and Maintenance Disuse Governance
11. www.cohesion.com | 877.774.3001 Permissions Encryption Masking Translation Governance Acquisition Refresh Maintenance Scrubbing Enrichment Integrity
12. www.cohesion.com | 877.774.3001 • The simplest phase, with the most work! Analysis and Design • Test scenario data needs identified • Refresh frequency • Storage needs identified Analysis • Implementation of storage infrastructure • Implementation of TDM tools, if required • Any data prep work Design Analysis Design Creation Use and Maintenan ce Disuse
13. www.cohesion.com | 877.774.3001 Creation Reverse migration • Clone • Subsetting Creation through • UI or API • Direct injection Massage Analysis Design Creation Use and Maintenan ce Disuse
14. www.cohesion.com | 877.774.3001 Provides Real World Data Ensures Data Integrity Entire Book of Business Available Reduces Data Set Size Minimizes Security Risks Covers All Test Scenarios Fast Acquisition Time for Data Minimizes Duplicate Data Creation - Key Evaluation Criteria
15. www.cohesion.com | 877.774.3001 Reverse Migration
16. www.cohesion.com | 877.774.3001 Data Creation
17. www.cohesion.com | 877.774.3001 Massage
18. www.cohesion.com | 877.774.3001 Reverse Migration Creation Massage Full Clone Subset UI/A PI Direct Injection Provides Real World Data X X Ensures Data Integrity X X Entire Book of Business Available X Reduces Data Set Size X X X X Minimizes Security Risks X X X Covers All Test Scenarios X X Fast Acquisition Time for Data X X X Minimizes Duplicate Data X X Instantiation Summary
19. www.cohesion.com | 877.774.3001 Preparation Validation Execution Maintenance Use of Test Data Analysis Design Creation Use and Maintenan ce Disuse
20. www.cohesion.com | 877.774.3001 Archival Deletion Retain Dis-use Analysis Design Creation Use and Maintenan ce Disuse
21. www.cohesion.com | 877.774.3001 TDM Manager Application Architect TDM Architect Test Lead Database Administrator Security and Compliance Officer Infrastructure Architect Key Roles Supporting TDM
22. www.cohesion.com | 877.774.3001 Improve defect quality Facilitate test coverage Reduce labor costs Manage storage needs Manage security risks Recap Analysis Design Creation Use and Maintenance Disuse Governance Reusable •Standardized •Modular •Managed •Known CIM Consumable •Quality •Self-Serve •Data Catalog •Fast Acquisition Scalable •Competency Center •Operational Efficiency •Traceable •Compliance TDM Manager Application Architect TDM Architect Test Lead Database Administrator Security and Compliance Officer Infrastructure Architect
23. www.cohesion.com | 877.774.3001 Questions?
24. www.cohesion.com | 877.774.3001 Joseph Ours, MBA, PMP jours@cohesion.com 614.423.5253 www.cohesion.com @justjoehere www.linkedin.com/in/josephours
25. www.cohesion.com | 877.774.3001 ABOUT COHESION
26. www.cohesion.com | 877.774.3001 Assessments Deployment Training Strategy Cohesion Services Regardless of industry or company size, business leadership struggles to answer the question, "Am I getting true ROI and value from Testing?" Improving Your Investment Cohesion specializes in full management consulting services ranging from Strategic consulting through resource deployment across a broad range of specialties including Enterprise Agile, Project Management, Analysis, Application Development, and Quality Assurance Our specialization in driving ROI and value in the Testing space enables us to affect ROI over the entire lifecycle. Enterprise Agile Quality Assurance Management and Analysis Web and Application Development
27. www.cohesion.com | 877.774.3001 We provide unparalleled project delivery and implement solutions supporting both traditional and Agile approaches. We have extensive experience delivering high-profile projects for Fortune 500 clients. We proudly bring more than a decade of experience and exceptional client satisfaction to the equation. Our genuine commitment to client success and our flexible approach help us stand apart. Strategic Role Based Consulting Custom Solution Implementation Project and Program Delivery Value-Add Capability Value Cost Typical Staffing Firms Tier 1 Firms Specialty Firms Cohesion is a leading technology consulting firm that partners with clients to optimize their technology investments.
28. www.cohesion.com | 877.774.3001 Differentiators Relevant Skills Success requires deep knowledge on how business can best leverage IT to manage a wide variety of business challenges. Accelerators Our accelerators are designed to make your transition to agile effective and efficient. We bring real world experience, leadership, and practicality to Enterprise Agile. Talented and High Impact Resources Our consultants come well prepared to provide significant value on all client engagements. As part of our business model, Cohesion attracts consultants who have a passion for delivery and thought leadership. • Cincinnati • Columbus • Charlotte