Big Data Testing

Big Data Testing talk @IntentMedia

Transcript

1. Big Data Testing Michele Martone QA Engineer, Intent Media Friday, December 7, 12
2. What is Big Data Testing at Intent Media? • Goal is to determine whether to display content to a user by modeling their characteristics. • Running linear regression on user characteristics to determine the decision. Friday, December 7, 12
3. Big Data Testing vs. Traditional Testing Big Data Traditional Inputs are huge and in the cloud Smaller scale and perhaps manual inputs Complicated transformations Mostly easy to follow steps Verification takes some research Concrete verification Friday, December 7, 12
4. Lessons Learned • Use small data sets if possible. • Test reasonableness with real data. • Read up on data warehouse testing, i.e. record counts, data integrity, etc. • Listen to and solicit your experts for acceptance criteria. • Learn to use the tools the developers use. Friday, December 7, 12
5. Big Data Testing Questions? Friday, December 7, 12