Testing INDIRECT DATA Web Analytics A/B Testing Web Performance Task Based Testing INTERPRETATION By Researcher/Analyst INTERPRETATION Not Required "Information that is lacking often invites competing interpretations." "The Drunkard's Walk: How Randomness Rules Our Lives" by Leonard Mlodinow
make sure that you have the resources to take actions on the outcomes. WHICH APPROACH? IMPLEMENT & DEPLOY Implement the tool correctly, test and then deploy it. Monitor results to guarantee that the tool does not affect visitors and that you are getting the data you need. IT DEPENDS 3 1 2 DETERMINE ‘WHAT’ Determine what you want to find out from your visitors. Set that as a goals and stick to it for the duration of your test. RESEARCH RELEVANT TOOLS Talk to IT and discuss what is possible as far as technology on the site is concerned. Find out if the selected tool will allow you to research what you need to reach your goal.
54 11 31 51 10 26 57 13 21 62 GOAL: COMPARE PRICES MARCH 2011 31% Identify Trends Lastminute May-holiday Comparers January 2011 February 2011 March 2011 April 2011 Lastminute May-holiday Searchers TAKE ACTION CONVEY THE RIGHT MARKETING MESSAGE AT THE RIGHT TIME
STORY ...find what you were looking for? ...compare holiday prices? ...book the holiday you wanted? ...find our contact details? ...have your question answered?
-20% -€€ VISITORS WHO COULD SUCCESFULLY BOOK THEIR HOLIDAY PRICING ISSUES IN MARCH MONITORING YOUR VISITORS’ SUCCESS COMPARING TASKS PRICING PROBLEMS AROSE EFFECTS ARE ALWAYS TANGIBLE Search Compare Book
€1.000 0.45% 62,5% of visitors who had the intention to book DID NOT BOOK A HOLIDAY! $1.500.000 in opportunities Total # of visitors Total # of bookings (orders) Average Order Value Conversion Rate 24.000 9.000 €1.000 37,5% Total # of visitors with intent to book Total # of bookings (orders) Average Order Value True Intent Conversion Rate