Did you say 330 interviews? In 2-3 weeks?

Transcript

1. Did you say 300 interviews? In 2-3 weeks? Informed decisions
2. HOW IT ALL BEGAN www.u1group.com Sessions conducted first 2-3 weeks in June 300 participants x 90 minute moderated interviews You may want to pause and take a deep breath at this point “ ” “ ” “ ” We are running the same number of sessions in the US “ ” ” The project is on a fast track “ ”
3. www.u1group.com HOW IT ALL BEGAN
4. DEEP BREATH TAKEN www.u1group.com
5. PROJECT OBJECTIVES identify opportunities for improvement in the UX of individual products create a benchmark for future iterations does product suite meet user needs compare the UX of competitors' product suite, and inform the overall UX and product strategy for the product suite www.u1group.com
6. www.u1group.com
7. Product 1 Product 2 Product 3 Product 4 Product 5 Product 6 Product 7 Product 8 Product 9 Product 10 www.u1group.com
8. THOUGHTS ON SCALING
9. THE PLAN Approach mirrored between US and AUS Audience 1 (300 participants – AUS & US) Analyse Audience 2 (300 participants – AUS & US) Analyse & report www.u1group.com
10. THE PLAN www.u1group.com
11. www.u1group.com RESEARCHERS ARE RARE (& IN DEMAND)
12. THE TEAM www.u1group.com Researchers QA PM SEAN LUELLA JO HN SID SEAN DAN M ARIE STANISLAV PRESLAV LEANNE RAE M EG HAN JUSTIN SCOTT CIARA Lead
13. HOW WE PREPARED www.u1group.com
14. RECRUITMENT www.u1group.com
15. PROTOCOL 90 minutes remotely moderated interview using Zoom context setting and managing the environment task-based usability testing capturing benchmark data participants and the moderator turned off their cameras www.u1group.com
16. • unsuccessful • successful • successful with unexpected path • false positive • out of time, right path • out of time, wrong path • gave up • tech issue or bug • other BENCHMARKING DATA • brand attitudes • time on task • success/failure • Reason for failure Warm up: In task: Success: Failure reasons: • perceived ease • confidence • perceived relevance Post task: www.u1group.com
17. BENCHMARKING DATA End of session: Wrap-up (open ended): • overall impressions • usage • likes/dislikes • suggested changes • general feedback on product suite • general feedback on competitor product suite • SUS • NPS • relevance • preference • helpfulness • collaboration • feedback on ratings www.u1group.com Jeff Sauro's "Benchmarking the user experience"
18. Screenshot of a zoom meeting room here USING ZOOM www.u1group.com
19. SET UP www.u1group.com
20. EXECUTION Week 1 Week 2 Week 3 Week 4 Week 5 onboarding & prep fieldwork Audience 1 analysis & prep fieldwork Audience 2 analysis www.u1group.com
21. WEEK 1 www.u1group.com Tom from Blink
22. WEEK 1 www.u1group.com
23. WEEK 1 www.u1group.com
24. WEEK 2 www.u1group.com
25. need to find suitable image WEEK 3 www.u1group.com
26. WEEK 4 www.u1group.com
27. WEEK 5 www.u1group.com
28. SO….. www.u1group.com
29. www.u1group.com YOU SAY YOU SMASHED IT, BUT…
30. SMALL THINGS participants closed survey tabs participants didn’t hit “start” at beginning of tasks differences in moderation style communication www.u1group.com communication
31. BIGGER THINGS reliability of internet in Australia AUS schedule catching US schedule prematurely distance from product stakeholders delivering findings vs a report
32. got ourselves a Sid TO REITERATE, WHAT WENT WELL www.u1group.com awesome team recruitment went REALLY well had a great partner in Blink
33. technology issues/competency SOME REMOTE MODERATED LEARNINGS www.u1group.com ensuring participants are ready screen sharing and privacy
34. SOME REMOTE MODERATED LEARNINGS www.u1group.com
35. does being ‘strayan matter? RESEARCH CONSIDERATIONS www.u1group.com geography and remote moderators
36. REFLECTIONS www.u1group.com Trust Honesty Instinct Process Size (doesn’t matter?) Experience
37. Informed decisions Thank you! Sean Smith Director U1 Group sean@u1group.com @seanedsmith We were supposed to be here today… U1 is here Let’s chat.