Getting Started: Usability Research (v1.1)

Have you wanted to start testing your designs with usability research but didn't know where to start? I'll walk you through the foundation of what goes into writing and conducting usability research.

This presentation was given at UXCampDC, January 13, 2018. It has since been updated. Please look for v1.2 for the most up-to-date slides.

Transcript

1. Usability Research Getting Started: Erich Rainville UX Architect erainville@esri.com
2. • Definition • Planning • Scenarios • Facilitating & Observing • Results • Activity Getting Started: Usability Research | Overview
3. What is Usability Research? Definition:
4. Getting Started: Usability Research | Definition “If people are given a week to use
 a broken thing, they will learn to use it and they will be upset when you try to fix it.” —Sarah Parmenter
5. Usability research is about evaluating a product or service by testing it with representative users through realistic use cases. Getting Started: Usability Research | Definition What is Usability Research?
6. • Users are unpredictable • Users come from diverse backgrounds and experiences • Validate ideas and designs • Build a better product! Getting Started: Usability Research | Definition Why do Usability Research?
7. Process in a Nutshell Planning:
8. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Can users create an account easily? Meh
9. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Can users create an account easily? Create Account: Do users notice the link? Are they interested enough to click it? Can they complete creating the account? Better!
10. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Parts of a Testing Plan • Introduction • Background • Scenarios and Tasks • Wrap-up
11. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Parts of a Testing Plan • Introduction • Background • Scenarios and Tasks • Wrap-up
12. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Parts of a Testing Plan • Introduction • Background • Scenarios and Tasks • Wrap-up
13. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Parts of a Testing Plan • Introduction • Background • Scenarios and Tasks • Wrap-up
14. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning Parts of a Testing Plan • Introduction • Background • Scenarios and Tasks • Wrap-up
15. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning
16. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning
17. • Define the Objectives • Write the Testing Plan • Recruiting Participants • Conduct the Test • Analyze the Results Getting Started: Usability Research | Planning
18. It’s All About Context Scenarios and Tasks:
19. Getting Started: Usability Research | Scenarios and Tasks • Scenarios are the stories and context • Scenarios specify goals to achieve and question to answer • Describe who the user is, what they are trying to do, and their goals What is a Scenario?
20. Getting Started: Usability Research | Scenarios and Tasks • State only what the user wants to do • Do not include any information on how to complete the scenario • Let them show you how the app or site accomplished the goal Tasks
21. Getting Started: Usability Research | Scenarios and Tasks Example: Learn ArcGIS You’ve heard that Esri has a website where new users can find basic lessons and experienced users can gain new skills. Task 1: Open the Learn ArcGIS website using the bookmark we provided. Task 2: Look for a set of lessons that will teach you how to use the analysis tools in ArcGIS Online.
22. Getting Started: Usability Research | Scenarios and Tasks Example: ArcGIS Earth You are a student services administrator of Dunbar Elementary School in Atlanta, Georgia. You want to plan a new school bus route using ArcGIS Earth. Task 1: Open ArcGIS Earth on the desktop. Take a minute to explore the application. Task 2: Before you can start working on the project, you need to sign in to your organizations portal. Task 3: In order to plan the optimal route, you will need to mark the school and each student’s home on your map.
23. It’s Show Time! Facilitating & Observing:
24. Getting Started: Usability Research | Facilitating & Observing • Be relaxed • Let the participant know why they are here and what you would like them to do • Be respectful • Keep track of time Facilitator’s Role
25. Getting Started: Usability Research | Facilitating & Observing • Encourage participants to “think aloud” • Listen carefully and watch for body language • Ask key probing questions: • What did you expect to happen? • What are you thinking? Facilitator’s Role
26. Getting Started: Usability Research | Facilitating & Observing • Listen • Watch closely • Keep an open mind • Take notes Observer’s Role
27. Getting Started: Usability Research | Facilitating & Observing Ask yourself: • Do they get it? • Can they find their way around? And remember… • Brace yourself! • You’re seeing participants best behavior • Focus on actions and explanations Observer’s Role
28. What’d You Learn? Results:
29. Getting Started: Usability Research | Results • Team discussion after each test • Compare notes • Look for patterns Analyzing Results
30. Getting Started: Usability Research | Results • Consider your audiences and their needs • Use supporting evidence (participant quotes, video clips) • Emphasize users’ prospective Sharing Findings
32. Erich Rainville UX Architect, Esri erainville@esri.com twitter/TheBlueDog instagram/BlueDog officehours.io/people/thebluedog