Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Lean UX NYC talk: High-quality, Impactful, Fast UX Research for Engineers

Tomer Sharon
April 11, 2013

Lean UX NYC talk: High-quality, Impactful, Fast UX Research for Engineers

Many software engineers, engineering leaders, and product developers want to learn from their customers about their needs and abilities. They understand that products should solve real problems for people and that they need to have an excellent user experience. Yet when it comes to conducting user experience research to actively gather insights from users about their abilities and perspectives, they have doubts. Countless software engineering practitioners perceive UX research as wasteful and slow and either do it as an afterthought or skip it completely while trusting their own intuitions.

Through three short case studies, this talk will demonstrate how UX research can be done with high quality standards, have an enormous effect, be completed quickly, and most importantly, achieved by software engineers without hiring an expert or paying thousands of dollars.

Tomer Sharon

April 11, 2013
Tweet

More Decks by Tomer Sharon

Other Decks in Research

Transcript

  1. HIGH-QUALITY,
    IMPACTFUL, FAST
    UX RESEARCH
    FOR ENGINEERS
    TOMER SHARON, UX RESEARCHER, GOOGLE

    View Slide

  2. HIGH-QUALITY IMPACTFUL
    FAST
    IGNORED
    SLOW
    CRAPPY

    View Slide

  3. KEY

    View Slide

  4. DON’T LISTEN
    TO USERS

    View Slide

  5. OBSERVE
    BEHAVIOR

    View Slide

  6. I DON’T LISTEN TO
    USERS BECAUSE OF
    THE PSYCHOLOGY OF
    ATTITUDE & BEHAVIOR

    View Slide

  7. HIGH, NEGATIVE
    RELATIONSHIP
    BETWEEN ATTITUDE
    AND BEHAVIOR

    View Slide

  8. STUDENTS WERE ASKED ABOUT THEIR ATTITUDE TOWARD
    CHEATING.
    A FEW WEEKS LATER, THEY WERE ASKED TO GRADE THEIR
    OWN TESTS. THERE WAS CLOSE TO ZERO CORRELATION
    BETWEEN ATTITUDE TOWARD CHEATING AND ACTUAL
    CHEATING.
    [COREY, 1937]

    View Slide

  9. View Slide

  10. View Slide

  11. WHAT DOES
    IT MEAN TO
    YOU?

    View Slide

  12. NEVER
    ASK WHAT
    THEY NEED

    View Slide

  13. INSTEAD
    OBSERVE
    WHAT THEY DO

    View Slide

  14. NEVER
    ASK WHAT IS
    THEIR FEEDBACK

    View Slide

  15. INSTEAD
    WATCH THEM
    USE IT

    View Slide

  16. HIGH-QUALITY

    View Slide

  17. ONLY AN EYE
    TRACKER CAN TELL
    IF USERS NOTICE
    STUFF

    View Slide

  18. EYE TRACKERS
    ARE NOT MIND
    READERS

    View Slide

  19. EYE TRACKERS ONLY
    TELL YOU WHERE
    PEOPLE LOOK,
    NOT WHAT THEY
    NOTICE

    View Slide

  20. NOTICEABILITY
    TEST

    View Slide

  21. NOTICEABILITY TEST
    A RESEARCH TECHNIQUE
    FOR LEARNING
    WHETHER PEOPLE
    NOTICE KEY ELEMENTS
    IN YOUR DESIGN

    View Slide

  22. HOW TO
    AFTER USERS COMPLETE
    A TASK ASK THEM TO RE-
    ASSEMBLE THE KEY
    SCREEN, SHUT UP, &
    WATCH WHAT HAPPENS

    View Slide

  23. View Slide

  24. View Slide

  25. ANALYSIS
    DID THEY PUT KEY
    ELEMENTS IN PLACE?
    DID THEY LEAVE OUT WHAT
    DOESN’T BELONG?
    DID THEY DRAW ELEMENTS
    THAT WEREN’T THERE?

    View Slide

  26. RESULT
    YOU GET A
    CRYSTAL-CLEAR
    ANSWER

    View Slide

  27. QUESTION IT ANSWERS
    DO THEY NOTICE
    IT?

    View Slide

  28. WHY IS IT
    HIGH-
    QUALITY?

    View Slide

  29. IMPACTFUL

    View Slide

  30. A/B
    USABILITY
    TEST*

    View Slide

  31. LOOP11 (www.loop11.com/startups)

    View Slide

  32. *A STANDALONE A/B
    TEST ONLY TELLS YOU
    WHAT HAPPENED, NOT
    WHY

    View Slide

  33. A/B USABILITY TEST
    AN ONLINE RESEARCH
    TECHNIQUE DURING WHICH
    USERS ARE ASKED TO
    COMPLETE TASKS WHILE UX
    METRICS ARE COLLECTED
    BEHIND THE SCENES

    View Slide

  34. RESULTS
    THINGS TO KEEP
    OPPORTUNITIES FOR
    IMPROVEMENT
    COMPERATIVE DATA ABOUT
    SPEED, SUCCESS, &
    SATISFACTION

    View Slide

  35. QUESTIONS IT ANSWERS
    WHO’S BETTER?
    WHERE DO WE
    FAIL?

    View Slide

  36. WHY IS IT
    IMPACTFUL?

    View Slide

  37. FAST

    View Slide

  38. THE RAINBOW
    SPREADSHEET

    View Slide

  39. A SPREADSHEET WITH
    WHICH ALL THE DATA
    COLLECTED DURING A UX
    STUDY IS CENTRALLY &
    SIMULTANEOUSLY
    DOCUMENTED BY A GROUP
    OF PEOPLE

    View Slide

  40. THE SPREADSHEET SERVES
    AS THE CENTERPIECE FOR
    LESSONS LEARNED FROM A
    STUDY AND LATER
    TRANSFORMS INTO THE
    FINAL REPORT

    View Slide

  41. View Slide

  42. View Slide

  43. View Slide

  44. ADVANTAGES
    INVOLVES THE ENTIRE TEAM
    FAST TURNAROUND OF RESULTS
    TEAM IS COMMITTED TO ACT ON
    RESULTS
    VISUAL INFO CLARIFIES WHAT’S
    IMPORTANT
    NO FORMAL REPORT

    View Slide

  45. WHY IS IT
    FAST?

    View Slide

  46. RECAP

    View Slide

  47. WANT HIGH-
    QUALITY?

    View Slide

  48. FOCUS ON
    BEHAVIOR
    TRY THE NOTICEABILITY TEST

    View Slide

  49. LOOKING FOR
    IMPACT?

    View Slide

  50. COMPARE
    TRY THE A/B USABILITY TEST

    View Slide

  51. NEED FAST
    RESULTS?

    View Slide

  52. NO REPORTS!
    TRY THE RAINBOW SPREADSHEET

    View Slide

  53. HIGH-QUALITY IMPACTFUL
    FAST

    View Slide

  54. AND PLEASE…

    View Slide

  55. DON’T LISTEN
    TO USERS

    View Slide

  56. DO LISTEN TO
    SNOWMOBILING
    TOUR GUIDES

    View Slide