Remote Research Workshop

Remote Research Workshop

Slides from the IA Summit 2012 workshop on Remote UX Research

9bb074de66a96eeacd0b275ee10e57d3?s=128

boltpeters

March 22, 2012
Tweet

Transcript

  1. 2.

    REMOTE RESEARCH Definition: Research where the participant is not sharing

    physical space with the researcher. In person Remote % of qualitative research done remotely* *Source: BP’s best guess
  2. 4.
  3. 5.
  4. 15.

    IN CASE THE INTERNET FAILS Research experience Most important thing

    to get out of today? Biggest fear or skepticism about remote research?
  5. 16.
  6. 22.
  7. 23.
  8. 26.
  9. 30.

    EXERCISE JUMP IN THE POOL Table groups Pick one moderator

    and one participant (they need to be in different locations) 10 minutes of moderating
  10. 31.

    MODERATOR Instructions Your participant has a sheet of paper and

    that’s it Goal: find out what kind of physical task instructions online Hint: ask them to give you a play by play of what they are doing Try and follow along with your own paper NO helping, even if you could.
  11. 42.
  12. 47.
  13. 48.

    Hey Marv, I want feedback on our MMO video game

    from 13yo English speaking kids in France & Latin America with webcams.
  14. 54.
  15. 57.
  16. 58.
  17. 60.

    Kids will lie for coins People mis-assessed their English levels

    Bandwidth was really a problem Kids don’t play when their parents are home
  18. 62.
  19. 63.

    Sure, Boss. Let’s combine methods. Intercept & observe 10 users

    live, and do 10 self- moderated with usertesting.com
  20. 64.

    TIME-AWARE TASKS Told to find purple pumps. Doesn’t care. Has

    to wear this for sister’s wedding this weekend. Whole different interview.
  21. 67.
  22. 70.
  23. 71.
  24. 77.

    Logistics: Who & When How to connect with the user

    (we’ll discuss in Tools) Managing time zones Session length
  25. 79.

    STAGED Incentives For Contextual Inquiry Start with $75, then at

    the end offer $25 more for environment photos Self-made diary studies
  26. 80.
  27. 81.

    Advanced planning: hybrid studies Why use only one method? Some

    methods don’t tell you the why 3-5 remote interviews is all you need
  28. 85.

    RECRUITING OPTIONS Grab someone in the hallway Grab someone who

    isn’t directly involved in your project IM your friends for a quick look Panels and recruiting agencies Real customers from marketing lists Site intercepts realness
  29. 87.

    RECRUITING OPTIONS Ethnio Links or house ads to online forms

    Recruiting agencies Customer email lists Panels Craigslist/online ads
  30. 89.

    USE FORMS WHEN You can place a link but not

    code Low budget Quotas are relatively complex Options: Google Docs Wufoo
  31. 90.

    USE AGENCIES WHEN No website access People whine about first-time

    visitors Higher budget Online recruiting failed
  32. 92.
  33. 93.
  34. 94.
  35. 95.

    CRAIGSLIST When other methods don’t work No dough Takes a

    while Embarrassing to admit to your friends
  36. 96.
  37. 97.
  38. 99.
  39. 100.
  40. 104.
  41. 109.
  42. 113.

    Tasks On Concepts For A Long Time People Talk To

    A Machine Talk To People Fancy-Ass Analytics Tasks On Images Tasks On A Live Site
  43. 114.

    I.A. & Navigation For Ad Agencies Ammunition Insight Just Better

    Analytics Still More Ammunition More Ammunition
  44. 115.

    Conceptual For A Long Time Self-Moderated Moderated Web Analytics Automated

    Static Automated Live Deep Behavioral UX Insight
  45. 117.

    Ad Agencies Love It Conceptual For A Long Time Self-Moderated

    Moderated Web Analytics Automated Static Automated Live
  46. 118.

    Jared Spool Hates It Conceptual For A Long Time Self-Moderated

    Moderated Web Analytics Automated Static Automated Live
  47. 119.
  48. 123.
  49. 124.
  50. 126.
  51. 128.
  52. 129.
  53. 130.
  54. 131.
  55. 132.
  56. 133.
  57. 134.
  58. 135.
  59. 136.
  60. 137.

    WHAT WE USE. A LOT. • Ethnio + GTM +

    iShowYouHD • Usabilla + Loop11 + Usertesting.com
  61. 139.
  62. 140.
  63. 151.

    How to rig your notes Leave one column (A) empty

    for notes. Set the cells of the next column (B) to record the clock time of each entry in A. =IF(A2=“”,“”,IF(B2=“”,NOW(),B2)) Set the cells of the next column (C) to record the difference between the first entry and the current entry =IF(ISERROR(B2-$B$2),“”,B2-$B$2) Fill down (Ctrl-D). Expect to use up to 120 rows for a session. Hide column B. You’ll never need to see it What the formulas look like Auto timestamp! Don’t write this down, it’s on page 104
  64. 155.
  65. 156.

    HYBRID STUDIES Numbers actually do lie sometimes And they don’t

    tell you the why 3-5 remote interviews is all you need
  66. 159.

    Control what you can control Which is, your set up.

    You wouldn’t go backpacking without checking your gear. Do it 24 hours in advance. Or else.
  67. 160.

    Prepare for what you can’t control User’s dog trips over

    power cord Internet affected by local weather User can’t install Doesn’t know how to install
  68. 168.
  69. 171.
  70. 174.
  71. 175.
  72. 176.
  73. 177.
  74. 178.
  75. 181.
  76. 189.
  77. 190.