Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Up a tree: Using tree tests to evaluate your IA

uxaustralia
November 07, 2013

Up a tree: Using tree tests to evaluate your IA

By Dave O'Brien at UX New Zealand 2013

You run usability tests on your designs, but do you test the structure of your site? How do you know it’s better than the old site? Online tree testing lets you test several proposed site structures against each other to see which is most effective. You get quick objective feedback from real users early in the design process. We start with tree-testing concepts and run a live tree test, then dive into the how-to’s of running a good study and the lessons we’ve learned from several high-profile projects. It’s a great chance to add another practical technique to your design toolkit.

uxaustralia

November 07, 2013
Tweet

More Decks by uxaustralia

Other Decks in Technology

Transcript

  1. Up a Tree
    Dave O’Brien Nov 2013
    Using tree tests to evaluate your IA

    View full-size slide

  2. Easy to find
    UXD easy to use
    IA easy to find

    View full-size slide

  3. Bad navigation

    View full-size slide

  4. 4
    Bad Labeling

    View full-size slide

  5. Bigger = harder
    “Getting to the right page within a
    website or intranet is the inevitable
    prerequisite to getting anything done.”
    - Jakob Nielsen

    View full-size slide

  6. How do we make it easier to find stuff?
    How do we
    make it easier
    to find stuff?

    View full-size slide

  7. We research our target users

    View full-size slide

  8. We design up a bunch of ideas
    • French
    • Italian
    • German
    • Japanese
    – Sushi
    – Teppanyaki
    – Yakitori
    • Chinese
    • Breakfast
    – Hot
    – Cold
    • Lunch
    • Dinner
    • Snacks
    • Beef
    • Poultry
    – Chicken
    – Turkey
    – Duck
    • Pork
    • Vegetarian
    Recipes

    View full-size slide

  9. We test our ideas to find out which work
    best

    View full-size slide

  10. Revise and re-test…

    View full-size slide

  11. …until we get something that works really
    well

    View full-size slide

  12. Test early
    Test early

    View full-size slide

  13. Today we’re going to look at tree testing

    View full-size slide

  14. Doing a real tree test
     Volunteer?

    View full-size slide

  15. So, what did we just see?

    View full-size slide

  16. Just like a real site
    Like a
    real
    site…

    View full-size slide

  17. But not really
    …but not
    really

    View full-size slide

  18. So why test this way?
    So, why test
    this way?

    View full-size slide

  19. Quick to set up

    View full-size slide

  20. It isolates two basic elements

    View full-size slide

  21. It makes analysis easy

    View full-size slide

  22. Don’t need to design a website first

    View full-size slide

  23. Just a spreadsheet

    View full-size slide

  24. What do we find out?
    What do we
    find out?

    View full-size slide

  25. What we look for
    Did they succeed?
    Did they backtrack?
    How fast did they click?
    Which sections need work?

    View full-size slide

  26. Some data, please!

    View full-size slide

  27. Low-scoring task

    View full-size slide

  28. Low-scoring pie tree

    View full-size slide

  29. High-scoring task

    View full-size slide

  30. High-scoring pie tree

    View full-size slide

  31. It’s not about the tool
    Are there other
    ways to test this?

    View full-size slide

  32. Closed card sorting

    View full-size slide

  33. Card-based classification evaluation
    Your 9-year-old son asks
    for a new belt with a
    cowboy buckle

    View full-size slide

  34. Other ways to test trees

    View full-size slide

  35. Best bang for the buck
     Online TT tools = quick and easy
     Fast to get up and running
     Easy for participants, on their own time
     The analytical gruntwork is mostly done for you
     Choice of commercial tools…

    View full-size slide

  36. C-Inspector (Steffen Schilb)

    View full-size slide

  37. UserZoom (tree-testing module)

    View full-size slide

  38. Treejack (Optimal Workshop)

    View full-size slide

  39. It’s not about the tool
    It’s not about
    the bike tool

    View full-size slide

  40. Lessons learned
    Some lessons
    we’ve learned

    View full-size slide

  41. When to test
    When to run
    a tree test?

    View full-size slide

  42. Phases in design process
    Research
    Open card sorts
    Baseline tree test
    Design
    Test tree 1, 2
    Revise, retest
    Testing
    Usability test

    View full-size slide

  43. Test against an existing tree
    Test
    new vs. old

    View full-size slide

  44. ACC old tree
    30%

    View full-size slide

  45. ACC new tree
    67%

    View full-size slide

  46. test alternative trees
    Test
    new vs. new

    View full-size slide

  47. recipes
    • French
    • Italian
    • German
    • Japanese
    – Sushi
    – Teppanyaki
    – Yakitori
    • Chinese
    • Breakfast
    – Hot
    – Cold
    • Lunch
    • Dinner
    • Snacks
    • Beef
    • Poultry
    – Chicken
    – Turkey
    – Duck
    • Pork
    • Vegetarian
    Recipes

    View full-size slide

  48. test iteratively
    Lather,
    rinse,
    repeat

    View full-size slide

  49. Typical test schedule (design phase)
    Week 1
    Create tree 1
    Create tree 2
    Week 2
    Run test 1
    Run test 2
    Week 3
    Analyse results
    Revise best tree
    Week 4
    Run revised test
    Analyse results
    Round 1
    Round 2

    View full-size slide

  50. Revising the best tree
    + =

    View full-size slide

  51. Different tasks for different groups
    Different strokes tasks
    for different folks

    View full-size slide

  52. Shimano example

    View full-size slide

  53. How many?
    How many?
    50
    Users/group
    10
    tasks/user

    View full-size slide

  54. Analysis – what should you be looking for?
    What should we
    look for?

    View full-size slide

  55. Low success scores

    View full-size slide

  56. Where did they go?

    View full-size slide

  57. Lots of backtracking

    View full-size slide

  58. Evil attractors

    View full-size slide

  59. Current limitations of the method
    All sunshine
    and lollipops?

    View full-size slide

  60. Only works with traditional tree structures

    View full-size slide

  61. Only tests certain factors
    Organisation
    Labeling
    Navigation (e.g. menus, see-also links)
    Content (e.g. supporting text)
    Visual design
    • Good and bad

    View full-size slide

  62. How good are your tasks?
    Too many tasks
    Badly worded tasks

    View full-size slide

  63. Don’t give away the answer!
    “You need to get reimbursed
    for expenses. Find the form.”
    •Library
    •Expenses/Reimbursements
    •Rules for claiming expenses
    •Expense forms
    •Who to contact
    •Travel

    View full-size slide

  64. No perfect tool (yet)

    View full-size slide

  65. Not a replacement for usability testing

    View full-size slide

  66. What next?
    What next?

    View full-size slide

  67. Better visualisation of results

    View full-size slide

  68. Testing navigation too

    View full-size slide

  69. Summary
     Tree testing = organisation and labeling
     Gives you a rough answer, very early
     Brings some objective data to the discussion
     Reveals IA problems to u-test later
     One more tool for your UX toolkit

    View full-size slide

  70. Tree testing – further reading
     Donna Spencer: paper testing
    http://www.boxesandarrows.com/view/card_based_classification_evaluation
     Dave O’Brien: online tree testing
    http://www.boxesandarrows.com/view/tree-testing
     Step Two Designs: tree testing overview
    http://www.steptwo.com.au/papers/kmc_treetesting
     Measuring Usability: tree testing overview
    http://www.measuringusability.com/blog/tree-testing-ia.php

    View full-size slide

  71. Let’s talk IA!
    Dave O’Brien
    [email protected]

    View full-size slide

  72. Make like a tree…and leave

    View full-size slide