Slide 1

Slide 1 text

Testing an IA Donna Spencer - Maadmob (@maadonna)

Slide 2

Slide 2 text

About me • User experience freelancer – information architecture, interaction design etc • Far too long (10+ years) • Run UX Australia & other conferences • @maadonna Card%sor(ng How%to%write%great% copy%for%the%web A%prac(cal%guide%to% informa(on%architecture

Slide 3

Slide 3 text

What is IA testing (or tree testing)?

Slide 4

Slide 4 text

Test your information architecture

Slide 5

Slide 5 text

But do it before it’s built!

Slide 6

Slide 6 text

Do it as early as you can Research Design IA Design navigation Prepare content Launch

Slide 7

Slide 7 text

How does it work?

Slide 8

Slide 8 text

In person

Slide 9

Slide 9 text

Or online

Slide 10

Slide 10 text

Or both

Slide 11

Slide 11 text

Preparing & running the test

Slide 12

Slide 12 text

Preparation: The IA • Need a simple hierarchy • Or two... • OK to put some items in two places • Can test just subcategories, or to pages

Slide 13

Slide 13 text

Preparation: The tasks • Figure out what you want to test • Write tasks • In general, user-friendly language • OK to have a long list of tasks for good coverage

Slide 14

Slide 14 text

Preparation: The people • Standard issues for recruitment! • If using online, offer an incentive • For online, you need volume to get good results • As you can’t probe to find out what people are thinking

Slide 15

Slide 15 text

Preparation: The tool • Write out cards for face-to-face • Online • Enter the IA (Treejack: paste from a spreadsheet) • Enter tasks • Identify ‘correct’ locations

Slide 16

Slide 16 text

Preparation: The tool • Settings • Randomise tasks to avoid a consistent learning effect • 6-8 tasks per person maximum

Slide 17

Slide 17 text

Recording results: Tool

Slide 18

Slide 18 text

Analysing the results

Slide 19

Slide 19 text

Analysis • Check what happened with each task • Check what happened in each part of the IA • Identify tasks/IA sections that worked: • Well • Badly • OK

Slide 20

Slide 20 text

The important part: Analysis

Slide 21

Slide 21 text

The important part: Analysis Legend - Pies Legend - Lines Went down the right path Went down the wrong path Went back This is the correct answer Skipped question Correct path Incorrect path Soft furnishings Participants came here 1 time and clicked: Home Home décor Soft furnishings Interior Decorative Bowls & Plates Kitchen Cookware Curry Pots Servingware Coasters & Mats Dinner Plates & Bowls Serving Bowls Trays & Platters Cups, mugs & glasses Kitchen Accessories Kitchen Accessories Food & drink Food

Slide 22

Slide 22 text

The important part: Analysis

Slide 23

Slide 23 text

The important part: Analysis

Slide 24

Slide 24 text

The important part: Analysis

Slide 25

Slide 25 text

Analysis • Check what happened with each task • Check what happened in each part of the IA • Identify tasks/IA sections that worked: • Well • Badly • OK • Can be hard to figure out why things happened

Slide 26

Slide 26 text

Find scented candles - Christmas? Legend - Pies Legend - Lines Went down the right path Went down the wrong path Went back This is the correct answer Skipped question Correct path Incorrect path Home Participants came here 40 times and clicked: Correct path 34 (85%) Incorrect path 6 (15%) Back from here 0 (0%) Nominated answer 0 (0%) Skip task 0 (0%) Home Home décor Soft furnishings Interior Candles & Holders Relaxation Essential Oils Incense & Holders Office Kitchen Christmas Christmas Catalogue Christmas Decorations

Slide 27

Slide 27 text

Tips

Slide 28

Slide 28 text

Tips • Test your test • Easy to make mistakes with the tree, correct answers and tasks • Test two versions • Easier to interpret results • Tweaks to one version • Entirely different approaches

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

Tips • Test your test • Easy to make mistakes with the tree, correct answers and tasks • Test two versions • Easier to interpret results • Tweaks to one version • Entirely different approaches • Tweak & re-test

Slide 31

Slide 31 text

Resources • Card-based classification evaluation (Donna Spencer: http:// boxesandarrows.com/card-based-classification-evaluation/ • Tree testing (Dave O’Brien): http://boxesandarrows.com/tree-testing/ • Card Sorting + Tree Testing : The Science Of Great Site Navigation (Jeff Sauro): http://www.measuringusability.com/blog/cardsort-tree-test.php • Julian’s 5 tips for Tree Testing (Julian Apatu): http:// www.optimalworkshop.com/blog/tree-testing-tips-with-julian-apatu/ • Making the most of Optimal Treejack (Nick Bowmast): http:// www.userexperience.co.nz/2009/08/making-the-most-of-optimal- treejack/

Slide 32

Slide 32 text

Tools • Treejack: http://www.optimalworkshop.com/treejack.htm • PlainFrame: http://uxpunk.com/plainframe/ • User zoom tree testing: http://www.userzoom.com/products/tree-testing • C-inspector: http://www.c-inspector.com/index.php

Slide 33

Slide 33 text

Thanks • http://maadmob.com.au/ • +61 409-778-693 • donna@maadmob.net • Twitter etc: maadonna