Share
Embed
Slide 1
Slide 1 text
Reporting your user research insights like a psychologist
Slide 2
Slide 2 text
A deep understanding of the people we are
designing for is cardinal to a product’s success
Slide 3
Slide 3 text
No content
Slide 4
Slide 4 text
Our research process can be very unclear to our stakeholders
Slide 5
Slide 5 text
No content
Slide 6
Slide 6 text
An immediate solution is to bring
stakeholders along on the journey
Slide 7
Slide 7 text
What about the stakeholders you
don’t have direct access to?
Slide 8
Slide 8 text
No content
Slide 9
Slide 9 text
As it stands, user research reports come in too many shapes and sizes.
They oftentimes miss key information and follow different structures.
This impacts our ability to…
Slide 10
Slide 10 text
Source: Searching for Explanations: How the Internet Inflates Estimates of Internal Knowledge, Journal of Experimental Psychology: General, June 2015, by Matthew Fisher, Mariel K. Goddu, and Frank C. Keil
Slide 11
Slide 11 text
No content
Slide 12
Slide 12 text
No content
Slide 13
Slide 13 text
Why was the introduction section designed?
It is easy to fall into the trap of getting excited about a problem space or research
question and jump straight into the data collection.
“Lets just talk to users!”
Slide 14
Slide 14 text
Elements of the Introduction
Slide 15
Slide 15 text
The Introduction is designed to hold us accountable - it
demands us to make a case for why research is needed,
vs a default “we need to talk to users!”
Slide 16
Slide 16 text
No content
Slide 17
Slide 17 text
Why was the Method section designed?
It is easy to fall into the trap of skipping over some details of how you conducted an
experiment. This is because it is tedious and of no immediate personal use
(you know what you did!)
Slide 18
Slide 18 text
Elements of the method pt.1
Slide 19
Slide 19 text
Elements of the Method pt.2
Slide 20
Slide 20 text
Individuals are selected
from the population to form
the sample
Findings derived from
sample are generalised to
the wider population
Slide 21
Slide 21 text
Individuals are selected
from the population to form
the sample
Findings derived from
sample are generalised to
the wider population
If all your report says is
“we spoke to 5 users”then we can’t
verify if this happened…
Slide 22
Slide 22 text
No content
Slide 23
Slide 23 text
Why was the Results Section designed?
It’s very easy to fall into the trap of looking at your results at face value and
making huge inferential leaps about their meaning,
Slide 24
Slide 24 text
Elements of the results section
Slide 25
Slide 25 text
Perspicuity
1.40
Dependability
1.10
Efficiency
1.47 Stimulation
Novelty
Attractiveness
1.1
Pragmatic Qualities Hedonic Qualities
Attractiveness
0.40 0.20
Say we only reported the descriptive statistics of our study...
User Experience Questionnaire →https://www.ueq-online.org/
Slide 26
Slide 26 text
User Experience Questionnaire →https://www.ueq-online.org/
Inferential statistics give us a better understanding of the precision of the estimate,
and help us make inferences from our sample to the wider population. They give us
confidence in our findings, and as you can see here, stimulation and novelty are
not statistically significant (P-value is not <0.05)
Slide 27
Slide 27 text
Perspicuity
1.40
Dependability
1.10
Efficiency
1.47
Stimulation Novelty
Attractiveness
1.1
Pragmatic Qualities Hedonic Qualities
Attractiveness
0.40 0.20
If we reported these findings without looking at whether they were
statistically significant, we would have mislead our stakeholders by
making the wrong conclusions.
User Experience Questionnaire →https://www.ueq-online.org/
✅
✅
✅
✅
❌
❌
Slide 28
Slide 28 text
No content
Slide 29
Slide 29 text
Why was the Discussion section designed?
It’s very easy to fall into the trap of refraining from sharing the flaws of your study
and being defensive when questioned about the quality of them.
Slide 30
Slide 30 text
Elements of the Discussion section
Slide 31
Slide 31 text
No content
Slide 32
Slide 32 text
Why was the Abstract section designed?
It’s very easy to fall into the trap of thinking your audience will have time to read
your full report in detail.
Slide 33
Slide 33 text
Elements of the Abstract section
Slide 34
Slide 34 text
“All this is great,
but we don’t have time or budget for it”
Slide 35
Slide 35 text
What we don’t have time for is wasting
human capital and $ on “research” which
isn’t valid nor sound.
Slide 36
Slide 36 text
Insofar as our research is to inform large
scale product decisions directly
impacting a large scale user base... we
need to lift our game.
Slide 37
Slide 37 text
No content
Slide 38
Slide 38 text
Thank you
Sydney — Melbourne — Brisbane — San Francisco — New York —
London — Wrocław — Dubai — Mumbai — Singapore — Tokyo
LinkedIn
Facebook
Twitter
Instagram
Tigerspike
We deliver business value, fast.
tigerspike.com
Styliana Sarris
Senior UX Designer
[email protected]
Slide 39
Slide 39 text
How can we apply this
to User Research?
Slide 40
Slide 40 text
No content
Slide 41
Slide 41 text
What body of knowledge do we already have?
What does the literature say?
Slide 42
Slide 42 text
No content
Slide 43
Slide 43 text
No content