Styliana Sarris - Reporting your User Research Findings like a Psychologist - Transcript

Our user research findings lack gravity when they are reported poorly.

Oftentimes, we negate key pieces of information or unwittingly breach ethical guidelines. Despite the various benefits of having some creative freedom, as it stands, the user research report comes in too many shapes and sizes. This impacts both our ability to quickly consume previous research conducted by fellow researchers and more importantly, denies us the ability to appraise its quality; a fundamental function of research.

Albeit presenting our research insights with long slabs of text and convoluted words is a far cry from the desired objective, we have a lot to gain from leveraging the structure that psychologists turn to when presenting their findings - the academic journal.

The design of the academic journal is very intentional, with each section devoted to addressing a key aspect of the scientific method. Insofar as user research is to be legitimate in guiding large-scale product decisions, we are not exempt from holding ourselves to high standards of rigour - but we also don’t need to be terrified by them. What we need is a standard that works in our unique context - a context where time is money, deliverables are created in a hurry and budgets are minimal.

In this talk, we will hone in on the architecture of the academic journal and explore what we can borrow from it to raise the bar on our research reporting, ultimately maximising the weight and longevity of our insights.

Transcript

1. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . www captionslive com au | captionslive outlook com | UX A a a D R a c Da 2 T da , 18 Ma c 2021 Ca i ned b : Hila Cadd
2. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 63 JAX WECHSLER: Thank . STEVE BATY: The e ha e been a c le f e i n ed if c ld j ake a m men ha e a l k and i e me e n e , ha ld be g ea . JAX WECHSLER: I ill. STEVE BATY: Thank . N , ne e ha e S liana Sa i . The ill be j ining in a m men . And e ill be la ing a ide , I belie e. Hell . STYLIANA SARRIS: Hi S e e. We' e ha ing a bi f in e ne c nnec i n d ama hi m ning. STEVE BATY: Tha i fine. We'll a hell and e'll hi la n he ide . I'll le Annabelle ake e f m he UX A alia acc n and a lea e ha e i h . STYLIANA SARRIS: Thank e m ch f ha ing me. I'm eall ha alk ab he d c men a i n ide f hing f m a UX e ea ch e ec i e. I'll be li e I'll be an e ing an e i n . Tha ma e en be be e . Y can g ahead and ha e. STEVE BATY: Le ' g . STYLIANA SARRIS: Thank m ch f ha ing me he e. I'm e ci ed be alking ab d c men a i n, i ill make i f n da b l king a ha e can lea n f m a ch l gi im e d c men a i n. S
3. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 64 fi I an a b calling ha a dee nde anding f he e le e de ign f i ca dinal cce . And a la ge b d f he k ha e d i a nd making e ha e' e eall nde anding a e ' end- -end j ne ha e can fig e he e he ain in a e, alle ia e ha in n. S a kee nde anding f he e le i a m . B a e ea ch ce can be eall nclea akeh lde . If e l k a h e di ec l in l ed, e , a c le f ick n e and hen he ge hi eall big li and e en i e ec mmenda i n f m e ea ch b he ' e n al a clea h e g i . One f he hing I an call i ha me f a efac , ha he gi e hi im e i n f (INAUDIBLE) he acc ac f he inf ma i n ha he h ld. All i d e i i ake ne e n g , h ld n, h e ac l , in hi ca e f e na, h e ac l did in e ie ing 10 e lead hi e nali filing. The e a e hing ha e a k el e a e ea che al . H e ac l did de i e he finge in he ai , in e e e ha e ee he e. We ee hi ime and ime again. An immedia e l i n b ing he akeh lde al ng n he j ne . S e b ing hem al ng and he a k e i n beca e he ' e hen a f i . B ha ab he akeh lde ha e d n' ha e di ec acce ? H d e ake hem n he j ne ? The ne ha a e g ing g ab hi file, he file eme ge f m he dead, i ' been c llec ing d in meb d ' d c men f lde n he cl d and e en i and and make me f meaning f i . S h d e ake he e le ha ill g ab hi file la e in he f e, h d e ake hem n he j ne . Thi i ha I an ed alk ab da . S a i and , m ng belief i ha he e e ea ch e c me in man ha e and i e , and hi f en ime lead mi ing ke inf ma i n and a b nch f diffe en c e l k a . Thi affec abili ea il c n me he e ea ch ha e' e l king
4. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 65 a , e eciall hen e' e ing l k a m l i le d c men a he ame ime, nde and he b d f kn ledge. I affec abili a ai e he ali f i . A ell a m e im an l de ign n e ea ch hich b ild n ha . If e d n' kn ha e ea ch ha al ead been d ne and e can' ea il c n me i , hen i ' e , e ick b ild n f ha , and eall e and kn ledge, e e ea ing hing ha e al ead kne . We' e n he fi ind be l king a e ing n. Thi i kind f he e e e ience, he m de n da ch l g he e e' e e ea ching h e can be e e echn l g e e e le, eall nde anding hei a i de and beha i . P ch l g ha been d ing hi f a eall eall l ng ime and me hing ha I an call , I g e a li le bi ab me. I a ed ff m j ne in UX d ing a he Uni e i f Melb ne. S he c e a eall eall hea il ing ained in m k a he beginning. S f me hi a me hing ha a c n in l ken ab . Ob i l e e e ained in hi me h d b ha I an d i ackn ledge ha i ilege b m main a i n and e f hi e i n e eciall i kind f deb nk me f i beca e i ' n a c m lica ed a i l k and I an em ha i e he fac if ha en' been ained in hi me h d i l k eall c n l ed and c nf ing, and I an de en i i e, I an la m a in de en i i ing h I can each in ing hi me h d. Beca e i ' in he ha d ba ke a he m men b i ' e im le a a c e. S I an alk ab ha da . A a high le el, he c e, he academic j nal , i fai l im le. S e a ff i h an ab ac hich i he e ec i e mma . We hen m e n he in d c i n, hich i eall ab b ilding a ca e f e ea ch. S i ' b ilding he g nd k f h e ea ch i im an and h e a e j ified and nning he e ea ch. The
5. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 66 me h d i a e -b - e kind f ced e and incl de h e ke , a ici an a ell a ha ma e ial e ed. The e l hen g e n e en e l f d and he di c i n, hich i he e e a ha he d mean , ha he e l f d i , ha infe ence e can make ab la i n. The e' al he efe ence a he end. I an kick ff i h he in d c i n and hen e' e g ing l back he ab ac a he end, gi en i ' he e ec i e mma and i ' ne ha g n d i e la , le ' l k a he in d c i n in a bi m e de ail. S h a he in d c i n ec i n de igned. I ' eall eall ea fall in hi a ab ge ing e ci ed ab a ca e f a e ea ch e i n. Thi i eall c mm n in ace in UX. The en imen end be le ' j g and alk e . B he migh ha e e ea ched he e ac ame ic bef e. If e d n' nde and he b d f kn ledge e ha e, hen e can' b ild n i . Wha ha en i e migh end a ing ime and m ne lea ning hing ha e al ead kne . The elemen f he in d c i n a e de igned hel ha f m ha ening. Fi , he in d c i n a i h h , hich i a ing he im ance f he blem and in e iga i n. S Sim n ld be e lea ed. Al a a i h h . I ' hen f ll ed b a li e a e e ie hich i eall an in e iga i n f ha e kn al ead . Th gh he in e iga i n f ha e kn al ead , f c e, e migh nc e a ga . S i ' clea l a ing ha he ga i . All he hing e l k f a d in he li e a e e ie , l king a e i ing kn ledge, ha i i ha e d n' kn . O aim hen g e add e he ga , h ill e b ild n hi e i kn ledge. And he la hing in an in d c i n i a e f h he e , hich a e ed ca i n g e e . S me hing I didn' men i n ea lie ha he h he i i ca dinal
6. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 67 f m e en ing f m an he en ial i fall. D ing hi in he in d c i n mean ha e l ck el e in a nd ha e e ec ha en, and e eall a e ha e a e g ing in e iga e. We can' b nch a c llec f da a and make ha e e meaning f hem. P ec ing f m adding an bia in e e a i n f making ha e e meaning f da a. N , I an h ne in a ecific a in UX ha I feel e eall ggle i h. Of c e, anecd al e idence, b me hing I ee ime and ime again i ha e alk a nd j m ing aigh hi , e need alk e , i h alking n el ing n e i ing da a b d f a g men . S me hing ha I' e ill a ed he e i a ick men al check ha he in d c i n demand f d . Fi , b i l e l k a he e i ing b d f kn ledge h gh li e a e e ie a I men i ned. B hen i a k ab , i he e a ga in kn ledge. If he an e i n , hen e d n' need c nd c e ea ch. If he an e i e , i a k f ha e a k a ec nda e i n. S d e hi add al e. If i d e n' add al e, hen he e' n need c nd c e ea ch. Sh ld i add al e e ec i d e , i gi e an idea ha e , e h ld n e ea ch, beca e he e' a ga in kn ledge and add e ing ha ga ill b ing al e. The hing n e he e i ha e d n' al a need g and ge ne inf ma i n. We can le e age a l f he e i ing b d f kn ledge make me f a g men f . Le ' g n he me h d. S he me h d a de igned ec f m hi a hich i gi ing e me de ail f h e c nnec ed he e e imen . We end d hi beca e i ' edi i e d n e e e ha e k and i ' n f immedia e e nal e. We kn ha e did, af e all. A clea me h d i ca dinal and if e d n' kn ha e did, if I'm l king a in a e i e and I d n' kn ha he did, hen I cann e lica e i e if he e l . S e can'
7. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 68 e if he he i ' f nde alid. And hen e' e l king a he li e a e e ie e' e l king a he me h d ee e, e' e a ai ing he h le e b he me h d i he e g , h did hi eam c nd c he e e imen , h did he c me hei c ncl i n, ha kind f da a did he c llec ? S he elemen f he me h d a e h ee a h i ie , e' e g he a ici an , he ma e ial and hen he ced e and I'll g h gh hi ne a a ime. L king a he a ici an e fi need a am le i e, h man e le e e a f kn ledge. If ' e d ing a cla ic hi migh be a am le i e f fi e. Then e l k a an dem g a hic hich a e ni e d . Wh did ec i , and n ha ba i , h d di ide am le. F e am le, I ecen l ked a g e nmen jec , i a in e nal and he en i e la i n had be A alian ci i en e en ha e acce hi in e nal. S ba icall hen I a ec i ing a am le e f m a abili e ec i e, I a c llec ing ne f he e cl i n c i e ia he had in he e a n n-A alian ci i en . S beca e in a la i n he e i n - he e ill ne e be a ca e f a n n-A alian, he he ha ' f he igh ng ea n , in hi la i n he e ldn' be an n n-A alian , he ef e I made e a age an f he a iable b making e m am le had n n n-A alian . S i a nl A alian ba ed. Then e ha e an mea e and l ed. If e a e abili need eall ca e ha in he me h d ec i n. Whe he ed . The la a f he me age i he e -b - e ced e, h he da a a c llec ed and anal ed. S need clea ab e ac l h c nd c ed d , h c llec ed he da a and h i a anal ed. I an h ne in a ecific blem again h gh m e e ience in UX and eading diffe en e f m m l i le b die , he he agenc
8. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 69 in e nal e ha I ead and alk ab a c mm n heme ha I ee a an i e. S a ic la l i e ain h e i e a ici an . S e e d ha a la i n f e f e le hich ill benefi f m he e ea ch. Tha make la i n, hich i e e ingle e n in ca e in he e ba e. Wha e d , e can' ibl e ea ch e e b d , me la i n a e e ba ed eall la ge in i e. S e g ab a b e a i n f hem f m am le. S e nl ha e alk he am le and hen he aim i ha f m he die ha e c nd c i h am le e gene ali e he finding make claim ab he ide la i n. Then a c e i e i if e' e n clea ab h e de i e ha am le, al a he e ill be eall b adb h ema k like e ke fi e 10 e , i h h e g abbed ha am le f m he la i n and ha a he incl i n and e cl i n c i e ia, meb d eading he e af e can' e if . I kn ing an e eme he eb e' e c m le el ke ed he e l ne e f e e n, b he in I'm ing eall h he e i ha e can' ell, he e i n a f meb d kn if hi ha ened if he am le i ke ed n . S eall clea l e ing n am ling ced e i ca dinal an b d a ai ing e ea ch af e a d . Le ' ake a dee e l k in he e l . I ' e ea fall in he a f l king a e l a face al e. If he ' e n a i icall ignifican can' gene ali e he ide la i n. Thi i e f lan ing in e e a i n i h he e l hich make i ha d f he a dience de i e an al e na i e c ncl i n. S he e l ec i n demand ha e e en e l in de en e h he e ell... ha fall f m he in d c i n. I'm g ing g in hi , de c i i e and infl en ial a e hea d e'll l k in hem in a ec and la l he e l ec i n j eall a id an in e e a i n f
9. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 70 he meaning f he e l . I ' j e l da a. The in e e a i n ill ha en in he di c i n hich i he ec i n af e hi . S g ing in de c i i e a i ic . The de c i i e a i ic eall a e an da a hen ' e d ing a an i a i e d , i ' he da a ha c llec ed ha e ain am le. S a e did he hing ha e' e l king a he e i b i l a hi g am, e' e l king a he e l f a - f m am le, f m a d . Thi i he c e, e d n' ha e g m ch in i b i mea e e e e ience n he e i a iable , a ac i ene , ea e f e e ce e a and hen hed nic ali ie . A can ee f m he e, im la i n and n el j i all e f med m ch le han he agma ic ali ie and hi can be a eall a k kind f c nce ning cena i he e he feel g d hed nic ali ie f a d c e ed eall eall l af e he bigge am le. S e f en end nega e l king a he infl en ial a i ic and I an g in hi beca e i ' eall eall blema ic. The a e a i ic ha i a e ab e he e c i i e and he e ain la i n. S he gi e a be e nde and f he eci i n f he e ima e. A can ee he e in hi able im la i n and n el a e n a i icall ignifican . S can ell b he eall la ge id h f he c nfidence in e al hich c n ain he e ima e f he mean hich can ee i he a e age e l f m e am le, hen l k a c nfidence, P al e, n ne f hem a e bel 0.05 hich i he e e ld a i i a a i icall ignifican e l . Of en e end e en he e finding hich e ain e am le, i h an men i n calc la i n f he infe en ial a i ic and e mi lead akeh lde , beca e e' e making he ng c ncl i n. A g a h like hi h im la i n and n el e f med e l . S e en ing akeh lde ha he a d e n' feel g d ld b i l ai e ala m bell and ai e ala m bell f he ng
10. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 71 ea n . M ing n he di c i n, i ' eall eall ea fall in hi a f e aining f m ha ing he fla f d and being defen i e hen e i ned ab he ali f hem. Thi i c mm n in field and me hing ha e need a b ilding c n in ing b ild a eall hick kin ab , beca e he fla f d a e im an call . We' e all n he f n f i h hem. Ackn ledging he limi a i n f d i ac all an ad an age , beca e fi , i n he f n f , like e a e, n e e d ill di c e he ld a a ime and i hel f f e e ea ch. The elemen f a di c i n. Wea e g he fi he a he mma f he h he i , did ha e hink ld ha en ac all ha en. I ' an in e e a i n f finding , ha d finding mean. Again i in he e l ha hi i he e e a alking ab he meaning f finding . If e' e g he limi a i n , h d i c m mi ed. An f e di ec i n , ha d e need del e dee e in ne and an c ncl i n e can make f m hi d . The la bi i he ab ac hich i e ec i e mma , and he e ha i eall ie l e i hi blem f falling in he a f hinking a dience ill ha e ime ead f ll e and de ail. Pe le a e b and e ec i e a e b . Re ea che ill al be b in ing lan f e e ea ch. Y ha e g h gh man e ea ch j nal a he ne ime. S ab ac i eall eall ke hen mma i ed in hel ing a dience ga ge he he he need , i ' kind f like d I need end m e ime g ing h gh hi e . I ' he ale i ch f e . F me hen I'm l king a he j nal , d I an in e m e ime. D e hi ha e an ela i n m iece f k. S he elemen f he ab ac ec i n a e im le in ha he e' ne elemen , he ke elemen f each f he ec i n de c ibed in he ab ac . S a i h h ? Sam le cha ac e i ic, mma f he e l ,
11. N e ha hi i a edi ed a c i f a li e e e a d he ef e ma c ai e . Thi a c i i he j i e f Ca i LIVE a d he a h i ed a e ible f a me a d ma be c ied ed b a he a i h a h i a i . Page 72 he e e need im e he e i ha e ec i e mma i n' j ab he h , i need ha e am le da a, e l , hich ha e he de c i i e infe en ial and b i l he infe en ial e ain d ing a an i a i e d . S hi i me hing ha I ge a l . All hi i g ea b e d n' ha e ime b dge f i . And I an ge challenge hi hinking beca e ha e d n' ha e ime f i a ing h man ca i al n d lla , n e ea ch, hich i n' alid n nd. In fa a e ea ch i inf m a la ge- cale d c deci i n hich di ec l im ac a la ge- cale e ba e. The e' e le behind i in fa a ' e a e g ing d e ea ch ha inf m ha deci i n e make hel he e e le, hen e need lif game. C ing e ea ch c ne ma gi e he fal e im e i n ha ' e making fa g e . If e ea ch i n' alid, nd, b ilding n kn ledge and can e eall call i e ea ch. Ha ake e i n . STEVE BATY: Thank . STYLIANA SARRIS: Thank m ch. I en a li le bi e b he e ill be e i n in he cha I imagine. STEVE BATY: If c ld ake a l k ha ld be e cellen . Thank m ch. STYLIANA SARRIS: Thank f ha ing me again. STEVE BATY: O lea e. B e. O ne fig e i B ke h ill be j ining in j a m men . B ke' g ing be alking ab e a i n. Hell .