User Testing Tryout 2020 ver.E.

Transcript

1. User Testing Tryout 2020 @plum_shiga
2. @plum_shiga 
 Laplace system.inc Software engineer Cognitive psychology, HCI, Semantics …
3. RESOLUTION
4. Behavioral and Direct data acquisition Establish culture Across Departments
5. Behavioral and Direct
6. https://www.nngroup.com/articles/which-ux-research-methods/
7. (I) don't want to extract requests and complaints. (No guess) (I) want to observe the response to a stimulus (fact) Caution!
8. Is the response / action intended?
9. Think aloud protocol The evaluator speaks out everything that comes to mind while performing the task using the target.
 [Ericsson & Simon 1993] The utterance content during the evaluation is recorded and analyzed together with the operation of the target.
10. Think aloud protocol Difficulty of utterance in parallel with operation
 [Shuck 1966] Re-encoding and restructuring of utterance [Kaiho 1993] Difficult to elicit useful utterances for usability evaluation [Cooke 2010] Experimenter's advice during evaluator silence hinders thinking [Ericsson & Simon 1993]
11. Think aloud protocol Difficulty of utterance in parallel with operation
 [Shuck 1966] Re-encoding and restructuring of utterance [Kaiho 1993] Difficult to elicit useful utterances for usability evaluation [Cooke 2010] Experimenter's advice during evaluator silence hinders thinking [Ericsson & Simon 1993]
12. Investigation of Indirect Oral Operation [Hori 2011] Two people, a instructor and an operator
 -> The instructor speaks. Not Evaluator = operator, evaluator != operator -> Make a Gimmick (Shikake) to speak
13. Investigation of Indirect Oral Operation [Hori 2011] Increased utterance confirmed. There were reports that awareness of "communication" was effective in structuring speech.
14. Investigation of Indirect Oral Operation [Hori 2011] Increased utterance confirmed. There were reports that awareness of "communication" was effective in structuring speech.
15. Hori, M. Kihara, Y. Kato, T.: Investigation of Indirect Oral Operation Method for Think Aloud Usability Testing. Human Centered Design. HCII 2011, LNCS 6776, pp.38 - 46 (2011)
16. Across Department
17. Capturing and modeling self- regulated learning 
 [Greene 2018] Capture Self-Regulated Learning (SRL) Processing with TAP. Utterance evaluation encourages self-recognition, leading to learning effects.
18. By having TAP practicing other than the development department, it is possible to re-experience the user's perspective and lead to the creation of a mindset
19. Behavioral and Direct data acquisition Establish culture Across Departments
20. User Testing Tryout 2020 @plum_shiga
21. References • [Bainbridge 1999] Bainbridge, L.: Verbal reports as evidence of the process operator's knowledge. International Journal of Human-Computer Studies, v.51 n.2, p.213-238, Aug. 1999 (1999) • [Cooke 2010] Cooke, L.: Assessing Concurrent Think-Aloud Protocol as a Usability Test Method: A Technical Communication Approach. IEEE transaction on professional communication. Vol. 53. No. 3, September 2010 (2010) • [Ericsson 1993] Ericsson, K. A. and Simon, H. A.: Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press (1993). • [Shuck 1966] Schuck, J. R., and Leahy, W. R. A comparison of verbal non-verbal reports of fragmenting visual images. Perception and Psychophysics, 1 (1966), 191--192. • [Kaiho 1993] ւอത೭ɼݪాӻࢠɿϓϩτίϧ෼ੳೖ໳ɽ৽༵ࣾ (1993) • [Hori 2011] Hori, M. Kihara, Y. Kato, T.: Investigation of Indirect Oral Operation Method for Think Aloud Usability Testing. Human Centered Design. HCII 2011, LNCS 6776, pp.38 - 46 (2011) • [Greene 2018] Greene, J. A., Deekens, V. M., Copeland, D. Z., & Yu, S. (2018). Capturing and modeling self- regulated learning using think-aloud protocols. In D. H. Schunk & J. A. Greene (Eds.), Educational psychology handbook series. Handbook of self-regulation of learning and performance (p. 323–337). Routledge/Taylor & Francis Group. Even if the title is Japanese, I wrote it without translating it so that I can find the same book. Thanks.