Thumbs up to gesture-controlled TVs? (Harshit C Desai)

A cross-cultural study on spontaneous gesture behaviour, spanning 18 countries. Wherever you go in the world, people are different. And so is the way they talk with their hands. As specialists for culture-specific user experience research, we wanted to find out which gestures people from various cultures would spontaneously use to control consumer electronics like interactive TVs. We conducted 360 face-to-face interviews with consumer electronics-savvy users in 18 different countries. The most frequent spontaneously used gestures and their difficulty were identified for each country and then aggregated to a global view of a gesture map for typical TV functions. The talk will highlight cross-cultural aspects of semantic gesture control for consumer electronics, using illustration and video material from all over the world. It will raise awareness for the cultural aspect of UI technology ad

Transcript

1. Harshit C Desai, UXINDIA13 Conference Presentation
2. Thumbs up to natural gesture interfaces? Harshit C Desai UX India - 2013 IIM- Bangalore
3. Introducing UX Fellows • Worldwide user experience research • 23 partner companies • Joint quality levels and processes • UX expertise + local culture expertise • UX expertise + local culture expertise
4. Introducing UX Fellows High quality UX research in 35+ countries
5. Introducing • Started in 2008 end as a new division of Indigo Consulting Team •Multidisciplinary team - Backgrounds include Communication Design, Interaction Design, Social Psychology and Management Studies Design, Social Psychology and Management Studies •All members are trained and certified usability analysts Expertise •Cognitive psychology, Design research, Usability Heuristics and Best practices, Wireframing •Conducted workshop and training sessions on usability techniques and practices
6. C: I like! B: I guess I ate something wrong A: I think I need to see a dentist D: That meal is really tasty What are these people trying to tell us? D: That meal is really tasty
7. Freehand gesture technology is entering our lives
8. Pointing gestures and semantic gestures
9. Pointing gestures
10. Semantic gestures • Gestures with an associated meaning • No need for an additional GUI • Potentially more efficient Challenges • Presumably influenced by local cultures • Some cultures might be more predisposed to the use of gestures than others Semantic gesture for mission control on a Mac
11. The UX Fellows Gesture Study
12. The UX Fellows Gesture Study Which semantic gestures would people from various cultures spontaneously use to control consumer electronic devices? • Country differences? • Country clusters? • Underlying metaphors? • Acceptance?
13. We compared spontaneous gesture behavior in 18 countries. RU CN CA US ES FR UK IT FI DE NL BE KR TR IN AU AR MX
14. Setting 15 min Warm-up: everyday gestures
15. Examined Commands Switch on device Volume up Channel up Context info for current program Channel down backward navigation in menus Confirm on-screen dialog (OK) Deny on-screen dialog (cancel) Pause video-on-demand (VOD) Restart VOD P+ P- Channel down Share current program Volume down Mute volume Pause current program Homepage EPG Restart VOD Fast forward VOD Rewind VOD Skip chapter VOD Previous chapter VOD Stop VOD Switch off device P-
16. Sample Persons who are able to imagine a gesture-control scenario for a TV. • Regular usage of a recent HD flat TV (max. 5-6 years of age) and other CE devices and services • High interest in consumer electronics • Regular usage of a touch device • No Xbox Kinect and gesture-enabled TV users • Potential buyers of international "premium" CE brands (no national, retailer or "no name" brands)
17. Sample sample economic background socio-economic background country
18. Sample 51% 49% 65 years 18 countries x 20 subjects max 51% 49% 16 32 x 20 subjects = 360 participants min mean
19. The Results
20. Elaboration
21. Difficulty of TV-related gestures 1.5 2.0 2.5 3.0 3.5 difficulty 1.0 1.5 Self-reported difficulty, 5 = very difficult, 1 = very easy, n = 360 tech-savvy CE consumers in 18 countries
22. Commonality of gestures 4 6 8 10 12 14 16 18 no. of countries high medium low 0 2 4 no. of countries with the same main gesture no. of countries
23. Some general insights
24. Average gesture difficulty by country 2.5 3.0 Everyday gestures CE gestures difficulty max 5,0 … 1.0 1.5 2.0 TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK difficulty min
25. Average gesture difficulty by country 2.5 3.0 CE gestures difficulty max 5,0 … 1.0 1.5 2.0 FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR difficulty min
26. Gesture difficulty by countries FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Volume down Pause VOD Channel down Rewind VOD Volume up Deny on-screen dialog (cancel) Channel up Confirm on-screen dialog (OK) Switch off device Switch off device Fast forward VOD Switch on device Restart VOD Mute volume Previous chapter VOD Pause current program Stop VOD Skip chapter VOD backward navigation in menus Context info for current program EPG Homepage Share current program
27. Gesture difficulty by countries FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Mean Volume down 1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2 1.5 Pause VOD 1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9 1.5 Channel down 1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1 1.6 Rewind VOD 1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5 1.7 Volume up 1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3 1.8 Deny on-screen dialog (cancel) 1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5 1.8 Channel up 1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2 1.8 Confirm on-screen dialog (OK) 1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3 1.9 Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9 Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9 Fast forward VOD 1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5 1.9 Switch on device 2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6 2.0 Restart VOD 1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0 2.0 Mute volume 1.4 1.7 1.3 1.5 1.7 1.8 2.3 1.8 1.7 2.1 1.9 2.2 2.4 2.5 2.4 2.4 2.0 2.7 2.0 Previous chapter VOD 1.0 1.7 1.7 1.7 2.2 1.8 1.4 2.0 2.1 1.7 1.8 2.0 2.0 2.3 1.3 3.0 2.7 3.3 2.0 Pause current program 2.1 1.6 1.5 1.7 1.4 1.7 2.5 1.6 1.9 2.2 2.0 2.2 2.1 2.2 2.6 2.4 2.2 3.1 2.0 Stop VOD 2.3 1.9 2.3 1.7 2.0 1.7 1.3 1.4 2.0 1.9 1.9 2.1 2.0 2.1 2.8 2.2 2.4 3.3 2.1 Skip chapter VOD 1.7 1.7 1.7 2.1 2.3 2.1 1.4 2.1 2.3 2.0 2.2 2.1 2.6 2.8 1.6 2.9 3.1 3.4 2.2 backward navigation in menus 1.4 2.1 2.1 1.9 2.5 2.0 1.3 2.3 2.5 2.1 2.7 2.3 2.2 2.2 3.6 2.9 2.2 3.4 2.3 Context info for current program 2.7 2.3 2.5 2.2 2.5 2.4 2.6 3.1 2.4 2.8 2.7 2.5 3.2 2.9 3.2 3.4 3.8 3.2 2.8 EPG 2.4 2.2 2.6 2.4 2.8 3.5 3.7 2.4 2.4 2.6 2.7 2.9 2.9 2.7 3.2 3.2 3.0 3.9 2.8 Homepage 3.7 2.2 2.3 2.2 2.7 2.4 3.8 3.1 2.0 2.9 2.7 3.0 3.0 3.3 3.7 3.4 3.3 3.7 2.9 Share current program 2.4 2.1 1.9 2.4 3.3 2.4 3.9 2.9 3.4 3.5 3.8 3.7 4.2 2.6 4.2 3.8 4.5 3.2 3.2 Mean 1.7 1.7 1.7 1.8 1.9 1.9 1.9 1.9 1.9 2.0 2.1 2.1 2.2 2.3 2.3 2.4 2.6 2.8
28. General acceptance • Our 360 tech-savvy participants responded very positively to the idea of semantic gesture input for TVs. "fun to use", "convenient", "coolness factor" • Participants would like to use gestures to control other devices as well (e.g. audio). devices as well (e.g. audio).
29. Operation Many participants felt that voice and sound could be a good support for gesture input. Can the TV hear me? waking up the device with a sound
30. Gesture type preference FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Semantic FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ Semantic 15 FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ Semantic 15 Pointing Many users would prefer switching between gesture types. Pointing Pointing 9 associated with more advanced commands
31. Typical concerns of users • Learning and retention of gestures (but: would be easy if based on implicit behavior repertory) • Sensitivity and accuracy of devices • Interference by other gestures in the room • Compatibility with lean-back disposition
32. Conclusions
33. Conclusions 1. For basic CE commands a common language for semantic gestures already exists across cultures. 2. More complex commands could be realized by either a. customizing these gestures for each individual market a. customizing these gestures for each individual market b. customizing individually c. proposing a set of semantic gestures that need to be learned (the study provides some suggestions) d. switching to pointing gestures in combination with a GUI 3. It is necessary to consider cultural differences at a country level when it comes to designing advanced gesture control for globally marketed devices.
34. Thank You harshit.desai@indigo.co.in