$30 off During Our Annual Pro Sale. View Details »

Thumbs up to gesture-controlled TVs? (Harshit C Desai)

uxindia
October 25, 2013

Thumbs up to gesture-controlled TVs? (Harshit C Desai)

A cross-cultural study on spontaneous gesture behaviour, spanning 18 countries. Wherever you go in the world, people are different. And so is the way they talk with their hands. As specialists for culture-specific user experience research, we wanted to find out which gestures people from various cultures would spontaneously use to control consumer electronics like interactive TVs. We conducted 360 face-to-face interviews with consumer electronics-savvy users in 18 different countries. The most frequent spontaneously used gestures and their difficulty were identified for each country and then aggregated to a global view of a gesture map for typical TV functions. The talk will highlight cross-cultural aspects of semantic gesture control for consumer electronics, using illustration and video material from all over the world. It will raise awareness for the cultural aspect of UI technology ad

uxindia

October 25, 2013
Tweet

More Decks by uxindia

Other Decks in Design

Transcript

  1. Harshit C Desai, UXINDIA13 Conference Presentation

  2. Thumbs up to natural gesture interfaces? Harshit C Desai UX

    India - 2013 IIM- Bangalore
  3. Introducing UX Fellows • Worldwide user experience research • 23

    partner companies • Joint quality levels and processes • UX expertise + local culture expertise • UX expertise + local culture expertise
  4. Introducing UX Fellows High quality UX research in 35+ countries

  5. Introducing • Started in 2008 end as a new division

    of Indigo Consulting Team •Multidisciplinary team - Backgrounds include Communication Design, Interaction Design, Social Psychology and Management Studies Design, Social Psychology and Management Studies •All members are trained and certified usability analysts Expertise •Cognitive psychology, Design research, Usability Heuristics and Best practices, Wireframing •Conducted workshop and training sessions on usability techniques and practices
  6. C: I like! B: I guess I ate something wrong

    A: I think I need to see a dentist D: That meal is really tasty What are these people trying to tell us? D: That meal is really tasty
  7. Freehand gesture technology is entering our lives

  8. Pointing gestures and semantic gestures

  9. Pointing gestures

  10. Semantic gestures • Gestures with an associated meaning • No

    need for an additional GUI • Potentially more efficient Challenges • Presumably influenced by local cultures • Some cultures might be more predisposed to the use of gestures than others Semantic gesture for mission control on a Mac
  11. The UX Fellows Gesture Study

  12. The UX Fellows Gesture Study Which semantic gestures would people

    from various cultures spontaneously use to control consumer electronic devices? • Country differences? • Country clusters? • Underlying metaphors? • Acceptance?
  13. We compared spontaneous gesture behavior in 18 countries. RU CN

    CA US ES FR UK IT FI DE NL BE KR TR IN AU AR MX
  14. Setting 15 min Warm-up: everyday gestures

  15. Examined Commands Switch on device Volume up Channel up Context

    info for current program Channel down backward navigation in menus Confirm on-screen dialog (OK) Deny on-screen dialog (cancel) Pause video-on-demand (VOD) Restart VOD P+ P- Channel down Share current program Volume down Mute volume Pause current program Homepage EPG Restart VOD Fast forward VOD Rewind VOD Skip chapter VOD Previous chapter VOD Stop VOD Switch off device P-
  16. Sample Persons who are able to imagine a gesture-control scenario

    for a TV. • Regular usage of a recent HD flat TV (max. 5-6 years of age) and other CE devices and services • High interest in consumer electronics • Regular usage of a touch device • No Xbox Kinect and gesture-enabled TV users • Potential buyers of international "premium" CE brands (no national, retailer or "no name" brands)
  17. Sample sample economic background socio-economic background country

  18. Sample 51% 49% 65 years 18 countries x 20 subjects

    max 51% 49% 16 32 x 20 subjects = 360 participants min mean
  19. The Results

  20. Elaboration

  21. Difficulty of TV-related gestures 1.5 2.0 2.5 3.0 3.5 difficulty

    1.0 1.5 Self-reported difficulty, 5 = very difficult, 1 = very easy, n = 360 tech-savvy CE consumers in 18 countries
  22. Commonality of gestures 4 6 8 10 12 14 16

    18 no. of countries high medium low 0 2 4 no. of countries with the same main gesture no. of countries
  23. Some general insights

  24. Average gesture difficulty by country 2.5 3.0 Everyday gestures CE

    gestures difficulty max 5,0 … 1.0 1.5 2.0 TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK difficulty min
  25. Average gesture difficulty by country 2.5 3.0 CE gestures difficulty

    max 5,0 … 1.0 1.5 2.0 FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR difficulty min
  26. Gesture difficulty by countries FR CN TR IN AR RU

    MX US IT DE AU FI CA BE ES NL UK KR Volume down Pause VOD Channel down Rewind VOD Volume up Deny on-screen dialog (cancel) Channel up Confirm on-screen dialog (OK) Switch off device Switch off device Fast forward VOD Switch on device Restart VOD Mute volume Previous chapter VOD Pause current program Stop VOD Skip chapter VOD backward navigation in menus Context info for current program EPG Homepage Share current program
  27. Gesture difficulty by countries FR CN TR IN AR RU

    MX US IT DE AU FI CA BE ES NL UK KR Mean Volume down 1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2 1.5 Pause VOD 1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9 1.5 Channel down 1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1 1.6 Rewind VOD 1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5 1.7 Volume up 1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3 1.8 Deny on-screen dialog (cancel) 1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5 1.8 Channel up 1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2 1.8 Confirm on-screen dialog (OK) 1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3 1.9 Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9 Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9 Fast forward VOD 1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5 1.9 Switch on device 2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6 2.0 Restart VOD 1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0 2.0 Mute volume 1.4 1.7 1.3 1.5 1.7 1.8 2.3 1.8 1.7 2.1 1.9 2.2 2.4 2.5 2.4 2.4 2.0 2.7 2.0 Previous chapter VOD 1.0 1.7 1.7 1.7 2.2 1.8 1.4 2.0 2.1 1.7 1.8 2.0 2.0 2.3 1.3 3.0 2.7 3.3 2.0 Pause current program 2.1 1.6 1.5 1.7 1.4 1.7 2.5 1.6 1.9 2.2 2.0 2.2 2.1 2.2 2.6 2.4 2.2 3.1 2.0 Stop VOD 2.3 1.9 2.3 1.7 2.0 1.7 1.3 1.4 2.0 1.9 1.9 2.1 2.0 2.1 2.8 2.2 2.4 3.3 2.1 Skip chapter VOD 1.7 1.7 1.7 2.1 2.3 2.1 1.4 2.1 2.3 2.0 2.2 2.1 2.6 2.8 1.6 2.9 3.1 3.4 2.2 backward navigation in menus 1.4 2.1 2.1 1.9 2.5 2.0 1.3 2.3 2.5 2.1 2.7 2.3 2.2 2.2 3.6 2.9 2.2 3.4 2.3 Context info for current program 2.7 2.3 2.5 2.2 2.5 2.4 2.6 3.1 2.4 2.8 2.7 2.5 3.2 2.9 3.2 3.4 3.8 3.2 2.8 EPG 2.4 2.2 2.6 2.4 2.8 3.5 3.7 2.4 2.4 2.6 2.7 2.9 2.9 2.7 3.2 3.2 3.0 3.9 2.8 Homepage 3.7 2.2 2.3 2.2 2.7 2.4 3.8 3.1 2.0 2.9 2.7 3.0 3.0 3.3 3.7 3.4 3.3 3.7 2.9 Share current program 2.4 2.1 1.9 2.4 3.3 2.4 3.9 2.9 3.4 3.5 3.8 3.7 4.2 2.6 4.2 3.8 4.5 3.2 3.2 Mean 1.7 1.7 1.7 1.8 1.9 1.9 1.9 1.9 1.9 2.0 2.1 2.1 2.2 2.3 2.3 2.4 2.6 2.8
  28. General acceptance • Our 360 tech-savvy participants responded very positively

    to the idea of semantic gesture input for TVs. "fun to use", "convenient", "coolness factor" • Participants would like to use gestures to control other devices as well (e.g. audio). devices as well (e.g. audio).
  29. Operation Many participants felt that voice and sound could be

    a good support for gesture input. Can the TV hear me? waking up the device with a sound
  30. Gesture type preference FR CN TR IN AR RU MX

    US IT DE AU FI CA BE ES NL UK KR Semantic FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ Semantic 15 FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ Semantic 15 Pointing Many users would prefer switching between gesture types. Pointing Pointing 9 associated with more advanced commands
  31. Typical concerns of users • Learning and retention of gestures

    (but: would be easy if based on implicit behavior repertory) • Sensitivity and accuracy of devices • Interference by other gestures in the room • Compatibility with lean-back disposition
  32. Conclusions

  33. Conclusions 1. For basic CE commands a common language for

    semantic gestures already exists across cultures. 2. More complex commands could be realized by either a. customizing these gestures for each individual market a. customizing these gestures for each individual market b. customizing individually c. proposing a set of semantic gestures that need to be learned (the study provides some suggestions) d. switching to pointing gestures in combination with a GUI 3. It is necessary to consider cultural differences at a country level when it comes to designing advanced gesture control for globally marketed devices.
  34. Thank You harshit.desai@indigo.co.in