Slide 1

Slide 1 text

“Siri, did I leave the oven on?” Mundane UX design for the connected home Claire Rowland @clurr Thursday, 27 September 2012

Slide 2

Slide 2 text

Whatʼs the odd one out? friends shopping leisure interests family home travel work Thursday, 27 September 2012

Slide 3

Slide 3 text

Whatʼs the odd one out? home Thursday, 27 September 2012 Your home is the one significant thing in your life that you canʼt stay in contact with online. Itʼs a big dumb box of mostly dumb things that canʼt talk to you, or each other.

Slide 4

Slide 4 text

Thursday, 27 September 2012

Slide 5

Slide 5 text

Opinions are entirely my own :) Thursday, 27 September 2012 And the interfaces that I can show right now, I am not responsible for designing.

Slide 6

Slide 6 text

Whatʼs a connected home? Thursday, 27 September 2012

Slide 7

Slide 7 text

Embedded computing in everyday objects... ...connected up to the internet Thursday, 27 September 2012 Sensors and controllers around the home, embedded computing in everyday objects, and connecting it all up to the internet so you can access and control it via web and phone. Currently that allows you to do things like...

Slide 8

Slide 8 text

Understand energy use... Energy clamp In-home display Smart plug Web and mobile interfaces Thursday, 27 September 2012 This is AlertMeʼs current energy service.

Slide 9

Slide 9 text

Control your heating... Thursday, 27 September 2012 This is AlertMeʼs current remote heating controller.

Slide 10

Slide 10 text

Camera Contact sensor Key fobs Motion sensor Secure your home Thursday, 27 September 2012 AlertMe home security.

Slide 11

Slide 11 text

Thereʼs more... Holiday home, recreational vehicle, car and boat monitoring Connected light bulbs, electrical sockets and door locks Aging in place: panic buttons, activity monitoring Connected appliances: ovens, dishwashers, tumble dryers Pet care: connected catflaps, automated feeders Safety devices: gun cabinets (US!) Thursday, 27 September 2012

Slide 12

Slide 12 text

This home automation stuff has been around for ages though, hasnʼt it? Thursday, 27 September 2012

Slide 13

Slide 13 text

Connected home technology has existed since at least as far back as 1975... This is X10 Powerhouse for the Commodore 64, from 1986. Thursday, 27 September 2012 It let you schedule lights and appliances to turn on and off, control a burglar alarm and thermostat, and could be operated remotely by telephone. Those are pretty much the things Iʼm working on right now. Except the telephoneʼs got a bit smaller and now we have the internet. Well, yeah, actually.

Slide 14

Slide 14 text

...but you had to be rich... Thursday, 27 September 2012

Slide 15

Slide 15 text

•It was difficult to install •Too many competing and proprietary standards meant poor interoperability •Usability was poor ...and/or a geek Thursday, 27 September 2012 For most people, the benefits just didnʼt outweigh the cost

Slide 16

Slide 16 text

•Itʼs getting cheaper •Wireless technologies make installation easier •More open standards increase interoperability •Design is (slowly) improving to make it easier for non- geeks Things are changing... Thursday, 27 September 2012

Slide 17

Slide 17 text

People are more accustomed to “little bits of smartness”... Thursday, 27 September 2012 embedded computing and even intelligence. my rice cooker is an AI: it uses fuzzy logic to figure out how long to cook for.

Slide 18

Slide 18 text

...and we have a metaphor for the “remote control for your life” Thursday, 27 September 2012

Slide 19

Slide 19 text

The challenges now are less in the technology... and more in understanding and delivering what the mass market actually needs Thursday, 27 September 2012 NB: big UX opportunity

Slide 20

Slide 20 text

“Connected” “home” The industry is better at this bit... Thursday, 27 September 2012 Itʼs still quite technology led.

Slide 21

Slide 21 text

“Connected” “home” ...than this bit Thursday, 27 September 2012 No good at designing it in ways that work in home environment. This is where UX comes in. With my colleagues, I have been working on understanding what this technology could do for people, where it often goes wrong for people, and defining what I think a good connected home UX might look like. These come from reviewing competitors, academic research, and our own concept testing...

Slide 22

Slide 22 text

5 key UX challenges Thursday, 27 September 2012 There are many, here are 5...

Slide 23

Slide 23 text

UX challenge 1: Get the design metaphor right Thursday, 27 September 2012

Slide 24

Slide 24 text

AT&T Thursday, 27 September 2012

Slide 25

Slide 25 text

Greenwave Reality Thursday, 27 September 2012

Slide 26

Slide 26 text

Home Automation Ltd (yes, really) Thursday, 27 September 2012

Slide 27

Slide 27 text

Spot the design metaphor? Thursday, 27 September 2012

Slide 28

Slide 28 text

Spot the design metaphor? Thursday, 27 September 2012

Slide 29

Slide 29 text

•System has users and peripheral devices •Users have access permissions, are in or out •One phone/keyfob = one user •Program home for optimal efficiency! Thursday, 27 September 2012 This is the (very old) AlertMe home monitoring homepage.

Slide 30

Slide 30 text

“Users could manage their deployment.” The Microsoft Home OS team Thursday, 27 September 2012 The Microsoft HomeOS team take the view that this is right. People understand computers, with users, access permissions and suchlike, and that that makes this a suitable metaphor for a smarthome. This causes them to say things like “Users could manage their deployment.” Iʼm sure theyʼre very smart but this is boring corporate IT speak and most of us donʼt want to take that home with us.

Slide 31

Slide 31 text

ʻRomantikʼ mode: an engineering solution to a human non-problem Thursday, 27 September 2012 Modes are a common smart home feature. But they require a lot of planning and advance configuration. Which isnʼt very sexy.

Slide 32

Slide 32 text

Real life is too messy to program •People are generally a bit disorganised and bad at predicting their future needs •Life is full of contradictions and exceptions •Devices are shared, and lent •Whoʼs allowed to do what is negotiated and flexible, not completely codified Thursday, 27 September 2012 e.g. Little Jack isnʼt normally allowed to watch that much TV, but today heʼs ill so youʼre feeling sorry for him e.g. The sheets ought to be washed but everyoneʼs busy so theyʼll do for a bit longer.

Slide 33

Slide 33 text

We already have a perfectly good metaphor for the home: Itʼs the home This one happens to be my home. I donʼt want to log into it, become a super user, or worry that itʼs going to crash or need debugging. sudo open-window Thursday, 27 September 2012

Slide 34

Slide 34 text

Most of all, itʼs my refuge: the last place in the world I want to feel out of control. And weʼve all seen how people often feel out of control of computers when they are too hard to use or do things we donʼt understand. Thursday, 27 September 2012

Slide 35

Slide 35 text

The design metaphor also influences aesthetics Thursday, 27 September 2012 Is this what being at home feels like?

Slide 36

Slide 36 text

Comcast Xfinity Thursday, 27 September 2012 Comcast XFinity alarm system screenshots. Features words like DISARM and ALL QUIET and a big red circle that looks a bit like HAL.

Slide 37

Slide 37 text

Just because my home is connected doesnʼt mean it should stop feeling like home: a safe and comfortable place. It just got a bit smarter, thatʼs all. Thursday, 27 September 2012

Slide 38

Slide 38 text

UX challenge 2: A home is a complex social context Thursday, 27 September 2012

Slide 39

Slide 39 text

•There is often more than one person in a house •They have interpersonal dynamics •They may want different things •Some of them are visitors or impromptu guests Thursday, 27 September 2012

Slide 40

Slide 40 text

“My teenagers skulk in their bedrooms. Theyʼre not out, but theyʼre not really in either...” Thursday, 27 September 2012

Slide 41

Slide 41 text

•A connected home surfaces information about what is happening within it •Itʼs often possible to work out who is in, out, turning the heating up all the time, or on the Playstation •When parties have different ideas about how things should be, that surfaces tensions 21 °C 19 °C Thursday, 27 September 2012 Itʼs a healthy and necessary part of most relationships to have the right to some private space, and to ignore or pretend not to notice some of the other personʼs behaviours. Technology makes this harder.

Slide 42

Slide 42 text

Tension between the person who uses the energy monitor and the people who use the appliances is common Thursday, 27 September 2012 Tumble dryers are a particular source of angst.

Slide 43

Slide 43 text

Who came in at what time? (Did they look drunk? Was anyone with them?!!) How long did the cleaner really stay? If this information is up on the internet, who might get access to it? Presence surfaces trust and privacy issues Thursday, 27 September 2012

Slide 44

Slide 44 text

UX challenge 3: “People donʼt want more control of their homes. They want more control of their lives” Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, Anind K. Dey: Principles of Smart Home Control (Ubicomp 2006) Thursday, 27 September 2012

Slide 45

Slide 45 text

•The computer centric model focuses on surfacing lots of information and controls and programming sequences of actions •It requires a lot of conscious effort and attention Thursday, 27 September 2012

Slide 46

Slide 46 text

Attention is a precious commodity Thursday, 27 September 2012

Slide 47

Slide 47 text

•A lot of what goes on in the home is actually pretty unremarkable and mundane •We develop routines to help us stay on top of the boring stuff without too much conscious effort •This allows us to save our attention for important or interesting things Thursday, 27 September 2012

Slide 48

Slide 48 text

My washing machine behaves as if washing clothes was the most urgent and important thing in my life Thursday, 27 September 2012 It beeps when itʼs finished a load. That is fine. But it doesnʼt stop beeping until you empty it. It expects you to drop everything and come running, right now, because the washing must come out IMMEDIATELY. This is appropriate behaviour from a burglar alarm, but not a washing machine.

Slide 49

Slide 49 text

What if you had a whole home full of needy, attention seeking devices?... Thursday, 27 September 2012

Slide 50

Slide 50 text

..with a whole load of new and unusual ways to break down? Thursday, 27 September 2012

Slide 51

Slide 51 text

Spend too much time Facebooking your house and your partner might leave you Thursday, 27 September 2012 Ericsson made a video about the social web of things, in which a manʼs home and his appliances all talk to each other (and him) via some weird kind of Facebook analog. It is meant to look easy but he seems to spend a lot of his time in idle chat with his house. Right at the end, his girlfriend dumps him and he spends the rest of his evening alone with the house. Apparently this is a promotional video.

Slide 52

Slide 52 text

Do the boring stuff Iʼm rubbish at so that I can spend time thinking about more interesting things Thursday, 27 September 2012

Slide 53

Slide 53 text

User instructions: 1) Ignore it Thursday, 27 September 2012 Wattbox - intelligent heating controller (prototype hardware shown).

Slide 54

Slide 54 text

UX challenge 4: We canʼt rely on existing mental models Thursday, 27 September 2012

Slide 55

Slide 55 text

Primary aim is deterrence Makes a loud noise Sensors are just part of the alarm Might call the police Existing mental models... Thursday, 27 September 2012

Slide 56

Slide 56 text

May not be visible/ audible outside Multiple actions possible: cameras, messaging, lights... Sensor data is highly visible Primary aim is peace of mind ...may not map well Thursday, 27 September 2012 Monitoring has some of the properties of a burglar alarm, but not all. But it does a lot of extra stuff too. Thinking of it as a burglar alarm doesnʼt help you understand it.

Slide 57

Slide 57 text

“When itʼs cold you need to turn the heating on.” Some mental models are wrong to start with Thursday, 27 September 2012

Slide 58

Slide 58 text

“My thermostat is too confusing to use so when I want to turn the heating up I put it in the fridge.” NB: this might sound silly but itʼs far more logical: Thursday, 27 September 2012

Slide 59

Slide 59 text

...and sometimes people just have illogical habits or beliefs that challenge our assumptions about what to design “I donʼt set my burglar alarm when Iʼm only going out for a few hours.” Thursday, 27 September 2012

Slide 60

Slide 60 text

Sometimes we have to make new mental models, or fix broken ones At a glance, show: what it does, when, which devices are involved, and who will be affected Be forgiving: mitigate the impact of ʻincorrectʼ usage Thursday, 27 September 2012

Slide 61

Slide 61 text

UX challenge 5: Many layers of UX Thursday, 27 September 2012

Slide 62

Slide 62 text

Physical hardware design, boxes and help guides Thursday, 27 September 2012

Slide 63

Slide 63 text

Device, web and mobile interfaces Thursday, 27 September 2012

Slide 64

Slide 64 text

Cross-device interactions, aka interusability See http://bugi.oulu.fi/~ksegerst/publications/p219-waljas.pdf Thursday, 27 September 2012 Interusability: usability for services composed of interconnected devices. Important to create the experience of interacting with the service, not just a device. See Minna Wäljas et al paper in the references. A number of aspects of interusability, like assigning the right interactions to the right devices and figuring out what degree of consistency is appropriate across the different devices and platforms.

Slide 65

Slide 65 text

Continuity: Seamless synchronisation of data and content Thursday, 27 September 2012 Perhaps the biggest challenge is continuity. If i interact with the service on one device, all other devices reflect that change in state. e.g. if I turn the target heating temperature up on my physical thermostat, the new temperature should be immediately reflected on the smartphone too otherwise thereʼll be a confusing period when I have two devices saying different things. Not that easy to implement!

Slide 66

Slide 66 text

The whole service experience needs considering purchase discover install set up in-life use support Thursday, 27 September 2012

Slide 67

Slide 67 text

Another big challenge: Doing complex UX on startup time Thursday, 27 September 2012

Slide 68

Slide 68 text

Minimum viable user research Review academic research: there’s lots of it I dream of time for ethno but right now, the focus is too broad, context too complex to manage it in the time I have Make wireframes and test in a lab... playing fast and loose with ecological validity No early adopters... they’re too unrepresentative Thursday, 27 September 2012

Slide 69

Slide 69 text

Mobile centric... but not quite mobile first The web is useful for testing conceptual models of new things: you can put lots of things in front of people at once and see how they interpret them Once a product's conceptual model is well defined, we focus most heavily on mobile, as the central control platform We zoom back out to web later Thursday, 27 September 2012

Slide 70

Slide 70 text

User-centred design has good tools for designing products energy Thursday, 27 September 2012

Slide 71

Slide 71 text

platform ...but isn’t yet geared towards designing platforms energy heating security lighting ? ? ? ? appliances ? Thursday, 27 September 2012 What the connected home needs is a platform: a framework for making all this stuff work together, and lots of new, unanticipated stuff too. User-centred design tools can be a bit too linear for this. For example, it’s impossible to define personas with any degree of specificity for general smart home, it's like defining personas for people who live in homes. You need different ones for different product lines, e.g. to reflect different motivations around energy (who's to say that the DIY fiend in home security is also the energy saver in heating? You have to look at fundamental logical structure of tasks and concepts and look for common components, like timers, danger warnings. You then apply UCD to explore each example. I don’t claim we’ve got this right yet and would love to find the right methods.

Slide 72

Slide 72 text

Ultimately itʼs a very broad challenge: Letʼs make all kinds of things for people who live in homes! Thursday, 27 September 2012 A complex and worthy challenge, and one many more of us will be getting involved in.

Slide 73

Slide 73 text

Thank you @clurr [email protected] Thanks to: Alex von Feldmann, Fraser Hamilton, Martin Storey, Naintara Land and Anna Kuriakose who have contributed insights, thinking and research to this presentation Thursday, 27 September 2012

Slide 74

Slide 74 text

Fuck Buttons by Matt Biddulph House by lilivanili Office by Phil Whitehouse Shopping basket by Jonathan Harford X10 Powerhouse from commodore.ca Internet fridge from fuckyeahinternetfridge.tumblr.com Messy House by Elizabeth Table4Five Trapped by Merina Computer by Phil Gold Crying child by eggonstilts Army from hdwallpapers.com Tea cosy by Brixton Makerhood Teeth by ktpupp Sleeping by Stan Frustration by dieselbug2007 Washing machine firmware error by Adam Crickett Houses by Peter O, Clive Darr, hollandhistory.net Usabilty lab by Leanne Waldal Burglar by homesecurityfocus.com Mongkok advertising by Slices of Light Posh house by Savant Toronto Teenage bedroom by Wendizzle HAL smarthome by james.lipsit.com Jack Black from bradley.chattablogs.com Holiday home: geograph.co.uk Older woman: soylentgreen23 Thanks for the photos Thursday, 27 September 2012

Slide 75

Slide 75 text

S Intille, The goal: Smart people not smart homes (2006) http://web.media.mit.edu/~intille/papers-files/IntilleICOST06.pdf Minna Wäljas, Katarina Segerståhl, Kaisa Väänänen-Vainio-Mattila, Harri Oinas- Kukkonen: Cross-Platform Service User Experience: A Field Study and an Initial Framework (Nordichi 2010) http://bugi.oulu.fi/~ksegerst/publications/p219-waljas.pdf Colin Dixon, Ratul Mahajan, Sharad Agarwal, AJ Brush, Bongshin Lee, Stefan Saroiu, and Victor Bahl, An Operating System for the Home (NSDI, USENIX, April 2012) Pertti Huuskonen: Run to the Hills! Ubiquitous Computing Meltdown (Advances in Ambient Intelligence, 2007) Peter Tolmie, James Pycock, Tim Diggins. Allan Maclean, Alain Karsenty, Unremarkable Computing (Ubiquity, 2002). Genevieve Bell & Paul Dourish: Yesterdayʼs tomorrows: notes on ubiquitous computingʼs dominant vision (Personal and Ubiquitous Computing, 2006) http://www.ics.uci.edu/~jpd/ubicomp/BellDourish-YesterdaysTomorrows.pdf Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K. Dey: Principles of Smart Home Control (Ubicomp 2006) T Saizmaa, A Holistic Understanding of HCI Perspectives on Smart Home, Networked Computing and Advanced Information Management, 2008. NCM '08 Thanks for the research Thursday, 27 September 2012