Towards User-defined Cross-Device Interaction

Slide 1

Slide 1 text

Towards User-defined Cross-Device Interaction AUDREY SANCTORUM & BEAT SIGNER VRIJE UNIVERSITEIT BRUSSEL

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

0% 5% 10% 15% 20% 25% 30% 0 1 2 3 4 5 or more Percentage of users Number of devices How many connected devices do people use? Belgium Switzerland USA Spain Japan The Connected Consumer Survey 2014/2015 Google Inc. 65%

Slide 4

Slide 4 text

Conductor (2014) HuddleLamp (2014) Connichiwa (2015) Panelrama (2014) MultiSpace (2006) ReticularSpaces (2012)

Slide 5

Slide 5 text

Existing Classifications "The 4C Reference Model for Distributed User Interfaces" by Demeure et al. • computation, configuration, communication and coordination "Distributed User Interfaces: State of the Art" by Niklas Elmqvist • input, output, platform, space and time

Slide 6

Slide 6 text

UI + data + UI elements UI + data Table / Camera Room Network connection to the server Anywhere HuddleLamp MultiSpace ReticularSpaces Panelrama Conductor Connichiwa Granularity of distribution Location constraint

Slide 7

Slide 7 text

UI + data + UI elements UI + data Table / Camera Room Network connection to the server Anywhere HuddleLamp Airlift MultiSpace ReticularSpaces ARIS GroupTogether iLand iRoom Panelrama Conductor IMPROMPTU THAW Deep Shot Weave Connichiwa XDStudio WebSplitter Melchior et al. (2009) CAMELEON-RT Granularity of distribution Location constraint Robertson et al. (1996) Frosini et al. (2013) MultiMasher Pick-and-Drop End Users

Slide 8

Slide 8 text

How to allow end users to define customised cross-device interactions? How much control will end users have in terms of the granularity of the UI components to be distributed? Will end users be limited by a specific location, space or office setting? Will end users be able to share their configuration of customised DUIs? Can end users reuse parts of other configurations? What will end users be able to modify? …

Slide 9

Slide 9 text

Sound< /identiﬁer> … Active Component Architecture Active Components Resource/Selector Plug-ins Developer Registry Core RSL User Profile End-User Registry Configuration Pool User Developer Button 1 Signer and Norrie (2007)

Slide 10

Slide 10 text

Scenarios

Slide 11

Slide 11 text

Swipe AC Double Swipe AC Triple Swipe AC Direction AC Swipe Area TABLET Sound AC TV Runtime environment Runtime environment ... Gesture AC Play AC Data Transfer AC Data Transfer AC Proposed Approach

Slide 12

Slide 12 text

Authoring Rather Than Programming Swipe Gesture Device: Tablet Area Device: Tablet Data Transfer SDevice: Tablet TDevice: TV Play Device: TV Sound Device: TV Volume: 80% _ X   Components Data Transfer Play Sound Swipe Area Double Swipe Triple Swipe Direction ...

Slide 13

Slide 13 text

Conclusion • Classification of DUI systems • User-defined cross-device interactions • Linking UI components and application logic • hypermedia metamodel • at any level of granularity • Sharing of user-defined interactions

Slide 14

Slide 14 text

References • A. Sanctorum and B. Signer, Towards User-defined Cross-Device Interaction, Proceedings of DUI 2016, 5th Workshop on Distributed User Interfaces, Lugano, Switzerland, June 2016 • http://beatsigner.com/publications/sanctorum_DUI2016.pdf