Upgrade to Pro — share decks privately, control downloads, hide ads and more …

PhD defense presentation

PhD defense presentation

Presentation for my PhD defense at University of Minho 29 January 2014.

Jorge C. S. Cardoso

January 29, 2014
Tweet

More Decks by Jorge C. S. Cardoso

Other Decks in Education

Transcript

  1. An Interaction Abstraction Toolkit
    for Public Display Applications
    Jorge C. S. Cardoso
    [email protected]
    http://jorgecardoso.eu

    View Slide

  2. Outline
    ● Motivation
    ● Objective
    ● Challenges
    ● Interaction Abstractions
    ● Evaluation
    ● Conclusion

    View Slide

  3. Motivation: “We need to do better”

    View Slide

  4. Motivation
    Each display uses its own approach to
    interactivity

    View Slide

  5. Objective: Interaction abstractions for
    public displays
    “toolkits for novel and perhaps unfamiliar application areas enhance the
    creativity of these programmers. By removing low-level implementation burdens
    and supplying appropriate building blocks, toolkits give people a ‘language’ to
    think about these new interfaces, which in turn allows them to concentrate on
    creative designs.” - Greenberg, S. (2007). Toolkits and interface creativity.
    Multimedia Tools and Applications, 32(2), 139–159.

    View Slide

  6. Interaction in public displays
    Focus
    ● Generic information displays
    ● Multi-user
    ● Shared environment
    ● Multiple input devices

    View Slide

  7. Interaction in public displays
    Challenges
    ● Very different interaction environment
    ○ What kind of abstractions are useful?
    ● No accepted interaction paradigms
    ○ No accepted set of “controls”
    ● Variety of interaction mechanisms

    View Slide

  8. SMS

    View Slide

  9. QR Codes

    View Slide

  10. Gestures

    View Slide

  11. Bluetooth

    View Slide

  12. Touch

    View Slide

  13. Keyboard + trackball!

    View Slide

  14. What kind/level of abstractions?
    ● Footprints for socially-aware
    display systems
    ○ Designers
    ● User Interaction Controls
    ○ Developers

    View Slide

  15. Footprints for socially-aware display
    systems
    What information can the display gather from interactions
    that can be used for context-aware content adaptation?
    Focus on adaptation to the social situation around the
    display
    Abstract interaction mechanisms and application semantics

    View Slide

  16. Footprints for socially-aware display
    systems
    ❏ Cardoso, J. C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to
    Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin / Heidelberg. doi:10.1007/978-3-642-05290-
    3_21
    ❏ Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.),
    Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7

    View Slide

  17. Footprints for socially-aware display
    systems

    View Slide

  18. User Interaction Controls
    ❏ Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on Human-Computer Interaction.
    (under review)

    View Slide

  19. PuReWidgets toolkit for web-based public display
    applications
    ● High-level abstractions
    ○ Widgets
    ● Various controls
    ○ Action buttons, list boxes, text entry, download, upload, checkin
    ● Independence from interaction mechanism
    ❏ Cardoso, J. C. S., & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the 11th International
    Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press. doi:10.1145/2406367.2406434 (Demo)
    ❏ Cardoso, J. C. S., & José, R. (2012). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on Pervasive Displays. Porto,
    Portugal. (Poster)
    ❏ Cardoso, J. C. S., & José, R. (2012). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac Campos, Simone D. J.
    Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems -
    EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496

    View Slide

  20. Widgets

    View Slide

  21. Interaction
    Touch Text-based
    (SMS, email, …)
    QR codes Mobile
    interface
    (Automatically
    generated)
    ❏ Cardoso, J. C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th
    International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS -
    Science and and Technology Publications. doi:10.5220/0004707500050013

    View Slide

  22. Toolkit evaluation
    Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle
    System scalability
    API usability
    Real-world deployment
    ❏ Cardoso, J. C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th International Conference
    on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press. doi:10.1145/2541831.2541834
    ❏ Cardoso, J. C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In R. Meersman, T. Dillon, & P. Herrero (Eds.), On the
    Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg. doi:10.1007/978-3-642-25126-9_67

    View Slide

  23. Conclusion: Summary of contributions
    1. A framework of digital footprints that designers of public displays can use to map several sensing and interaction
    features to content adaptation strategies.
    2. A design space of interaction tasks and controls that can serve as a basis for programming toolkits that provide
    high-level interaction widgets.
    3. Identification of the fundamental requirements for an interaction abstraction toolkit for public displays.
    4. The PuReWidgets software toolkit itself for incorporating interactive features into public display applications
    5. An in-breadth evaluation of the PuReWidgets toolkit along several dimensions, including the system’s
    performance and scalability, the API usability, and a real-world deployment.
    6. Open-source software projects, allowing anyone to use, modify, and adapt for further research and development.
    ● https://code.google.com/p/purewidgets/
    i. – The PuReWidgets toolkit .
    ii. – Three interactive public display applications
    ● https://code.google.com/p/public-display-scheduler/ A Google Chrome extension that serves as an
    application scheduler for public displays.

    View Slide

  24. Conclusion: Summary of contributions
    1. Cardoso, Jorge C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th
    International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS - Science
    and and Technology Publications.
    2. Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on Human-
    Computer Interaction. (under review)
    3. Taivan, C., Rui José, Silva, B., Elhart, I., & Cardoso, J. (2013). Design considerations for application selection and control in multi-user public displays.
    JUCS special issue: Towards Sustainable Computing through Ambient Intelligence.
    4. Cardoso, Jorge C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th
    International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press.
    5. José, R., Cardoso, J., Alt, F., Clinch, S., & Davies, N. (2013). Mobile applications for open display networks: common design considerations. In
    Proceedings of the 2nd ACM International Symposium on Pervasive Displays -- PerDis ’13 (pp. 97–102). ACM. doi:10.1145/2491568.2491590
    6. Cardoso, Jorge C S, & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the
    11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press.
    7. Cardoso, Jorge C. S., & José, R. (2012a). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on
    Pervasive Displays. Porto, Portugal. Retrieved from http://dx.doi.org/10.6084/m9.figshare.92165
    8. Cardoso, Jorge C. S., & José, R. (2012b). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac
    Campos, Simone D. J. Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on
    Engineering interactive computing systems - EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496
    9. Cardoso, Jorge C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In Robert Meersman, T. Dillon, & P.
    Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg.
    10. Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D.
    E. Michelis (Eds.), Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7
    11. Cardoso, Jorge C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon
    (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin /
    Heidelberg.

    View Slide

  25. Conclusion
    ● We need better tools to create applications
    for open display networks
    ○ Interaction abstractions
    ● PuReWidgets is just one attempt/model

    View Slide

  26. An Interaction Abstraction Toolkit
    for Public Display Applications
    Jorge C. S. Cardoso
    [email protected]
    http://jorgecardoso.eu

    View Slide