Course Review - Lecture 12 - Next Generation User Interfaces (4018166FNR)

This lecture forms part of a course on Next Generation User Interfaces given at the Vrije Universiteit Brussel.

Transcript

1. 2 December 2005 Next Generation User Interfaces Course Review Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel beatsigner.com
2. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 2 May 23, 2022 Course Summary 1. Introduction ▪ history of human-computer interaction - analogue computers, direct manipulation, mouse, desktop metaphor, innovative forms of interaction ▪ interface types ▪ natural user interfaces 2. Interaction Design ▪ interaction design process (lifecycle model) - establish requirements, design alternatives, prototyping, evaluation ▪ usability and user experience goals ▪ design principles ▪ examples of good and poor design ▪ interaction design approaches - e.g. user-centred design
3. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 3 May 23, 2022 Course Summary … 3. Requirements Analysis, Prototyping and Evaluation ▪ types of requirements - functional requirements, data requirements, environmental requirements, … ▪ different forms of data gathering and analysis for requirements - interviews, focus groups, direct observation, … ▪ prototyping - low fidelity vs. high fidelity - vertical vs.horizontal ▪ types of evaluation - controlled vs.natural setting ▪ DECIDE evaluation framework ▪ usability testing and field studies ▪ inspections and analytics ▪ GOMS model, keystroke level model and Fitts’s law
4. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 4 May 23, 2022 Course Summary … 4. Information Architectures ▪ personal information management ▪ memory types ▪ PIM systems ▪ RSL metamodel, cross-media PIM and MindXpres ▪ paper: Towards Cross-Media Information Spaces and Architectures 5. Multimodal Interaction ▪ human senses ▪ Bolt's "Put-that-there" ▪ multimodal fusion and fission ▪ ten myths of multimodal interaction ▪ CASE model and CARE properties
5. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 5 May 23, 2022 Course Summary … 6. Pen-based Interaction ▪ history and affordances of pen and paper ▪ digital pen and paper solutions ▪ iPaper research ▪ innovative hardware and materials - printed electronics, AR headsets, … 7. Interactive Tabletops and Surfaces ▪ multi-user tabletop interfaces ▪ enabling technologies and frameworks - resistive, surface capacitive and projected capacitive touch panels, SAW ▪ applications
6. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 6 May 23, 2022 Course Summary … 8. Gesture-based Interaction ▪ gesture types - semiotic, ergotic and epistemic gestures ▪ gesture recognition devices ▪ gesture design guidelines ▪ gesture spotting and recognition solutions ▪ paper: Gestural Interfaces: A Step Backward In Usability 9. Tangible, Embedded and Embodied Interaction ▪ history of graspable and tangible user interfaces ▪ applications ▪ tangible bits and radical atoms ▪ tangible holograms (TangHo) and dynamic data physicalisation ▪ paper: Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials
7. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 7 May 23, 2022 Course Summary … 10.Virtual and Augmented Reality ▪ technologies - large screen, BOOM, CAVE, head-mounted display ▪ VR navigation and interaction techniques ▪ augmented reality techniques - magic lens, magic mirror, magic eyeglass, optical/video see-trough HMDs ▪ applications 11.Implicit Human-Computer Interaction ▪ context ▪ intelligibility ▪ affective computing ▪ emotion classification models ▪ emotion recognition modalities
8. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 8 May 23, 2022 Exam ▪ Exams will take place on June 19/20, 2023 ▪ Oral exam in English (20 mins slot) ▪ covers content of lectures and exercises ▪ counts 40% for the overall grade ▪ 5 mins questions about the assignment ▪ 15 mins questions about the course content (no preparation time) ▪ You will have to register for a specific examination slot ▪ Overall grade = oral exam (40%) + assignment (60%) ▪ students have some flexibility in distributing the grades for the assignment (±2 points) - by default all team members get the same grade for assignment - send us an email before June 5, 2023 if you want to change the distribution
9. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 9 May 23, 2022 Exam … ▪ Submission of the assignment, source code and video via email to Maxim (mvdewync@vub.be) ▪ deadline: May 28, 24:00 (UTC+1) ▪ The exam will cover all the content presented in the lectures as well as any additional information from the exercise sessions ▪ includes the videos shown in some of the lectures ▪ Make sure that you understand the basic concepts ▪ however, we might ask questions at any level of detail to evaluate your knowledge ▪ Make sure that you can report about any aspects of the assignment
10. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 10 May 23, 2022 Exam … ▪ Remember to read the following three papers as they form part of the course material ▪ B. Signer, Towards Cross-Media Information Spaces and Architectures, Proceedings of the 13th International Conference on Research Challenges in Information Science (RCIS 2019), Brussels, Belgium, May 2019 - https://beatsigner.com/publications/towards-cross-media-information-spaces- and-architectures.pdf ▪ D.A. Norman and J. Nielsen, Gestural Interfaces: A Step Backward In Usability, interactions, 17(5), September 2010 - https://doi.org/10.1145/1836216.1836228 ▪ H. Ishii, D. Lakatos, L. Bonanni and J.-B. Labrune, Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials, interactions, 19(1), January 2012 - https://doi.org/10.1145/2065327.2065337
11. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 11 May 23, 2022 01001000100 0101001100010010100010010 0100100010010001000100001001000 100010001100001001000110010101010110 1100010010100010010010010100010101011001 101001100001100 101010100 0010100 100 110101010101 00100 01010101000 1001 1111111111 111 0000000010 0 11111111 0101001011 010101010 111010101 001010010110 Next Generation User Interfaces @WISE
12. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 12 May 23, 2022 Prof. Dr. Beat Signer Cross-MediaTechnology, Interac- tive Paper, Data Physicalisation Dr. Audrey Sanctorum User-defined XDI and IoT Inter- action, Human-AI Interaction CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation WEB & INFORMATION SYSTEMS ENGINEERING CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Maxim Van de Wynckel Hybrid Positioning, Implicit Human-Computer Interaction Yoshi Malaise Technology-enhanced Learning, Content-driven Presentations
13. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 13 May 23, 2022 WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Ekene Attoh IoT Middleware, Context-aware Computing, Implicit HCI Isaac Valadez Knowledge Physicalisation and Augmentation, Tangible UIs Xuyao Zhang Extensible Platform for Dynamic Data Physicalisation Ingela Rossing Dynamic Data Physicalisation Framework and Guidelines
14. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 14 May 23, 2022 WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Arun Sojan Physicalisation for Digital Twins Piet Van Der Paelt Julia-based Framework for Simulation and Optimisation Evan Cole Technology-enhanced Learning, Study Lenses Migdeily Cantera End-User Development, Mixed Reality IoT UIs, Intelligibility
15. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 15 May 23, 2022 Are You Interested in a Thesis? ▪ Various possibilities for BA, MA and PhD theses ▪ Data Physicalisation - extensible dynamic data physicalisation platform and framework ▪ Innovative Mixed Reality Interfaces - augmented realty board, museum guides, … ▪ Personal Information Management (PIM) ▪ Technology-enhanced Learning ▪ End-User Development and Human-AI Interaction ▪ Hybrid Positioning and Implicit Human-Computer Interaction ▪ Smart Environments and Cross-Domain Internet of Things (IoT) ▪ Next Generation Presentation Solutions (e.g. MindXpres) ▪ ... ▪ Do you have your own ideas? Come along to discuss them ... - https://wise.vub.ac.be/thesis-proposals
16. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 16 May 23, 2022 Video: Microsoft Productivity Vision (2015)
17. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 17 May 23, 2022 References ▪ Microsoft Productivity Future Vision (2015) ▪ https://www.youtube.com/watch?v=w-tFdreZB94
18. 2 December 2005 Next Generation User Interfaces The End Good Luck with the Exam!