Course Review - Lecture 12 - Next Generation User Interfaces (4018166FNR)

This lecture forms part of a course on Next Generation User Interfaces given at the Vrije Universiteit Brussel.

Transcript

1. 2 December 2005 Next Generation User Interfaces Course Review Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel beatsigner.com
2. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 2 May 13, 2024 Course Summary 1. Introduction ▪ history of human-computer interaction - analogue computers, direct manipulation, mouse, desktop metaphor, innovative forms of interaction ▪ interface types and natural user interfaces ▪ interaction design process (lifecycle model) - establish requirements, design alternatives, prototyping, evaluation ▪ types of requirements - functional requirements, data requirements, environmental requirements, … ▪ user-centred design ▪ prototyping - different forms of low-fidelity prototyping ▪ evaluation - why, what, where and when?
3. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 3 May 13, 2024 Course Summary … 2. Information Architectures ▪ personal information management ▪ memory types ▪ PIM systems ▪ RSL metamodel, cross-media PIM and MindXpres ▪ paper: Towards Cross-Media Information Spaces and Architectures 3. Multimodal Interaction ▪ human senses ▪ Bolt's "Put-that-there" ▪ multimodal fusion and fission ▪ ten myths of multimodal interaction ▪ CASE model and CARE properties
4. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 4 May 13, 2024 Course Summary … 4. Pen-based Interaction ▪ history and affordances of pen and paper ▪ digital pen and paper solutions ▪ iPaper research ▪ innovative hardware and materials - printed electronics, AR headsets, … 5. Interactive Tabletops and Surfaces ▪ multi-user tabletop interfaces ▪ enabling technologies and frameworks - resistive, surface capacitive and projected capacitive touch panels, SAW ▪ applications
5. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 5 May 13, 2024 Course Summary … 6. Gesture-based Interaction ▪ gesture types - semiotic, ergotic and epistemic gestures ▪ gesture recognition devices ▪ gesture design guidelines ▪ gesture spotting and recognition solutions ▪ paper: Gestural Interfaces: A Step Backward In Usability 7. Tangible, Embedded and Embodied Interaction ▪ history of graspable and tangible user interfaces ▪ applications ▪ tangible bits and radical atoms ▪ tangible holograms (TangHo) ▪ paper: Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials
6. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 6 May 13, 2024 Course Summary … 8. Virtual and Augmented Reality ▪ technologies - large screen, BOOM, CAVE, head-mounted display ▪ VR navigation and interaction techniques ▪ augmented reality techniques - magic lens, magic mirror, magic eyeglass, optical/video see-trough HMDs ▪ applications 9. Data Physicalisation ▪ advantages ▪ enabling technologies ▪ examples ▪ research challenges ▪ dynamic data physicalisation framework
7. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 7 May 13, 2024 Course Summary … 10.Implicit Human-Computer Interaction ▪ context ▪ intelligibility ▪ affective computing ▪ emotion classification models ▪ emotion recognition modalities 11.Human-AI Interaction ▪ challenges ▪ guidelines ▪ human-centred artificial intelligence (HCAI) ▪ HCAI framework ▪ prometheus design principles
8. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 8 May 13, 2024 Exam ▪ Exams will take place on June 6/7, 2024 ▪ Oral exam in English (20 mins slot) ▪ covers content of lectures and exercises ▪ counts for 40% of the overall grade ▪ 5 mins questions about the assignment ▪ 15 mins questions about the course content (no preparation time) ▪ You will have to register for a specific examination slot ▪ Overall grade = oral exam (40%) + assignment (60%) ▪ students have some flexibility in distributing the grades for the assignment (±2 points) - by default all team members get the same grade for assignment - send us an email before June 1, 2024 if you want to change the distribution
9. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 9 May 13, 2024 Exam … ▪ Submission of the assignment, source code and video via email to Maxim (mvdewync@vub.be) ▪ deadline: May 26, 24:00 (UTC+1) ▪ The exam will cover all the content presented in the lectures as well as any additional information from the exercise sessions ▪ includes the videos shown in some of the lectures ▪ Make sure that you understand the basic concepts ▪ however, we might ask questions at any level of detail to evaluate your knowledge ▪ Make sure that you can report about any aspects of the assignment
10. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 10 May 13, 2024 Exam … ▪ Remember to read the following three papers as they form part of the course material ▪ B. Signer, Towards Cross-Media Information Spaces and Architectures, Proceedings of the 13th International Conference on Research Challenges in Information Science (RCIS 2019), Brussels, Belgium, May 2019 - https://beatsigner.com/publications/towards-cross-media-information-spaces- and-architectures.pdf ▪ D.A. Norman and J. Nielsen, Gestural Interfaces: A Step Backward In Usability, interactions, 17(5), September 2010 - https://doi.org/10.1145/1836216.1836228 ▪ H. Ishii, D. Lakatos, L. Bonanni and J.-B. Labrune, Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials, interactions, 19(1), January 2012 - https://doi.org/10.1145/2065327.2065337
11. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 11 May 13, 2024 01001000100 0101001100010010100010010 0100100010010001000100001001000 100010001100001001000110010101010110 1100010010100010010010010100010101011001 101001100001100 101010100 0010100 100 110101010101 00100 01010101000 1001 1111111111 111 0000000010 0 11111111 0101001011 010101010 111010101 001010010110 Next Generation User Interfaces @WISE
12. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 12 May 13, 2024 Prof. Dr. Beat Signer Cross-Media Technology, Interac- tive Paper, Data Physicalisation Dr. Audrey Sanctorum User-defined XDI and IoT Inter- action, Human-AI Interaction CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation WEB & INFORMATION SYSTEMS ENGINEERING Maxim Van de Wynckel Hybrid Positioning, Implicit Human-Computer Interaction Yoshi Malaise Technology-enhanced Learning, Content-driven Presentations CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA)
13. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 13 May 13, 2024 WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Ekene Attoh IoT Middleware, Context-aware Computing, Implicit HCI Isaac Valadez Knowledge Physicalisation and Augmentation, Tangible UIs Xuyao Zhang Extensible Platform for Dynamic Data Physicalisation Ingela Rossing Dynamic Data Physicalisation Framework and Guidelines
14. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 14 May 13, 2024 WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Arun Sojan Physicalisation for Digital Twins Piet Van Der Paelt Julia-based Framework for Simulation and Optimisation Evan Cole Technology-enhanced Learning, Study Lenses
15. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 15 May 13, 2024 Are You Interested in a Thesis? ▪ Various possibilities for MA and PhD theses ▪ Data Physicalisation - extensible dynamic data physicalisation platform and framework ▪ Personal Information Management (PIM) ▪ Technology-enhanced Learning ▪ Innovative Mixed Reality Interfaces - augmented realty board, museum guides, … ▪ Next Generation Presentation Solutions (e.g.MindXpres) ▪ End-User Development and Human-AI Interaction ▪ Hybrid Positioning and Implicit Human-Computer Interaction ▪ Smart Environments and Cross-Domain Internet of Things (IoT) ▪ ... ▪ Do you have your own ideas? Come along to discuss them ... - https://wise.vub.ac.be/thesis-proposals
16. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 16 May 13, 2024 Video: Microsoft Productivity Vision (2015)
17. Beat Signer - Department of Computer Science - bsigner@vub.ac.be 17 May 13, 2024 References ▪ Microsoft Productivity Future Vision (2015) ▪ https://www.youtube.com/watch?v=w-tFdreZB94
18. 2 December 2005 Next Generation User Interfaces The End Good Luck with the Exam!