Department Vrije beatsigner.com Universiteit of Computer Brussel Science Department of Computer Science Vrije Universiteit Brussel beatsigner.com 2 December 2005
student has an understanding of general HCI principles and user interface design guidelines as well as the interaction design process and its use for the humancentred design of digital and physical products. The student is able to reflect on the qualities and shortcomings of different interaction styles, while placing the user at the core of the interface design process. September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 4
background, the human-computer interaction principles and the interaction design lifecycle model discussed in the course to create interfaces with good usability and user experience. Students are further able to explain their decisions based on the theory as well requirements analysis and evaluations. ▪ The student is able to assess the usability and effectiveness of user interfaces by using the tools and principles studied during the course. Based on these tools and principles, the student is further able to match different interface and interaction types for a given context. September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 5
exercise sessions ▪ the topics covered in the exercise sessions will also be helpful for the assignment ▪ Additional content might be covered in exercises strongly recommended to attend all exercise sessions! ▪ exam covers content of lectures and exercises ▪ ▪ Exercise sessions assistants: Ingela Rossing ([email protected]) and Bingyan Li ([email protected]) ▪ 3 groups (starting on September 21) ▪ - WPO1: Thursday 11:00–13:00 in D.3.05, WPO2: Wednesday 14:00–16:00 in D.2.18 and WPO3: Thursday 16:00–18:00 in D.2.14 September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 6
▪ lecture slides, exercises, research papers, tutorials, ... ▪ Make sure that you are subscribed to the Human-Computer Interaction course on Canvas ▪ https://canvas.vub.be/courses/49809 ▪ Handouts are on Canvas the day before the lecture ▪ slides will also be available on the WISE website - https://wise.vub.ac.be/course/human-computer-interaction September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 7
Lecture Exercise 6: Heuristic Evaluation D.3.09/D.2.14 No Lecture Exercise 7: Evaluation (Usability / User Experience) D.2.18/D.2.14 No Lecture Exercise 7 for some Groups D.3.09/D.2.18 No Lecture No Exercise Lecture 8: Use Cases and Course Review G.1.53 No Exercise No Lecture Exercise 8: Project Presentation September 21, 2026 D.3.09/D.2.18/D.2.18 Beat Signer - Department of Computer Science - [email protected] 9
design one of five different applications (Event Calendar Organiser, Brussels International Students, Brussels Chocolate Exploration, VUB Cafeteria App or Active Senior Gatherings) - project report, videos of prototypes and final presentation - evaluated based on creativity, application of Interaction Design process and HCI guidelines, documentation, requirements analysis and evaluation, prototypes and final presentation ▪ Assignment handed out in week 3 ▪ group project with 4 students per group - add yourself to a group on Canvas (under People) or send an email to Ingela Rossing by Friday, October 2 ([email protected]) - final presentation (week of December 14), report and videos (December 23) ▪ assignment counts for 50% of the final grade September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 10
and exercises ▪ counts 50% for the overall grade ▪ ▪ Overall grade = written exam (50%) + assignment (50%) for the assignment students have some flexibility in distributing the grades (±2 points) ▪ note that the grade for the written exam as well as for the assignment have to be 8/20 or higher in order to pass the exam! ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 11
AI (GenAI) is strictly limited to enhancing the clarity and readability of your written work. You may use it for grammar correction, sentence restructuring, and improving the flow of text. All project work must reflect your own original thought process and problem-solving skills. Any unauthorised use of GenAI beyond the above-mentioned permitted use will be considered a violation of academic integrity. Further, if GenAI has been used, this should be declared. ▪ Check slides from Plagiarism and GenAI Info Session ▪ https://canvas.vub.be/courses/30881/modules/items/713134 September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 12
types ▪ 2. HCI and Interaction Design human-computer interaction, interaction design process ▪ understanding and conceptualising interaction ▪ 3. Requirements Analysis and Prototyping data gathering and analysis for requirements ▪ different types of prototyping ▪ 4. Human Perception and Cognition vision, attention, recognition, memory, … ▪ hand-eye coordination ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 13
Methods ▪ DECIDE framework, usability testing, experiments, field testing, heuristic evaluations, A/B testing, predictive models 7. HCI Research Methods 8. Use Cases and Course Review various use cases ▪ course review and questions about exam ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 14
design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them. ACM SIGCHI Curricula for Human-Computer Interaction ▪ Human-Computer Interaction is a multidisciplinary field Computer Science ▪ Design ▪ Cognitive Science ▪ Psychology ▪ … ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 15
products to support the way people communicate and interact in their everyday and working lives. Y. Rogers, H. Sharp and J. Preece, Interaction Design: Beyond Human-Computer Interaction Interaction Design (IxD) defines the structure and behavior of interactive systems. Interaction Designers strive to create meaningful relationships between people and the products and services that they use, from computers to mobile devices to appliances and beyond. ixd.org September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 16
interaction (HMI) ▪ Only trained engineers could use the machines ▪ Interaction was limited to the programming of the machines (e.g. punched cards) and the printing of results September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 18
PhD thesis at MIT drawing tool ▪ light pen and buttons ▪ first graphical user interface ▪ direct manipulation of graphical objects ▪ basis for many new interface ideas ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 19
his colleagues at the Stanford Research Institute developed the oNLine System (NLS) as part of the Augment Project ▪ vision about the future of interactive computing ▪ NLS was demonstrated at the Fall Joint Computer Conference in 1968 Douglas Engelbart showed first practical use of hypertext ▪ computer mouse ▪ remote collaboration (connected computers) ▪ raster-scan video monitors ▪ screen windows ▪ ... ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 20
▪ LAN to share resources ▪ Desktop metaphor ▪ ▪ ▪ ▪ windows, icons, menus, pointer (WIMP) interaction "filing cabinets" with hierarchical folders seeing and pointing rather than remembering and typing "What You See Is What You Get" (WYSIWYG) Xerox Star 8010 [http://www.digibarn.com/collections/systems/xerox-8010/] September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 22
corrected some mistakes aggressive pricing ▪ Old ideas (e.g. Xerox Star) but well executed ▪ Domination in the desktop publishing sector ▪ ▪ excellent graphics affordable laser printers September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 23
interfaces, speech, gesture and handwriting recognition, and artificial intelligence ▪ Emergence of the Internet, cell phones, wireless networks, sensor technologies, large and small screens, or virtual and augmented reality hardware innovative interaction with digital information and services ▪ combining the physical and digital in new ways ▪ - mixed reality, cross-media technologies, tangible interfaces, wearable computing, ... ▪ collaborative interfaces with social interaction September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 25
in command line ▪ Combination of keys such as Ctrl + c and Ctrl + v ▪ Superseded by GUIs ▪ Still used by experts ▪ batch processing ▪ Alternative to GUIs for visually impaired users ▪ e.g. command-line interface for Second Life September 21, 2026 ▪ Syntax (e.g. how to combine commands) ▪ Which names can be remembered best ▪ Consistency in labeling and naming of commands Beat Signer - Department of Computer Science - [email protected] 27
participation in a virtual environment (VE) ▪ Use of CAVEs (Cave Automatic Virtual Environment) or headsets ▪ New ways of navigating in 3D space ▪ How to prevent users from experiencing nausea ▪ Identify most effective ways for ▪ First-person view or thirdperson perspective September 21, 2026 Meta Quest 3 headset navigation ▪ Best ways to interact with information Beat Signer - Department of Computer Science - [email protected] 29
▪ easy to maintain ▪ ▪ Users do often not read all the content on a page before following a link ▪ Emphasis on content and the ▪ Bring the desktop to the use of links for navigation browser ▪ Where am I? What’s here? HTML5 and JavaScript ▪ AJAX ▪ … ▪ Web Content Accessibility ▪ September 21, 2026 Where can I go? Guidelines (WCAG) Beat Signer - Department of Computer Science - [email protected] 30
ready at hand 24/7 ▪ Real-time access to contextual information scanning product barcodes while shopping ▪ scanning QR codes ▪ ▪ Small screen and limited control space ▪ Location-based services ▪ Various guidelines on how to and recommendations design mobile interfaces ▪ Privacy issues ▪ September 21, 2026 location sharing applications Beat Signer - Department of Computer Science - [email protected] 31
a ticket ▪ replace touchtone navigation ▪ real-time translators ▪ ▪ Supports visually impaired users ▪ Voice recognition and text- ▪ Natural interfaces vs. voiceto-speech technology based menu navigation specific grammars to improve ▪ Type of voice actor recognition rate ▪ Immediate confirmation of ▪ barge-in requests ▪ September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 32
childhood ▪ digitalisation of handwriting ▪ Stylus on screen vs. digital pen and paper ▪ Quick and easy way to annotate documents ▪ Intuitive interfaces to integrate physical paper with digital information and services September 21, 2026 EdFest, Global Information Systems Group, ETH Zurich ▪ Switching from writing, annotating or sketching to the execution of commands ▪ context-sensitive menus ▪ Feedback for digital pen and paper interfaces Beat Signer - Department of Computer Science - [email protected] 33
gestures Nintendo Wiimote ▪ Microsoft Kinect ▪ … ▪ ▪ Mid-air gestures also used for controlling home appliances ▪ Sign language interpreters Microsoft Kinect ▪ Detection (start /end) and recognition of mid-air gestures ▪ continous input stream ▪ Gestures vs. unconscious gesticulation ▪ Control device vs. hands-free September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 34
▪ Very fast and accurate hands-free input ▪ Good for pointing but less suited for smooth drawing ▪ Useful for evaluations in HCI ▪ Increasing use in Virtual and Mixed Reality September 21, 2026 Canon EOS R3 Eye Control AF ▪ Often needs some initial calibration ▪ How to distinguish deliberate gazing from accidental glancing? Beat Signer - Department of Computer Science - [email protected] 35
and output modalities speech and gesture ▪ eye-gaze and gesture ▪ pen input and speech ▪ … ▪ ▪ Multiple modalities might SpeeG2, WISE lab, VUB ▪ Recognition and calibration of different aspects of a user’s behaviour is more difficult be used simultaneously or alternately ▪ Identify gains of combining different input and output modalities September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 36
▪ Sensing of physical objects and feedback in digital or physical space ▪ Interplay of different devices and objects ▪ no enforced sequencing and no modal interaction ▪ Affordances of interface objects guide the user September 21, 2026 ArtVis, WISE lab, VUB ▪ Coupling between physical action and effect ▪ where to provide digital feedback ▪ What kind of physical artefacts should be used ▪ bricks, cubes, sticky notes, … Beat Signer - Department of Computer Science - [email protected] 37
with digital information and services ▪ Information can be visualised (overlaid) in different ways head-mounted displays (HMDs) ▪ handheld displays ▪ fixed installations ▪ September 21, 2026 Microsoft HoloLens ▪ Form of the digital augmentation and when and where it should be applied ▪ Very different designs ▪ playful learning experience ▪ medical application Beat Signer - Department of Computer Science - [email protected] 38
e-textiles ▪ ▪ Glasses, jewellery, shoes or jackets as user interfaces Smart contact lens ▪ Wearable technology for remote awareness ▪ Hug Shirt by CuteCircuit for mobile phone calls ▪ Wearable interfaces have to be comfortable ▪ Hygiene is an issue ▪ washing of e-textiles ▪ Social acceptance and privacy September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 39
investigate hazardous locations ▪ More recently domestic robots for cleaning and gardening ▪ e.g. Roomba iRobot ▪ Pet robots and human-like robots used in therapies Emergent Communication, AI lab, VUB ▪ Ethical concerns ▪ robots with human- or animal-like behaviour ▪ Communication with robots ▪ human-”human” vs. human- machine interaction September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 40
commu- AI-generated content may be incorrect. nicating with users and other devices often learn the context and user behaviour (AI) ▪ implicit interactions do not have to be triggered by user ▪ ▪ Smart environments such as smart homes or offices eSPACE authoring tool, WISE lab, VUB ▪ Minimise mismatch between user expectations and actions triggered by the system ▪ Intelligibility offers users insights about the system behaviour September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 41
years there is a significant increase in the number of user interface types ▪ How to decide which interface is preferable for a given task or activity? speech vs. command-based interface ▪ multimodal vs. monomodal interface ▪ wearable vs. mobile interface ▪ virtual reality vs. augmented reality ▪ … ▪ ▪ Many of these questions are currently being researched ▪ this course will provide you some more insights about the design process and human-computer interaction-related issues September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 42
Sharp and Jenny Preece, Wiley (6th edition), April 2023 ISBN-13: 978-1119901099 ▪ Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Guidelines, Jeff Johnson, Morgan Kaufmann (3rd edition), November 2020, ISBN-13: 978-0192864550 ▪ Introduction to Human-Computer Interaction, Kasper Hornbaek, Per Ola Kristensson and Antti Oulasvirta, Oxford University Press, September 2025, ISBN-13: 978-0130461094 September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 45
Jinjuan Heidi Feng and Harry Hochheiser, Morgan Kaufmann (2nd edition), May 2019, ISBN-13: 978-0128053904 ▪ Designing for Interaction: Creating Innovative Applications and Devices, Dan Saffer, New Riders (2nd edition), August 2009 ISBN-13: 978-0321643391 ▪ The Design of Everyday Things, Don Norman, Basic Books (revised and expanded edition), November 2013, ISBN-13: 978-0465050659 September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 46
Computer Interaction, Major Reference Work, Springer Nature, 2025 ▪ https://beatsigner.com/publications/pen-based-interaction.pdf ▪ M.C. Norrie, B. Signer, M. Grossniklaus, R. Belotti, C. Decurtins and N. Weibel, Context-Aware Platform for Mobile Data Management, Wireless Networks (WINET), 13(6), Springer, December 2007 ▪ https://beatsigner.com/publications/norrie_WINET2007.pdf September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 47
Speech- and Gesture-based Interface for Efficient Controller-free Text Entry, Proceedings of the 15th International Conference on Multimodal Interaction (ICMI 2013), Sydney, Australia, December 2013 ▪ https://beatsigner.com/publications/hoste_ICMI2013.pdf ▪ B. Dumas, B. Moerman, S. Trullemans and B. Signer, ArtVis: Combining Advanced Visualisation and Tangible Interaction for the Exploration, Analysis and Browsing of Digital Artwork Collections, Proceedings of AVI 2014, Como, Italy, May 2014 ▪ https://beatsigner.com/publications/dumas_AVI2014.pdf September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 48
Theoretical Foundations for the End-User Development of Cross-Device and IoT Applications, ACM Transactions on Computer-Human Interaction (TOCHI), February 2025 ▪ https://beatsigner.com/publications/sanctorum_TOCHI2025.pdf ▪ B. Signer, Towards Cross-Media Information Spaces and Architectures, Proceedings of the 13th International Conference on Research Challenges in Information Science (RCIS 2019), Brussels, Belgium, May 2019 ▪ https://beatsigner.com/publications/signer_RCIS2019.pdf September 21, 2026 Beat Signer - Department of Computer Science - [email protected] 49