2 December 2005 Human-Computer Interaction Use Cases and Course Review Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel beatsigner.com
Beat Signer - Department of Computer Science - [email protected] 3 December 15, 2022 Prof. Dr. Beat Signer Cross-MediaTechnology, Interac- tive Paper, Data Physicalisation Dr. Audrey Sanctorum User-defined XDI and IoT Inter- action, Human-AI Interaction WEB & INFORMATION SYSTEMS ENGINEERING CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Maxim Van de Wynckel Hybrid Positioning, Implicit Human-Computer Interaction Xuyao Zhang Extensible Platform for Dynamic Data Physicalisation CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation
Beat Signer - Department of Computer Science - [email protected] 4 December 15, 2022 WEB & INFORMATION SYSTEMS ENGINEERING CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Ekene Attoh IoT Middleware, Context-aware Computing, Implicit HCI Isaac Valadez Knowledge Physicalisation and Augmentation, Tangible UIs Yoshi Malaise Technology-enhanced Learning, Content-driven Presentations Migdeily Cantera End-User Development, Mixed Reality IoT UIs, Intelligibility CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation
Beat Signer - Department of Computer Science - [email protected] 5 December 15, 2022 WEB & INFORMATION SYSTEMS ENGINEERING CISA Human-Machine & Human-Information Interaction Information Systems & Management Information Visualisation & Navigation CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Arun Sojan Framework for Dynamic Data Physicalisation Piet Van Der Paelt Julia-based Framework for Simulation and Optimisation Evan Cole Technology-enhanced Learning, Study Lenses
Beat Signer - Department of Computer Science - [email protected] 9 December 15, 2022 TangHo Prototype ▪ Lego Mindstorms-based 6DOF arm prototype ▪ motors can be locked or set to float mode - useful for bidirectional I/O ▪ replaceable end effectors for different types of non-visual feedback ▪ Challenges ▪ inverse kinematics (final system is body mounted) - use robotics toolbox (MATLAB) ▪ limited HoloLens hand tracking ▪ 3D printing of final arm Timothy J. Curtin
Beat Signer - Department of Computer Science - [email protected] 12 December 15, 2022 Dynamic Data Physicalisation ▪ Understanding the design space ▪ how do users map data to physicalisations ▪ Data physicalisation design guidelines ▪ what are the just-perceptual differences that a physical variable can convey? ▪ Dynamic data physicalisation framework ▪ data physicalisation grammar ▪ data processing with device-independent output ▪ software drivers for different physicalisations (e.g. TangHo) ▪ New application domains Jacques Bertin, 1967
Beat Signer - Department of Computer Science - [email protected] 16 December 15, 2022 What is Wrong with Slideware? ▪ Simulation of physical slides ▪ limited space due to the slide concept ▪ linear navigation from slide to slide ▪ difficult to reuse content and embed rich media types ▪ MindXpres addresses these issues ▪ unlimited canvas with zoomable user interface ▪ non-linear navigation and associative linking ▪ content-based approach with automatic visualisation
Beat Signer - Department of Computer Science - [email protected] 17 December 15, 2022 Presentation Solutions ▪ PaperPoint ▪ interactive PowerPoint paper handouts ▪ non-linear navigation and annotations ▪ in use since 2005 ▪ MindXpres ▪ extensible presentation platform ▪ non-linear navigation via zoomable user interface ▪ rich media plug-ins ▪ developed since 2011
Beat Signer - Department of Computer Science - [email protected] 23 December 15, 2022 Visual and Interaction Design ▪ Visualisation of interactive areas and functionality ▪ design patterns ▪ Interaction design ▪ online versus offline input processing ▪ lack of modal dialogues ▪ multimodal interaction ▪ Findings might be appli- cable to traditional GUIs ▪ e.g. cross-application widget interaction Global Information Systems Group, ETH Zurich
Beat Signer - Department of Computer Science - [email protected] 25 December 15, 2022 Personal Information Management (PIM) ▪ Keeping, organising and re-finding information ▪ digital and physical ▪ Study of human- information interaction ▪ files, piles, mixtures, … ▪ OC2 PIM model ▪ based on RSL hypermedia metamodel ▪ Cross-Media PIM system ▪ explicit as well as implicit associations between entities
Beat Signer - Department of Computer Science - [email protected] 31 December 15, 2022 Course Summary … 4. Human Perception and Cognition ▪ human senses and modalities ▪ model of visual perception processing ▪ anatomy of the human eye - lens, pupil, retina (rods and cones), … ▪ brightness perception and illusions ▪ visual field and peripheral vision ▪ perception - biased by past, present and future - designing for biased perception ▪ Gestalt principles - law of proximity, law of similarity, law of continuity, law of closure, … ▪ long term memory and immediate memory
Beat Signer - Department of Computer Science - [email protected] 32 December 15, 2022 Course Summary … 5. Design Guidelines and Models ▪ Shneiderman’s eight golden rules of interfaces design ▪ Nielsen’s ten usability heuristics for UI design ▪ visibility, simplicity and mapping ▪ guidelines for using colours ▪ inattentional/change blindness ▪ affordances ▪ Fitts’s law
Beat Signer - Department of Computer Science - [email protected] 34 December 15, 2022 Course Summary … 7. HCI Research Methods ▪ seven types of HCI research contributions - empirical contributions, artefact contributions (systems research), methodological contributions, theoretical contributions, dataset contributions, literature survey contributions, opinion contributions ▪ descriptive, relational and experimental research - statistical significance (e.g. t tests) - correlation does not imply a causal relationship ▪ surveys, diaries and interviews ▪ grounded theory (inductive research) ▪ ethnography ▪ automatic data collection - measuring the human and online data ▪ human computation
Beat Signer - Department of Computer Science - [email protected] 35 December 15, 2022 Course Summary … 8. Use Cases and Course Review ▪ use cases for different HCI research contributions
Beat Signer - Department of Computer Science - [email protected] 36 December 15, 2022 Exam ▪ Written closed book exam ▪ covers content of lectures and exercises ▪ Date ▪ January 11, 09:00–12:00 ▪ Overall grade = written exam (50%) + assignment (50%) ▪ for the assignment students have some flexibility in distributing the grades (±2 points) - send us an email by January 4, 2023 with all group members in CC if you want to distribute some points ▪ note that the grade for the written exam as well as for the assign- ment have to be 8/20 or higher in order to pass the exam! ▪ Submission of the assignment via Canvas ▪ deadline: December 23, 24:00 (Brussels timezone)
Beat Signer - Department of Computer Science - [email protected] 37 December 15, 2022 Exam … ▪ The exam will cover all the content presented in the lectures as well as any additional information from the exercise sessions ▪ includes the videos shown in some of the lectures ▪ Make sure that you understand the basic concepts first ▪ however, we might ask questions at any level of detail to evaluate your knowledge ▪ Applying the theoretical knowledge to concrete use cases ▪ e.g. given a description of a specific problem in a given domain - decide about requirements gathering techniques - define different types of requirements
Beat Signer - Department of Computer Science - [email protected] 38 December 15, 2022 Exam … ▪ Applying the theoretical knowledge to concrete use cases … ▪ e.g. given a description/pictures of a specific UI - identify potential issues based on heuristics, Gestalt principles, Fitts’s law and other guidelines ▪ Describing (and potentially applying) certain concepts ▪ Interaction Design Lifecyle Model ▪ steps of the DECIDE evaluation framework ▪ usability goals ▪ …
Beat Signer - Department of Computer Science - [email protected] 39 December 15, 2022 Other Related Courses ▪ Specialisation: Data Management and Analytics (DAMA) ▪ Information Visualisation (MA) ▪ representation of data (encoding of value/relation) ▪ presentation of data (visualisation techniques) ▪ interaction ▪ dashboards and case studies ▪ Next Generation User Interfaces (MA) ▪ multimodal interaction - theoretical concepts, fusion and fission, ... ▪ interactive tabletops and surfaces ▪ pen-based interaction ▪ gesture-based interaction ▪ tangible interaction and mixed reality
Beat Signer - Department of Computer Science - [email protected] 40 December 15, 2022 Other Related Courses ... ▪ Advanced Topics in Big Data (MA) ▪ seminar about recent developments in Big Data ▪ scalable data management and big data analytics ▪ graph processing and distributed query processing ▪ human-data interaction and human-in-the loop data processing ▪ information visualisation and data physicalisation
Beat Signer - Department of Computer Science - [email protected] 41 December 15, 2022 References ▪ B. Signer, Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Second Edition, ISBN 978-3-8370-2713-6, August 2017 ▪ Dynamic Data Physicalisation and Tangible Holograms ▪ https://wise.vub.ac.be/topic/dynamic-data-physicalisation ▪ https://wise.vub.ac.be/topic/tangible-holograms-tangho ▪ MindXpres Project ▪ https://mindxpres.com ▪ iGesture ▪ http://igesture.org
Beat Signer - Department of Computer Science - [email protected] 42 December 15, 2022 References ... ▪ B. Signer and T.J. Curtin, Tangible Holograms: Towards Mobile Physical Augmentation of Virtual Objects, Technical Report WISE Lab, WISE-2017-01, March 2017 ▪ https://beatsigner.com/publications/signer_arXiv2017.pdf ▪ B. Signer, P. Ebrahimi, T.J. Curtin and Ahmed K.A. Abdullah, Towards a Framework for Dynamic Data Physicalisation, International Workshop Toward a Design Language for Data Physicalisation, Berlin, Germany, October 2018 ▪ https://beatsigner.com/publications/signer_DataPhys2018.pdf
Beat Signer - Department of Computer Science - [email protected] 43 December 15, 2022 References ... ▪ L. Hoste and B. Signer, SpeeG2: A Speech- and Gesture-based Interface for Efficient Controller-free Text Entry, Proceedings of ICMI 2013, 15th International Conference on Multimodal Interaction, Sydney, Australia, December 20132017 ▪ https://beatsigner.com/publications/hoste_ICMI2013.pdf ▪ E.I. Reuss, B. Signer and M.C. Norrie, PowerPoint Multimedia Presentations in Computer Science Education: What do Users Need?, Proceedings of USAB 2008, 4th Symposium on Usability & HCI for Education and Work, Graz, Austria, November 2008 ▪ https://beatsigner.com/publications/reuss_USAB2008.pdf
Beat Signer - Department of Computer Science - [email protected] 44 December 15, 2022 References ... ▪ R. Roels and B. Signer, MindXpres: An Extensible Content-driven Cross-Media Presentation Platform, Proceedings of WISE 2014, 15th International Conference on Web Information System Engineering, Thessaloniki, Greece, October, 2014 ▪ https://beatsigner.com/publications/roels_WISE2014.pdf ▪ R. Roels, P. Mestereaga and B. Signer, An Interactive Source Code Visualisation Plug-in for the MindXpres Presentation Platform, Communications in Computer and Information Science (CCIS), 583, 2016 ▪ https://beatsigner.com/publications/roels_CCIS2016.pdf
Beat Signer - Department of Computer Science - [email protected] 45 December 15, 2022 References ... ▪ Y. Malaise and B. Signer, Personalised Learning Environments Based on Knowledge Graphs and the Zone of Proximal Development, Proceedings of CSEDU 2022, 14th International Conference on Computer Supported Education, April 2022 ▪ https://beatsigner.com/publications/malaise_CSEDU2022.pdf ▪ M.C. Norrie, B. Signer, M. Grossniklaus, R. Belotti, C. Decurtins and N. Weibel, Context-aware Platform for Mobile Data Management, Wireless Networks (WINET), 13(6), Springer, December 2007 ▪ https://beatsigner.com/publications/norrie_WINET2007.pdf
Beat Signer - Department of Computer Science - [email protected] 46 December 15, 2022 References ... ▪ B. Signer, U. Kurmann and M.C. Norrie, iGesture: A General Gesture Recognition Framework, Proceedings of ICDAR 2007, 9th International Conference on Document Analysis and Recognition, Curitiba, Brazil, September 2007 ▪ https://beatsigner.com/publications/signer_ICDAR2007.pdf ▪ S. Trullemans, A. Sanctorum and B. Signer, PimVis: Exploring and Re-finding Documents in Cross-Media Information Spaces, Proceedings of AVI 2016, International Working Conference on Advanced Visual Interfaces, Bari, Italy, June 2016 ▪ https://beatsigner.com/publications/trullemans_AVI2016.pdf
signer
skimatalk
rmcelreath
kaityo256
yasslab
tamai_63
cbtlibrary
toksato
matleenalaakso
asial_edu
imash
mukaken
andyhume
lara
jeffersonlam
addyosmani
tammielis
sferik
bkeepers
eileencodes
sstephenson
productmarketing
scottboms
malarkey