and Human-Information Interaction Prof. Dr. Beat Signer beatsigner.com Web & Information Systems Engineering Lab Department of Computer Science Vrije Universiteit Brussel 2 December 2005
CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Prof. Dr. Beat Signer Dr. Maxim Van de Wynckel Cross-Media Technology, Interactive Paper, Data Physicalisation Interoperable Positioning Systems, Implicit HCI A close-up of a person smiling A person with a mustache and beard Description automatically generated AI-generated content may be incorrect. Information Systems & Management Information Visualisation & Navigation CISA Human-Machine & Human-Information Interaction Ingela Rossing Jan Boonants Dynamic Data Physicalisation Framework and Guidelines Mixed Reality Information Architectures, Generic IoT Interfaces September 2026 Beat Signer - Department of Computer Science - [email protected] 5
white background A person with a beard and glasses Description automatically generated AI-generated content may be incorrect. WEB & INFORMATION SYSTEMS ENGINEERING logo.wmf CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Qi Xu Isaac Valadez Next Generation Scholarly Workflows, Cross-Media PIM Digital Twin User Interfaces, Hybrid GUI-LLM Interfaces A person wearing glasses A person with long hair AI-generated content may be incorrect. Description automatically generated with low confidence Information Systems & Management Information Visualisation & Navigation CISA Human-Machine & Human-Information Interaction Bingyan Lee Yoshi Malaise Next Generation User Interfaces Technology-enhanced Learning, for Human-Information Interaction Content-driven Presentations September 2026 Beat Signer - Department of Computer Science - [email protected] 6
CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Xuyao Zhang Ekene Attoh Extensible Platform for Dynamic Data Physicalisation IoT Middleware, Context-aware Computing, Implicit HCI Information Systems & Management Information Visualisation & Navigation CISA Human-Machine & Human-Information Interaction Piet Van Der Paelt Tunday Akintan Julia-based Framework for Simulation and Optimisation AI Literacy, Responsible AI Adoption and AI Governance September 2026 Beat Signer - Department of Computer Science - [email protected] 7
CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) CROSS-MEDIA INFORMATION SPACES AND ARCHITECTURES (CISA) Arun Sojan Patrick Sello Physicalisation for Digital Twins Digital Twins for Healthcare, Federated Learning Information Systems & Management Information Visualisation & Navigation CISA Human-Machine & Human-Information Interaction September 2026 Beat Signer - Department of Computer Science - [email protected] 8
are based on the simulation of paper affordances on desktop computers ▪ How to manage mixed-media "documents" in open and fluid cross-media information spaces? ▪ on the data level - context-sensitive adaptation - cross-media transclusion ▪ Information Visualisation & Navigation CISA on the visualisation and navigation level - zoomable user interfaces ▪ Information Systems & Management on the cross-media interaction level Human-Machine & Human-Information Interaction - fluid multimodal cross-media interfaces ▪ Remediation of the "paper simulation" approach ▪ September 2026 WYSIWYG is only one out of many options! Beat Signer - Department of Computer Science - [email protected] 10
the logic of the concept: "What You See Is What You Get" is based on printing the document out ("get" means "get WHEN YOU PRINT IT OUT"). And that means a metaphysical shift: a document can only consist of what can be printed! [...] No overlays [...] – PAPER UNDER GLASS. Geeks Bearing Gifts: How the Computer World Got This Way, Mindful Press 2009 Ted Nelson When data of any sort are placed in storage, they are filed alphabetically or numerically, and information is found (when it is) by tracing it down from subclass to subclass. It can be in only one place, unless duplicates are used [...] The human mind does not work that way. It operates by association. As We May Think, Atlantic Monthly, July 1945 September 2026 Beat Signer - Department of Computer Science - [email protected] Vannevar Bush 11
▪ digital and physical ▪ Study of humaninformation interaction ▪ files, piles, mixtures, … ▪ Cross-Media PIM system ▪ explicit as well as implicit associations between entities ▪ Next generation scholarly workflows September 2026 Beat Signer - Department of Computer Science - [email protected] 15
Pictures Vancouver Granville Island Vancouver Harbour ER 2010 Public Market multiple classification September 2026 My Videos Keynote J. Thorp Vancouver Aquarium Olga and Lamia My Presentations ER 2010 Keynote Dinner ER 2010 ER 2010 cross-media transclusion WISE 2009 single slide transclusion (via OOXML RSL selector) cross-media association Beat Signer - Department of Computer Science - [email protected] Gregory Cardone 20
areas and functionality ▪ design patterns ▪ Interaction design booklet 2005 online versus offline input processing ▪ lack of modal dialogues ▪ multimodal interaction ▪ ▪ Findings might be appli- Global Information Systems Group, ETH Zurich cable to traditional GUIs ▪ September 2026 e.g. cross-application widget interaction Beat Signer - Department of Computer Science - [email protected] 26
▪ Investigation of current AI-generated content may be incorrect. scholarly workflows ▪ RSL-based PIM model for cross-media scholarly workflows ▪ Researcher’s One-Stop Shop (ROSS) platform plug-ins for existing scholarly tools ▪ cross-media interfaces ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 27
at the file level • Curating stage: information managed/interacted with at the excerpt level • Current excerpt-level PIM strategies provide limited support for preserving contextual information September 2026 Qi Xu and Beat Signer, An Empirical Study on Personal Information Management Practices Across Scholarly Workflows, Proceedings of the EA of CHI 2026, International Conference on Human Factors in Computing Systems, Barcelona, Spain, April 2026 Beat Signer - Department of Computer Science - [email protected] 28
for cross-media document annotations September 2026 Qi Xu and Beat Signer, Augmenting Scholarly Reading with Cross-Media Annotations, International Workshop on Science and Technology for Augmenting Reading (STAR), CHI 2026, Barcelona, Spain, April 2026 Beat Signer - Department of Computer Science - [email protected] 29
physical-digital information ▪ MARIS architecture for cohesive cross-media knowledge spaces affordances of paper ▪ didirectional embodied interaction paradigms ▪ cross-media UI toolkit ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 30
for cross-device and IoT applications (eSPACE) ▪ End-user authoring customised distribution of user interface components ▪ mashup tool for digital and physical (IoT) components ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 31
Interact: Challenges and Opportunities for Next-Generation Human-Information Interaction, Proceedings of HUMAN 2024, 7th Workshop on Human Factors in Hypertext, Poznan, Poland, September 2024 Jan Boonants September 2026 Beat Signer - Department of Computer Science - [email protected] 34
red circuit board AI-generated content may be incorrect. indoor positioning ▪ SemBeacon specification ▪ extension of POSO combined with Bluetooth specification ▪ combination of AltBeacon and Eddystone-URL ▪ encoding URI of online RDF description ▪ hardware beacons September 2026 Screens screenshots of a phone AI-generated content may be incorrect. Beat Signer - Department of Computer Science - [email protected] 36
generated positioning system stream-based processing ▪ interoperability ▪ discoverability ▪ ▪ Combine existing and new positioning techniques ▪ Data Structure ▪ data objects ▪ data frames ▪ absolute or relative positions September 2026 A hand holding a phone AI-generated content may be incorrect. Beat Signer - Department of Computer Science - [email protected] 37
a system AI-generated content may be incorrect. positioning systems ▪ describe different parts of positioning system in RDF ▪ POSO extends the SSN and SOSA ontologies ▪ Use of Solid Pods for storing user-controlled positioning data September 2026 A diagram of a computer system AI-generated content may be incorrect. Beat Signer - Department of Computer Science - [email protected] 38
of a computer system Description automatically generated forms ▪ rules normally not compatible ▪ NLP-based solution to translate proprietary rules to high-level EUPont model high-level rules managed in personal Solid Pods ▪ rules can be executed on different IoT platforms via an EUPont runtime ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] Attoh and Signer, 2024 40
▪ programmer, expert user and end user Filled in template Rule End User ▪ Beyond simple "if this then that" rules (8) Template (6) Expert User ▪ Client-server architecture server: context reasoning based on Drools ▪ client: sensor input as well as applications (7) (4) ▪ Situations Facts Functions Actions (5) Rule Programmer ▪ Increase trust via intelligibility September 2026 Beat Signer - Department of Computer Science - [email protected] 41
and Beat Signer, A Hybrid GUI-LLM Interface Paradigm for 3D Scene Customisation, Proceedings of DIS 2026, International Conference on Designing Interactive Systems, Singapore, Republic of Singapore, June 2026 September 2026 Beat Signer - Department of Computer Science - [email protected] 45
AI-generated content may be incorrect. model ▪ meeting aspects influencing in-person collaboration, such as cognitive impact, meeting variables and participant characteristics ▪ Meeting scheduler to decide on the best form of a (cross-space) meeting September 2026 Beat Signer - Department of Computer Science - [email protected] 46
can be locked or set to float mode - useful for bidirectional I/O ▪ Replaceable end effector for different types of non-visual feedback ▪ Challenges ▪ inverse kinematics (final system is body mounted) - use robotics toolbox (MATLAB) limited HoloLens hand tracking ▪ 3D printing of final arm ▪ Timothy J. Curtin September 2026 Beat Signer - Department of Computer Science - [email protected] 49
well as output ▪ How can we achieve dynamic data physicalisation with dynamic affordances use physical variables such as temperature or texture ▪ exploration of big data sets ▪ experimental tangible holograms (TangHo) platform ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 52
do users map data to physicalisations ▪ Understanding the perceptual effectiveness ▪ e.g. what are the just-noticeable differences that a physical variable can convey? ▪ Framework for dynamic data physicalisation ▪ data processing with device-independent output - TextDIO: text for static or dynamic reports - PhysDIO: data points, data variables and physical variables text and visualisation drivers for representation on specific devices (e.g. TangHo) ▪ new data physicalisation design guidelines (as in InfoVis) ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 53
do users map data to physicalisations ▪ Data physicalisation design guidelines ▪ what are the just-perceptual differences that a physical variable can convey? ▪ Dynamic data physicalisation framework Jacques Bertin, 1967 data physicalisation grammar ▪ data processing with device-independent output ▪ software drivers for different physicalisations (e.g. TangHo) ▪ ▪ New application domains September 2026 Beat Signer - Department of Computer Science - [email protected] 55
of different sizes of objects AI-generated content may be incorrect. platform for dynamic data physicalisation ▪ communication architecture for plug-and-play of modules ▪ modules representing different physical variables A white rectangular object with black and white objects AI-generated content may be incorrect. - self-describing language for physicalisation of modules ▪ Rapid prototyping of dynamic data physicalisation September 2026 Beat Signer - Department of Computer Science - [email protected] 56
limited space due to the slide concept ▪ linear navigation from slide to slide ▪ difficult to reuse content and embed rich media types ▪ ▪ MindXpres addresses these issues unlimited canvas with zoomable user interface ▪ non-linear navigation and associative linking ▪ content-based approach with automatic visualisation ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 57
navigation and annotations ▪ in use since 2005 ▪ ▪ MindXpres extensible presentation platform ▪ non-linear navigation via zoomable user interface ▪ rich media plug-ins ▪ developed since 2011 ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 58
overview for the presenter ▪ see content of current and nearby slides (orientation) ▪ Annotation of static slide content highlighting of content ▪ dynamic creation of new content at presentation time ▪ ▪ Improved control of embedded media (e.g. video) ▪ Digital whiteboard ▪ Multi-pen support collaborative presentations ▪ brainstorming ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 59
XML-based MindXpres document format ▪ Compiler (node.js application) translates XML to HTML ▪ Presentation engine based on HTML5 and related APIs ▪ September 2026 e.g. WebSockets for connectivity Beat Signer - Department of Computer Science - [email protected] 61
Framework and Content Model for Next Generation Presentation Solutions, PACMHCI 3(Issue EICS), 2019 R. Roels and B. Signer, A Conceptual Framework and Content Model for Next Generation Presentation Solutions, PACMHCI 3(Issue EICS), 2019 September 2026 Beat Signer - Department of Computer Science - [email protected] 62
includes development of a data plug-in ▪ implementation of a visual plug-in ▪ registration with the resource plug-in repository ▪ ▪ Link browser loads plug-ins on demand ▪ internal or external (third party application) visualisation ▪ Third-party applications use the link browser for visualisation ▪ similar to the integration of third-party applications with web browsers ▪ Non-monolithic annotation model and authoring tool ▪ September 2026 resource-specific plug-ins Beat Signer - Department of Computer Science - [email protected] 67
multimodal and multi-touch interactions ▪ rule-based language approach ▪ rapid prototyping and application development Screen shot 2011-04-22 at 20.04.29.jpg ▪ gestureSet.png ▪ iGesture Workbench create and test gesture sets and algorithms ▪ different modalities: digital pen, Wii remote, … ▪ open source (http://igesture.org) ▪ ▪ HephaisTK Toolkit domain-specific human-computer dialogue language (SMUIML) for multimodal I/O ▪ speech recognisers, RFID readers, … ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 72
of abstraction ▪ unified fusion framework based on shared fact base ▪ Interactions defined via declarative rule-based language (Midas) ▪ Rapid prototyping ▪ September 2026 simple integration of new input devices and external recognisers Beat Signer - Department of Computer Science - [email protected] 73
plug-ins for QR codes, RFID tags, SIFT algorithm, … ▪ tracking of documents across organisational structures ▪ avoid fragmentation when using multiple tracking setups ▪ DocTr REST Output Interface Document Manag ement Delegator OC2 Data Model Pending Pool GUI Identification Mechanism tracking solution REST Input Interface Tracking Setups September 2026 Beat Signer - Department of Computer Science - [email protected] 76
5.4) User 2 3 6 4 5 Skeletal tracking (Microsoft Kinect) SpeeG2 GUI Sven De Kock September 2026 Beat Signer - Department of Computer Science - [email protected] 77
low confidence and office tools augmenting the scribbling process ▪ knowledge physicalisation via tangible objects ▪ ▪ Design guidelines for knowledge physicalisation and augmentation September 2026 Beat Signer - Department of Computer Science - [email protected] Innoty's Snnap Board solution 83
Drawing Tool test4 Photo Browser Photo Browser (Slider) Global Information Systems Group, ETH Zurich September 2026 Beat Signer - Department of Computer Science - [email protected] 84
Cross-Media Narrative ▪ Writing/drawing as a collaborative act of storytelling ▪ Captured handwriting is linked to existing digital and physical content ▪ Link server driving the cosmo augmentation process ▪ active components - ambient sound and light In collaboration with Axel Vogelsang, Artists in Labs Programme September 2026 Beat Signer - Department of Computer Science - [email protected] 85
combination with a TUI explore Web Gallery of Art ▪ faceted browsing ▪ phidgets-based TUI ▪ RFID-tagged physical objects ▪ ▪ Three main components to explore, analyse and browse the information Bram Moerman September 2026 Beat Signer - Department of Computer Science - [email protected] 86
paper on desktop computers ▪ RSL-based representation of open and fluid cross-media information spaces interactive paper and data physicalisation solutions ▪ personal information management and associative file systems ▪ MindXpres presentation tool ▪ ▪ Mixed reality and dynamic data physicalisation ▪ ArtVis, Mental Nomad and Tangible Holograms (TangHo) ▪ Multimodal and multi-touch interaction Midas/Mudra, HephaisTK and iGesture ▪ SpeeG2, Kinect Presenter ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 88
theses Dynamic Data Physicalisation ▪ Personal Information Management (PIM) ▪ - next generation scholarly workflows Technology-enhanced Learning ▪ Innovative Mixed Reality Interfaces ▪ - paper-digital interaction - AR-based human-information interaction, … Next Generation Presentation Solutions (e.g. MindXpres) ▪ Human-AI Interaction and Digital Twin Solutions ▪ Hybrid Positioning and Implicit Human-Computer Interaction ▪ Smart Environments and Cross-Domain Internet of Things (IoT) ▪ ... ▪ Do you have your own ideas? Come along to discuss them ... ▪ September 2026 Beat Signer - Department of Computer Science - [email protected] 89
Cross-Media Information Spaces, Second Edition, ISBN 978-3-8370-2713-6, August 2017 B. Signer, Pen-based Interaction, Handbook of Human Computer Interaction, Major Reference Work, Springer Nature, 2025 cover2.jpg A blue and white sign with text Description automatically generated https://beatsigner.com/publications/pen-based-interaction.pdf ▪ ArtVis Project ▪ https://www.beatsigner.com/flyers/ArtVis.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 90
and Architecture for Open Cross-Media Annotation and Link Services, Information Systems 36(3), Elsevier, May 2011 ▪ https://beatsigner.com/publications/signer_IS2011.pdf [2] B. Signer, What is Wrong with Digital Documents? A Conceptual Model for Structural Cross-Media Content Composition and Reuse, Proceedings of the 29th International Conference on Conceptual Modeling (ER 2010), Vancouver, Canada, November 2010 ▪ https://beatsigner.com/publications/signer_ER2010.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 92
and Cross-Media Information Spaces, Dissertation ETH No. 16218, Zurich, Switzerland, 2005 ▪ https://beatsigner.com/publications/signer2006.pdf [4] B. Signer and M.C. Norrie, As We May Link: A General Metamodel for Hypermedia Systems, Proceedings of ER 2007, 26th International Conference on Conceptual Modeling, Auckland, New Zealand, November 2007 ▪ https://beatsigner.com/publications/signer_ER2007.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 93
Conceptual Framework and Metamodel for Context-Aware Personal Cross-Media Information Management Systems, Proceedings of ER 2014, 33rd International Conference on Conceptual Modelling, Atlanta, USA, October, 2014 ▪ https://beatsigner.com/publications/trullemans_ER2014.pdf [6] S. Trullemans, A. Vercruysse and B. Signer, DocTr: A Unifying Framework for Tracking Physical Documents and Organisational Structures, Proceedings of EICS 2016, Brussels, Belgium, June 2016 ▪ https://beatsigner.com/publications/trullemans_EICS2016.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 94
Signer, INFEX: A Unifying Framework for Cross-Device Information Exploration and Exchange, Proceedings of the ACM on Human-Computer Interaction (PACMHCI), 1(3), 2017 ▪ https://beatsigner.com/publications/roels_PACMHCI2017.pdf [8] R. Roels and B. Signer, MindXpres: An Extensible Content-driven Cross-Media Presentation Platform, Proceedings of WISE 2014, 15th International Conference on Web Information System Engineering, Thessaloniki, Greece, October, 2014 ▪ https://beatsigner.com/publications/roels_WISE2014.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 95
Cross-Device Interaction, Proceedings of DUI 2016, 5th Workshop on Distributed User Interfaces, Lugano, Switzerland, June 2016 ▪ https://beatsigner.com/publications/sanctorum_DUI2016.pdf [10] S. Trullemans, L. Van Holsbeeke and B. Signer, The Context Modelling Toolkit: A Unified Multi-layered Context Modelling Approach, Proceedings of PACMHCI 1(1), June 2017 ▪ https://beatsigner.com/publications/trullemans_EICS2017.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 96
An Interactive Data Visualisation Approach for Next Generation Presentation Tools: Towards Rich Presentation-based Data Exploration and Storytelling, Proceedings of CSEDU 2016, Rome, Italy, April, 2016 ▪ https://beatsigner.com/publications/roels_CSEDU2016.pdf [12] M.C. Norrie, B. Signer and N. Weibel, Interactive Paper as a Reading Medium in Digital Libraries, Proceedings of ECDL 2008, 12th European Conference on Research and Advanced Technology for Digital Libraries, Aarhus, Denmark, September 2008 ▪ https://beatsigner.com/publications/norrie_ECDL2008.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 97
D. Heiniger, Telephone Interface for Avalanche Warnings based on Information Server for Adaptable Content Delivery, Proceedings of Pervasive 2002, Zurich, Switzerland, August 2002 ▪ https://beatsigner.com/publications/signer_Pervasive2002.pdf [14] S. Trullemans, A. Sanctorum and B. Signer, PimVis: Exploring and Re-finding Documents in CrossMedia Information Spaces, Proceedings of AVI 2016, International Working Conference on Advanced Visual Interfaces, Bari, Italy, June 2016 ▪ https://beatsigner.com/publications/trullemans_AVI2016.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 98
B. Signer, ArtVis: Combining Advanced Visualisation and Tangible Interaction for the Exploration, Analysis and Browsing of Digital Artwork Collections, Proceedings of AVI 2014, Como, Italy, May 2014 ▪ https://beatsigner.com/publications/dumas_AVI2014.pdf [16] B. Dumas, T. Broché, L. Hoste and B. Signer, ViDaX: An Interactive Semantic Data Visualisation and Exploration Tool, Proceedings of AVI 2012, International Working Conference on Advanced Visual Interfaces, Capri Island, Italy, May 2012 ▪ https://beatsigner.com/publications/dumas_AVI2012.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 99
Weibel, Print-n-Link: Weaving the Paper Web, Proceedings of DocEng 2006, ACM Symposium on Document Engineering, Amsterdam, The Netherlands, October 2006 ▪ https://beatsigner.com/publications/norrie_DocEng2006.pdf [18] M. Van de Wynckel and B. Signer, Indoor Positioning Using the OpenHPS Framework, Proceedings of IPIN 2021, International Conference on Indoor Positioning and Indoor Navigation, Lloret de Mar, Spain, November 2021 ▪ https://beatsigner.com/publications/vanDeWynckel_IPIN2021.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 100
An Interactive Source Code Visualisation Plug-in for the MindXpres Presentation Platform, Communications in Computer and Information Science (CCIS), 583, 2016 ▪ https://beatsigner.com/publications/roels_CCIS2016.pdf [20] Y. Malaise and B. Signer, Personalised Learning Environments Based on Knowledge Graphs and the Zone of Proximal Development, Proceedings of CSEDU 2022, International Conference on Computer Supported Education, Online Event, April 2022 ▪ https://beatsigner.com/publications/malaise_CSEDU2022.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 101
W. De Meuter, Midas: A Declarative Multi-Touch Interaction Framework, Proceedings of TEI 2011, 5th International Conference on Tangible, Embedded and Embodied Interaction, Funchal, Portugal, January 2006 ▪ https://beatsigner.com/publications/scholliers_TEI2011.pdf [22] L. Hoste, B. Dumas and B. Signer, Mudra: A Unified Multimodal Interaction Framework, Proceedings of ICMI 2011, 13th International Conference on Multimodal Interaction, Alicante, Spain, November 2011 ▪ https://beatsigner.com/publications/hoste_ICMI2011.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 102
iGesture: A General Gesture Recognition Framework, Proceedings of ICDAR 2007, 9th International Conference on Document Analysis and Recognition, Curitiba, Brazil, September 2007 ▪ https://beatsigner.com/publications/signer_ICDAR2007.pdf [24] L. Hoste and B. Signer, SpeeG2: A Speech- and Gesture-based Interface for Efficient Controller-free Text Entry, Proceedings of ICMI 2013, 15th International Conference on Multimodal Interaction, Sydney, Australia, December 2013 ▪ https://beatsigner.com/publications/hoste_ICMI2013.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 103
Interactive Paper as a Mobile Client for a MultiChannel Web Information System, World Wide Web Journal (WWW), Vol. 10, No. 4, Springer, December 2007 ▪ https://beatsigner.com/publications/signer_WWWJ2007.pdf [26] B. Signer and M.C. Norrie, PaperPoint: A Paperbased Presentation and Interactive Paper Prototyping Tool, Proceedings of TEI 2007, First International Conference on Tangible and Embedded Interaction, Baton Rouge, USA, February 2007 ▪ https://beatsigner.com/publications/signer_TEI2007.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 104
Cosmonaut: An Interactive Narrative Environment on Basis of Digitally Enhanced Paper, Proceedings of the International Conference on Virtual Storytelling 2005, Strasbourg, France, December 2005 ▪ https://beatsigner.com/publications/vogelsang_ICVS2005.pdf [28] L. Hoste and B. Signer, Expressive Control of Indirect Augmented Reality During Live Music Performances, Proceedings of NIME 2013, 13th International Conference on New Interfaces for Musical Expression, Daejeon, Korea Republic, May 2013 ▪ https://beatsigner.com/publications/hoste_NIME2013.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 105
M.C. Norrie, PaperProof: A Paper-Digital Proof-Editing System, Proceedings of CHI 2008, 26th International Conference on Human Factors in Computing Systems (Interactivity Track), Florence, Italy, April 2008 ▪ https://beatsigner.com/publications/weibel_CHI2008.pdf [30] N. Weibel, B. Signer, M.C. Norrie, H. Hofstetter, H.-C. Jetter and H. Reiterer, PaperSketch: A PaperDigital Collaborative Remote Sketching Tool, Proceedings of IUI 2011, International Conference on Intelligent User Interfaces, Palo Alto, USA, February 2011 ▪ https://beatsigner.com/publications/weibel_IUI2011.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 106
Towards Mobile Physical Augmentation of Virtual Objects, Technical Report WISE Lab, WISE-2017-01, March 2017 ▪ https://beatsigner.com/publications/signer_arXiv2017.pdf [32] B. Signer, P. Ebrahimi, T.J. Curtin and Ahmed K.A. Abdullah, Towards a Framework for Dynamic Data Physicalisation, International Workshop Toward a Design Language for Data Physicalisation, Berlin, Germany, October 2018 ▪ https://beatsigner.com/publications/signer_DataPhys2018.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 107
A Solid-based Architecture for Decentralised Interoperable Location Data, Proceedings of IPIN 2022, International Conference on Indoor Positioning and Indoor Navigation, Beijing, China, September 2022 ▪ https://beatsigner.com/publications/vanDeWynckel_IPIN2022.pdf [34] M. Van de Wynckel and B. Signer, POSO: A Generic Positioning System Ontology, Proceedings of ISWC 2022, International Semantic Web Conference, Hangzhou, China, October 2022 ▪ https://beatsigner.com/publications/vanDeWynckel_ISWC2022.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 108
SemBeacon: A Semantic Proximity Beacon Solution for Discovering and Detecting the Position of Physical Things, Proceedings of IoT 2023, International Conference on the Internet of Things, Nagoya, Japan, November 2023 ▪ https://beatsigner.com/publications/vanDeWynckel_IOT2023.pdf [36] M. Van de Wynckel, I. Valadez and B. Signer, FidMark: A Fiducial Marker Ontology for Semantically Describing Visual Markers, Proceedings ESWC 2024, International Conference on the Semantic Web Conference, Hersonissos, Greece, May 2024 ▪ https://beatsigner.com/publications/vanDeWynckel_ESWC2024.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 109
Past, Present and Future, Proceedings of PaperComp 2010, 1st International Workshop on Paper Computing, Copenhagen Denmark, September 2010 ▪ https://beatsigner.com/publications/signer_PaperComp2010.pdf [38] A.A.O Tayeh and B. Signer, A Dynamically Extensible Open Cross-Document Link Service, Proceedings of WISE 2015, 16th International Conference on Web Information Systems Engineering, Miami, USA, November, 2015 ▪ https://beatsigner.com/publications/tayeh_WISE2015.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 110
Needs to Opportunities in Personal Information Management: A Case Study on Organisational Strategies in CrossMedia Information Spaces, Proceedings of DL 2014, London, UK, September, 2014 ▪ https://beatsigner.com/publications/trullemans_DL2014.pdf [40] R. Roels, C. Vermeylen and B. Signer, A Unified Communication Platform for Enriching and Enhancing Presentations with Active Learning Components, Proceedings of ICALT 2014, Athens, Greece, July 2014 ▪ https://beatsigner.com/publications/roels_ICALT2014.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 111
B. Signer, Towards Query by Sketch, Michael Springmann, Second DELOS Conference on Digital Libraries, Pisa, Italy, December 2007 ▪ https://beatsigner.com/publications/springmann_DELOS2007.pdf [42] B. Signer, Towards Cross-Media Information Spaces and Architectures, Proceedings of RCIS 2019, Brussels, Belgium, May 2019 ▪ https://beatsigner.com/publications/signer_RCIS2019.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 112
and B. Willems, Back to the Future: Bringing Original Hypermedia and Cross-Media Concepts to Modern Desktop Environments, Proceedings of Hypertext 2021, Virtual Event, August 2021 ▪ https://beatsigner.com/publications/signer_Hypertext2021.pdf [44] E. Cole, Y. Malaise, and B. Signer, Computing Education Research as a Translational Transdiscipline, Proceedings of SIGCSE 2023, Toronto, Canada, March 2023 ▪ https://beatsigner.com/publications/cole_SIGCSE2023.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 113
A Modular and Extensible Hardware Platform Prototype for Dynamic Data Physicalisation, WISE-2025-01, arXiv preprint, March 2025 ▪ https://beatsigner.com/publications/xuyao_CoRR2025.pdf [46] I. Valadez, S. Trullemans and B. Signer, Where Do We Meet? Key Factors Influencing Collaboration Across Meeting Spaces, WISE-2023-02, arXiv preprint, November 2023 ▪ https://beatsigner.com/publications/valadez_WISE-2023-02.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 114
B. Signer, Seamless Data Persistence in Simulation Models: A Metaprogramming Approach in Julia, Proceedings of SIMUtools 2024, International Conference on Simulation Tools and Techniques, Bratislava, Slovakia, December 2024 ▪ https://beatsigner.com/publications/vanDerPaelt_SIMUtools2024.pdf [48] B. Signer, As We May Interact: Challenges and Opportunities for Next-Generation Human-Information Interaction, Proceedings of HUMAN 2024, Poznań, Poland, September 2024 ▪ https://beatsigner.com/publications/signer_HUMAN2024.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 115
Study on Personal Information Management Practices Across Scholarly Workflows, Proceedings of CHI 2026, Inter national Conference on Human Factors in Computing Systems, Barcelona, Spain, April 2026 ▪ https://beatsigner.com/publications/xu_CHI2026.pdf [50] I. Valadez, I. Avina and B. Signer, A Hybrid GUI-LLM Interface Paradigm for 3D Scene Customisation, Proceedings of DIS 2026, International Conference on Designing Interactive Systems, Singapore, Republic of Singapore, June 2026 ▪ https://beatsigner.com/publications/valadez_DIS2026.pdf September 2026 Beat Signer - Department of Computer Science - [email protected] 116
signer
kanaya
tagtag
rmaruy
xleitix
rajeshrinet
trycycle
hanbao
shomaekawa
hf149
syuchimu
brainpadpr
bluesmoon
thirion
axbom
ipullrank
afnizarnur
shpigford
nonsquared
moore
jdejongh
samlambert
mayatellez
codingconduct
![Cross-Media Information Spaces and Architectures data-driven storytelling [11] open cross-media](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_2.jpg){kind=link}
![References ... [1] B. Signer and M.C. Norrie, A Model](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_91.jpg){kind=link}
![References ... [3] B. Signer, Fundamental Concepts for Interactive Paper](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_92.jpg){kind=link}
![References ... [5] S. Trullemans and B. Signer, Towards a](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_93.jpg){kind=link}
![References ... [7] R. Roels, A. De Witte and B.](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_94.jpg){kind=link}
![References ... [9] A. Sanctorum and B. Signer, Towards Userdefined](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_95.jpg){kind=link}
![References ... [11] R. Roels, Y. Baeten and B. Signer,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_96.jpg){kind=link}
![References ... [13] B. Signer, M.C. Norrie, P. Geissbuehler and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_97.jpg){kind=link}
![References ... [15] B. Dumas, B. Moerman, S. Trullemans and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_98.jpg){kind=link}
![References ... [17] Moira C. Norrie, Beat Signer and Nadir](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_99.jpg){kind=link}
![References ... [19] R. Roels, P. Mestereaga and B. Signer,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_100.jpg){kind=link}
![References ... [21] C. Scholiers, L. Hoste, B. Signer and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_101.jpg){kind=link}
![References ... [23] B. Signer, U. Kurmann and M.C. Norrie,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_102.jpg){kind=link}
![References ... [25] B. Signer, M. Grossniklaus and M.C. Norrie,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_103.jpg){kind=link}
![References ... [27] A. Vogelsang and B. Signer, The Lost](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_104.jpg){kind=link}
![References ... [29] N. Weibel, A. Ispas, B. Signer and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_105.jpg){kind=link}
![References ... [31] B. Signer and T.J. Curtin, Tangible Holograms:](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_106.jpg){kind=link}
![References ... [33] M. Van de Wynckel and B. Signer,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_107.jpg){kind=link}
![References ... [35] M. Van de Wynckel and B. Signer,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_108.jpg){kind=link}
![References ... [37] B. Signer and M.C. Norrie, Interactive Paper:](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_109.jpg){kind=link}
![References ... [39] S. Trullemans and B. Signer, From User](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_110.jpg){kind=link}
![References ... [41] A. Ispas, H. Schuldt, M.C. Norrie and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_111.jpg){kind=link}
![References ... [43] B. Signer, R. Roels, R. van Barlingen](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_112.jpg){kind=link}
![References ... [45] X. Zhang, M. Ilić and B. Signer,](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_113.jpg){kind=link}
![References ... [47] P. Van Der Paelt, B. Lauwens and](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_114.jpg){kind=link}
![References ... [49] Q. Xu and B. Signer, An Empirical](https://files.speakerdeck.com/presentations/37d40f6a45b249d29e7650dd6e523a4d/slide_115.jpg){kind=link}