Towards Cross-Media Information Spaces and Architectures

Slide 1

Slide 1 text

2 December 2005 Towards Cross-Media Information Spaces and Architectures Prof. Beat Signer beatsigner.com Web & Information Systems Engineering Lab Department of Computer Science Vrije Universiteit Brussel

Slide 2

Slide 2 text

"As We May Think" (1945) ▪ Memex ▪ memory extender ▪ information retrieval ▪ associative trails ▪ trail blazers information overload

Slide 3

Slide 3 text

01001000100 0101001100010010100010010 0100100010010001000100001001000 100010001100001001000110010101010110 1100010010100010010010010100010101011001 101001100001100 101010100 0010100 100 110101010101 00100 01010101000 1001 1111111111 111 0000000010 0 11111111 0101001011 010101010 111010101 001010010110 Cross-Media Information Spaces

Slide 4

Slide 4 text

Fragmentation of information across different applications, devices and digital & physical information environments

Slide 5

Slide 5 text

Cross-Media Linking Flexible Document Representation Cross-Media User Interfaces

Slide 6

Slide 6 text

Data-centric approach for cross-media information solutions based on a hypermedia metamodel

Slide 7

Slide 7 text

Cross-Media Linking Flexible Document Representation Cross-Media User Interfaces

Slide 8

Slide 8 text

RSL Metamodel and Link Service Beat Signer and Moira C. Norrie, As We May Link: A General Metamodel for Hypermedia Systems, Proceedings of ER 2007, November 2007

Slide 9

Slide 9 text

EdFest: Paper-Digital Guide Global Information Systems Group ETH Zurich

Slide 10

Slide 10 text

PimVis: Personal Information Management Sandra Trullemans and Audrey Sanctorum

Slide 11

Slide 11 text

PimVis Document View Audrey Sanctorum

Slide 12

Slide 12 text

PimVis Focus View Audrey Sanctorum

Slide 13

Slide 13 text

Open Cross-Media Linking local visual plug-ins external visual plug-ins communicate Cross-Media Link Browser & Editor Ahmed A.O. Tayeh

Slide 14

Slide 14 text

Cross-Media Linking Flexible Document Representation Cross-Media User Interfaces

Slide 15

Slide 15 text

What is Wrong with Digital Documents? Most people don't understand the logic of the concept: "What You See Is What You Get" is based on printing the document out ("get" means "get WHEN YOU PRINT IT OUT"). And that means a metaphysical shift: a document can only consist of what can be printed! [...] No overlays [...] – PAPER UNDER GLASS. Ted Nelson, Geeks Bearing Gifts: How the Computer World Got This Way, Mindful Press 2009 Existing document formats often based on the simulation of paper affordances on desktop computers

Slide 16

Slide 16 text

What is Wrong with Slideware? ▪ Simulation of physical slides ▪ limited space due to slide concept ▪ linear navigation ▪ monolithic documents ▪ difficult to reuse content and embed rich media types

Slide 17

Slide 17 text

MindXpres Presentation Platform ▪ Flexible representation of presentations ▪ use of structural RSL links ▪ separation of content and structure ▪ Extensible platform ▪ content-based approach ▪ cross-media content reuse ▪ non-linear navigation and zoomable user interface ▪ associative linking ▪ rich media types Reinout Roels

Slide 18

Slide 18 text

MindXpres Document Representation

Slide 19

Slide 19 text

video

Slide 20

Slide 20 text

Different context-dependent adaptive overlay structures on top of (parts of) content Clear separation between content and structure enables cross-media content reuse (transclusion)

Slide 21

Slide 21 text

Cross-Media Linking Flexible Document Representation Cross-Media User Interfaces

Slide 22

Slide 22 text

PimVis: Paper-Digital User Interface Sandra Trullemans and Audrey Sanctorum

Slide 23

Slide 23 text

ArtVis: Tangible User Interface Bram Moerman

Slide 24

Slide 24 text

Real-Time Cross-Media Data Exploration dynamic data physicalisation

Slide 25

Slide 25 text

Adaptive Distributed Hybrid User Interfaces Audrey Sanctorum and Beat Signer, A Unifying Reference Framework and Model for Adaptive Distributed Hybrid User Interfaces, Proceedings of RCIS 2019, May 2019 Audrey Sanctorum eSPACE reference framework and model

Slide 26

Slide 26 text

Cross-Media Linking Flexible Document Representation Cross-Media User Interfaces

Slide 27

Slide 27 text

Unified Cross-Media Information Spaces

Slide 28

Slide 28 text

Common underlying representation of cross-media links and structures via RSL hypermedia metamodel

Slide 29

Slide 29 text

"Operating System" of the Future RSL-based Hypermedia Engine … Legacy Applications File System Driver Hypermedia-enabled Applications RCIS2019.docx RCIS2019.docx

Slide 30

Slide 30 text

References ▪ B. Signer, Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Second Edition, ISBN 978-3-8370-2713-6, August 2017 ▪ B. Signer and M.C. Norrie, As We May Link: A General Metamodel for Hypermedia Systems, Proceedings of ER 2007, 26th International Conference on Conceptual Modeling, Auckland, New Zealand, November 2007 ▪ http://beatsigner.com/publications/signer_ER2007.pdf

Slide 31

Slide 31 text

References ... ▪ B. Signer, What is Wrong with Digital Documents? A Conceptual Model for Structural Cross- Media Content Composition and Reuse, Proceedings of the 29th International Conference on Conceptual Mod- eling (ER 2010), Vancouver, Canada, November 2010 ▪ http://beatsigner.com/publications/signer_ER2010.pdf ▪ R. Roels and B. Signer, A Conceptual Framework and Content Model for Next Generation Presentation Solutions, Proceedings of the ACM on Human-Computer Interaction (PACMHCI), 2019 ▪ http://beatsigner.com/publications/sanctorum_RCIS2019.pdf

Slide 32

Slide 32 text

References ... ▪ S. Trullemans, A. Sanctorum and B. Signer, PimVis: Exploring and Re-finding Documents in Cross- Media Information Spaces, Proceedings of AVI 2016, International Working Conference on Advanced Visual Interfaces, Bari, Italy, June 2016 ▪ http://beatsigner.com/publications/trullemans_AVI2016.pdf ▪ B. Dumas, B. Moerman, S. Trullemans and B. Signer, ArtVis: Combining Advanced Visualisation and Tangible Interaction for the Exploration, Analysis and Browsing of Digital Artwork Collections, Proceedings of AVI 2014, Como, Italy, May 2014 ▪ http://beatsigner.com/publications/dumas_AVI2014.pdf

Slide 33

Slide 33 text

References ... ▪ B. Signer and T.J. Curtin, Tangible Holograms: Towards Mobile Physical Augmentation of Virtual Objects, Technical Report WISE Lab, WISE-2017-01, March 2017 ▪ http://beatsigner.com/publications/signer_arXiv2017.pdf ▪ A.A.O Tayeh and B. Signer, A Dynamically Extensible Open Cross-Document Link Service, Proceedings of WISE 2015, 16th International Conference on Web Information Systems Engineering, Miami, USA, November, 2015 ▪ http://beatsigner.com/publications/tayeh_WISE2015.pdf

Slide 34

Slide 34 text

References ... ▪ A. Sanctorum and B. Signer, A Unifying Reference Framework and Model for Adaptive Distributed Hybrid User Interfaces, Proceedings of RCIS 2019, 13th International Conference on Research Challenges in Information Science, Brussels, Belgium, May 2019 ▪ https://beatsigner.com/publications/sanctorum_RCIS2019.pdf