A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

Presentation given at ICPCA 2008, 3rd International Conference on Pervasive Computing and Applications, Alexandria, Egypt.

ABSTRACT: We present a framework that supports the development of pervasive cross-media applications through a clean separation of interaction design and application programming. The approach is based on a novel concept of active components that provides a lightweight mechanism for linking physical and digital entities to services. We show how the development of cross-media applications can be simplified by adopting an authoring rather than a programming approach and how we achieved this by integrating the active component concept into an extensible hypermedia server.

Research paper: https://beatsigner.com/publications/a-framework-for-developing-pervasive-cross-media-applications-based-on-physical-hypermedia-and-active-components.pdf

Transcript

1. ICPCA 2008, October 7 A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components Beat Signer and Moira C. Norrie Institute for Information Systems, ETH Zurich 8092 Zurich, Switzerland
2. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Pervasive Cross-Media Applications The Lost Cosmonaut iTable PaperPoint EdFest
3. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Cross-Media Link Server
4. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch RSL Metamodel and iServer
5. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch iServer Resource Plug-ins Resource RFID space XHTML document document page mpeg file, avi file etc. mpeg file, avi file etc. mp3 file, wav file etc. gif file, jpeg file etc. ... Medium physical object web page paper movie movie sound image ... Selector RFID tag XPointer shape time span shape time span shape ...
6. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components <?xml version="1.0" encoding="UTF-8" ?> <iserver> <activeComponent id="s1a" creator="beat"> <name>Show slide 1</name> <properties> <parameter> <key>org.ximtec.iserver.ac:command</key> <value>showSlide</value> </parameter> <parameter> <key>org.ximtec.iserver.ac:slide</key> <value>1</value> </parameter> </properties> <identifier>PAPERPOINT_CONTROL</identifier> </activeComponent> ... </iserver> PAPERPOINT_CONTROL Show slide 1 command showSlide slide 1
7. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components ... ▪ Execute code (services) on the client and server side Active Component A Active Component B Active Component C iServer AC Manager Server Request Sender Active Component Stub B AC Names ACS Manager Client Device AC Names Client HTTP
8. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components ...
9. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components ... package org.ximtec.iserver.activecomponent.logic; public class CommandLine extends EmptyLogic { } package org.ximtec.iserver.activecomponent.stub; import java.io.IOException; ... public class CommandLineStub extends SingleEventStub { public static final String PARAM_COMMAND = "command"; public void finish() { try { Runtime.getRuntime().exec(getParameter(PARAM_COMMAND)); } catch (IOException e) { LOGGER.log(Level.SEVERE, Constant.EMPTY_STRING, e); } } // finish }
10. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components ...
11. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components ... Button Slider Slider2D DateSelector Browser MapSelector Capture CaptureAndOcr CaptureAndSpeak Image Sound Movie SQLClient XCMRequest ClientCtrlRequest PaperPointControl PaperPointAnnot ...
12. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Slider / Slider2D Active Component
13. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Cross-Media Authoring Tool
14. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Active Components Editor PAPERPOINT_CONTROL Show slide 1 command showSlide slide 1
15. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch The Lost Cosmonaut ▪ Writing as a collaborative act of memory and story- telling ▪ Reading, writing and narrative as an act of making sense ▪ Handwriting as a tool for human computer interaction In collaboration with Axel Vogelsang, Artists in Labs Programme
16. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Conclusions ▪ Separation of interaction design and application programming ▪ Authoring rather than programming approach ▪ Extensible cross-media framework ▪ modular and extensible active components ▪ resource plug-ins ▪ Rapid prototyping
17. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch Further Information ▪ https://beatsigner.com/interactive-paper.html ▪ Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Beat Signer, ISBN 978-3-8370-2713-6, May 2008 Prof. Moira Norrie Dr. Beat Signer Nadir Weibel Adriana Ispas