A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

Presentation given at ICPCA 2008, 3rd International Conference on Pervasive Computing and Applications, Alexandria, Egypt.

ABSTRACT: We present a framework that supports the development of pervasive cross-media applications through a clean separation of interaction design and application programming. The approach is based on a novel concept of active components that provides a lightweight mechanism for linking physical and digital entities to services. We show how the development of cross-media applications can be simplified by adopting an authoring rather than a programming approach and how we achieved this by integrating the active component concept into an extensible hypermedia server.

Research paper: https://beatsigner.com/publications/a-framework-for-developing-pervasive-cross-media-applications-based-on-physical-hypermedia-and-active-components.pdf

Transcript

1. ICPCA 2008, October 7
   A Framework for Developing Pervasive
   Cross-Media Applications based on Physical
   Hypermedia and Active Components
   Beat Signer and Moira C. Norrie
   Institute for Information Systems, ETH Zurich
   8092 Zurich, Switzerland
   

   View Slide

2. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Pervasive Cross-Media Applications
   The Lost Cosmonaut
   iTable PaperPoint
   EdFest
   

   View Slide

3. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Cross-Media Link Server
   

   View Slide

4. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   RSL Metamodel and iServer
   

   View Slide

5. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   iServer Resource Plug-ins
   Resource
   RFID space
   XHTML document
   document page
   mpeg file, avi file etc.
   mpeg file, avi file etc.
   mp3 file, wav file etc.
   gif file, jpeg file etc.
   ...
   Medium
   physical object
   web page
   paper
   movie
   movie
   sound
   image
   ...
   Selector
   RFID tag
   XPointer
   shape
   time span
   shape
   time span
   shape
   ...
   

   View Slide

6. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Active Components
   
   
   
   Show slide 1
   
   
   org.ximtec.iserver.ac:command
   showSlide
   
   
   org.ximtec.iserver.ac:slide
   1
   
   
   PAPERPOINT_CONTROL
   
   ...
   
   PAPERPOINT_CONTROL
   Show slide 1
   command showSlide
   slide 1
   

   View Slide

7. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Active Components ...
   ▪ Execute code (services) on the client and server side
   Active Component
   A
   Active Component
   B
   Active Component
   C
   iServer
   AC Manager
   Server
   Request Sender
   Active Component
   Stub B
   AC Names
   ACS Manager
   Client Device
   AC Names
   Client
   HTTP
   

   View Slide

8. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Active Components ...
   

   View Slide

9. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
   Active Components ...
   package org.ximtec.iserver.activecomponent.logic;
   public class CommandLine extends EmptyLogic {
   }
   package org.ximtec.iserver.activecomponent.stub;
   import java.io.IOException;
   ...
   public class CommandLineStub extends SingleEventStub {
   public static final String PARAM_COMMAND = "command";
   public void finish() {
   try {
   Runtime.getRuntime().exec(getParameter(PARAM_COMMAND));
   }
   catch (IOException e) {
   LOGGER.log(Level.SEVERE, Constant.EMPTY_STRING, e);
   }
   } // finish
   }
   

   View Slide

10. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Active Components ...
    

    View Slide

11. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Active Components ...
    Button
    Slider
    Slider2D
    DateSelector
    Browser
    MapSelector
    Capture
    CaptureAndOcr
    CaptureAndSpeak
    Image
    Sound
    Movie
    SQLClient
    XCMRequest
    ClientCtrlRequest
    PaperPointControl
    PaperPointAnnot
    ...
    

    View Slide

12. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Slider / Slider2D Active Component
    

    View Slide

13. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Cross-Media Authoring Tool
    

    View Slide

14. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Active Components Editor
    PAPERPOINT_CONTROL
    Show slide 1
    command showSlide
    slide 1
    

    View Slide

15. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    The Lost Cosmonaut
    ▪ Writing as a collaborative
    act of memory and story-
    telling
    ▪ Reading, writing and
    narrative as an act of
    making sense
    ▪ Handwriting as a tool for
    human computer
    interaction
    In collaboration with Axel Vogelsang,
    Artists in Labs Programme
    

    View Slide

16. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Conclusions
    ▪ Separation of interaction design and application
    programming
    ▪ Authoring rather than programming approach
    ▪ Extensible cross-media framework
    ▪ modular and extensible active components
    ▪ resource plug-ins
    ▪ Rapid prototyping
    

    View Slide

17. ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch
    Further Information
    ▪ https://beatsigner.com/interactive-paper.html
    ▪ Fundamental Concepts for Interactive Paper
    and Cross-Media Information Spaces, Beat
    Signer, ISBN 978-3-8370-2713-6, May 2008
    Prof. Moira Norrie Dr. Beat Signer Nadir Weibel Adriana Ispas
    

    View Slide