Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

Beat Signer
October 07, 2008

A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

Presentation given at ICPCA 2008, 3rd International Conference on Pervasive Computing and Applications, Alexandria, Egypt.

ABSTRACT: We present a framework that supports the development of pervasive cross-media applications through a clean separation of interaction design and application programming. The approach is based on a novel concept of active components that provides a lightweight mechanism for linking physical and digital entities to services. We show how the development of cross-media applications can be simplified by adopting an authoring rather than a programming approach and how we achieved this by integrating the active component concept into an extensible hypermedia server.

Research paper: https://beatsigner.com/publications/a-framework-for-developing-pervasive-cross-media-applications-based-on-physical-hypermedia-and-active-components.pdf

Beat Signer

October 07, 2008
Tweet

More Decks by Beat Signer

Other Decks in Science

Transcript

  1. ICPCA 2008, October 7
    A Framework for Developing Pervasive
    Cross-Media Applications based on Physical
    Hypermedia and Active Components
    Beat Signer and Moira C. Norrie
    Institute for Information Systems, ETH Zurich
    8092 Zurich, Switzerland

    View full-size slide

  2. ICPCA 2008, October 7 Beat Signer, [email protected]
    Pervasive Cross-Media Applications
    The Lost Cosmonaut
    iTable PaperPoint
    EdFest

    View full-size slide

  3. ICPCA 2008, October 7 Beat Signer, [email protected]
    Cross-Media Link Server

    View full-size slide

  4. ICPCA 2008, October 7 Beat Signer, [email protected]
    RSL Metamodel and iServer

    View full-size slide

  5. ICPCA 2008, October 7 Beat Signer, [email protected]
    iServer Resource Plug-ins
    Resource
    RFID space
    XHTML document
    document page
    mpeg file, avi file etc.
    mpeg file, avi file etc.
    mp3 file, wav file etc.
    gif file, jpeg file etc.
    ...
    Medium
    physical object
    web page
    paper
    movie
    movie
    sound
    image
    ...
    Selector
    RFID tag
    XPointer
    shape
    time span
    shape
    time span
    shape
    ...

    View full-size slide

  6. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components



    Show slide 1


    org.ximtec.iserver.ac:command
    showSlide


    org.ximtec.iserver.ac:slide
    1


    PAPERPOINT_CONTROL

    ...

    PAPERPOINT_CONTROL
    Show slide 1
    command showSlide
    slide 1

    View full-size slide

  7. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components ...
    ▪ Execute code (services) on the client and server side
    Active Component
    A
    Active Component
    B
    Active Component
    C
    iServer
    AC Manager
    Server
    Request Sender
    Active Component
    Stub B
    AC Names
    ACS Manager
    Client Device
    AC Names
    Client
    HTTP

    View full-size slide

  8. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components ...

    View full-size slide

  9. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components ...
    package org.ximtec.iserver.activecomponent.logic;
    public class CommandLine extends EmptyLogic {
    }
    package org.ximtec.iserver.activecomponent.stub;
    import java.io.IOException;
    ...
    public class CommandLineStub extends SingleEventStub {
    public static final String PARAM_COMMAND = "command";
    public void finish() {
    try {
    Runtime.getRuntime().exec(getParameter(PARAM_COMMAND));
    }
    catch (IOException e) {
    LOGGER.log(Level.SEVERE, Constant.EMPTY_STRING, e);
    }
    } // finish
    }

    View full-size slide

  10. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components ...

    View full-size slide

  11. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components ...
    Button
    Slider
    Slider2D
    DateSelector
    Browser
    MapSelector
    Capture
    CaptureAndOcr
    CaptureAndSpeak
    Image
    Sound
    Movie
    SQLClient
    XCMRequest
    ClientCtrlRequest
    PaperPointControl
    PaperPointAnnot
    ...

    View full-size slide

  12. ICPCA 2008, October 7 Beat Signer, [email protected]
    Slider / Slider2D Active Component

    View full-size slide

  13. ICPCA 2008, October 7 Beat Signer, [email protected]
    Cross-Media Authoring Tool

    View full-size slide

  14. ICPCA 2008, October 7 Beat Signer, [email protected]
    Active Components Editor
    PAPERPOINT_CONTROL
    Show slide 1
    command showSlide
    slide 1

    View full-size slide

  15. ICPCA 2008, October 7 Beat Signer, [email protected]
    The Lost Cosmonaut
    ▪ Writing as a collaborative
    act of memory and story-
    telling
    ▪ Reading, writing and
    narrative as an act of
    making sense
    ▪ Handwriting as a tool for
    human computer
    interaction
    In collaboration with Axel Vogelsang,
    Artists in Labs Programme

    View full-size slide

  16. ICPCA 2008, October 7 Beat Signer, [email protected]
    Conclusions
    ▪ Separation of interaction design and application
    programming
    ▪ Authoring rather than programming approach
    ▪ Extensible cross-media framework
    ▪ modular and extensible active components
    ▪ resource plug-ins
    ▪ Rapid prototyping

    View full-size slide

  17. ICPCA 2008, October 7 Beat Signer, [email protected]
    Further Information
    ▪ https://beatsigner.com/interactive-paper.html
    ▪ Fundamental Concepts for Interactive Paper
    and Cross-Media Information Spaces, Beat
    Signer, ISBN 978-3-8370-2713-6, May 2008
    Prof. Moira Norrie Dr. Beat Signer Nadir Weibel Adriana Ispas

    View full-size slide