Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive Paper: Past, Present and Future

Beat Signer
September 26, 2010

Interactive Paper: Past, Present and Future

Presentation given at PaperComp 2010, 1st International Workshop on Paper Computing, Copenhagen, Denmark.

ABSTRACT: Over the last few years, there has been a significant increase in the number of researchers dealing with the integration of paper and digital information or services. While recent technological developments enable new forms of paper-digital integration and interaction, some of the original research on interactive paper dates back almost twenty years. We give a brief overview of the most relevant past and current interactive paper developments. Then, based on our experience in developing a wide variety of interactive paper solutions over the last decade, as well as the results of other research groups, we outline future directions and challenges for the realisation of innovative interactive paper solutions.
Further, we propose the definition of common data formats and interactive paper design patterns to ensure future cross-application and framework interoperability.

Research paper: https://beatsigner.com/publications/interactive-paper-past-present-and-future.pdf

Beat Signer

September 26, 2010
Tweet

More Decks by Beat Signer

Other Decks in Science

Transcript

  1. PaperComp 2010, September 26, 2010
    Interactive Paper: Past, Present and Future
    Beat Signer and Moira C. Norrie
    Department of Computer Science
    Vrije Universiteit Brussel
    beatsigner.com

    View full-size slide

  2. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Paper Computing in the Past
    Reading Wheel, Ramelli, 1588
    Punch Cards, since ca. 1725
    Electro Junior Toy

    View full-size slide

  3. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Paper Computing in the Past ...
    DigitalDesk, Wellner, 1991 Listen Reader, Back et al., 2000
    Ariel, Mackay et al., 1995 Audio Notebook, Stifelman, 1993

    View full-size slide

  4. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Current Approaches
    Amazon Kindle Anoto Digital Pen and Paper Technology
    Augmented Paper
    Electronic Paper

    View full-size slide

  5. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Interactive Paper Frameworks
    ▪ Tools offered by Anoto
    ▪ SDK for PC applications and network applications
    ▪ Forms Design Kit (FDK)
    ▪ PaperToolkit
    ▪ integration of interactive and batched input handling
    ▪ Letras
    ▪ distributed event processing pipeline

    View full-size slide

  6. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Interactive Paper Frameworks
    ▪ iPaper
    ▪ information-centric approach supports different
    technologies, functionalities and applications
    ▪ separation of authoring and programming
    ▪ rapid prototyping (active components)
    ▪ Livescribe's Smartpen SDK
    ▪ application sharing and the user as a developer
    ▪ ...

    View full-size slide

  7. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Future Challenges and Directions
    ▪ Future challenges for augmented and interactive
    paper solutions include
    ▪ software framework interoperability and scalability
    ▪ automatic application deployment
    ▪ hardware and material sciences
    ▪ visual and interaction design
    ▪ cross-media information management
    ▪ deeper understanding of existing work practices
    ▪ …

    View full-size slide

  8. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Input Device Independence
    iPaper, Paper++ Project, 2001 iPaper, Paper++ Project, 2003
    iPaper, EdFest Project, 2005 iPaper, The Lost Cosmonaut Project, 2004

    View full-size slide

  9. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Input Device Independence ...
    Bähr et al., PaperComp 2010 Bonnard et al., PaperComp 2010
    Portocarrero et al., PaperComp 2010 Suzuki et al., PaperComp 2010

    View full-size slide

  10. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Digital Ink Abstraction
    ▪ Most frameworks and toolkits define their own
    proprietary digital ink representation
    ▪ existing standards (e.g. InkML) are often not used
    ▪ is there a need for new common data formats?
    ▪ Common data formats can help to
    ▪ exchange data between applications and across
    different interactive paper frameworks
    ▪ realise mixed-media environments

    View full-size slide

  11. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Scalability and Application Deployment
    ▪ Problem of existing augmented paper solutions
    ▪ isolated applications
    ▪ missing cross-application interaction
    ▪ Interactive Paper 2.0
    ▪ global and open architecture
    ▪ unique resolving of interactive paper services based
    on a global paper lookup service (PLS)
    - automatic application deployment
    ▪ service oriented architecture to enable cross-
    application interaction and composition

    View full-size slide

  12. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Visual and Interaction Design
    ▪ Visualisation of interactive
    areas and functionality
    • design patterns
    ▪ Interaction design
    • online versus offline
    input processing
    • lack of modal dialogues
    • multimodal interaction
    EdFest Project, 2004
    EdFest Project, 2005
    ▪ Findings might be applicable to traditional GUIs
    ▪ e.g. cross-application widget interaction

    View full-size slide

  13. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Innovative Hardware and Materials
    ▪ Mobile solutions for feed-
    back on paper documents
    • spatially aware pro-
    jection of information
    • digital pen with display
    • voice feedback
    • ...
    ▪ Fusion of electronic paper
    and interactive paper
    • printed electronics
    MouseLight, Song et al., 2010
    PaperWorks Project, 2007

    View full-size slide

  14. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Paper-Digital Authoring and Publishing
    ▪ Manual authoring
    ▪ Content-driven publishing
    • e.g. EdFest brochure
    • integration with third-
    party applications
    • what about versioning?
    ▪ Automatic link authoring
    • e.g. Print-n-Link
    ▪ Collaborative authoring
    iPaper Manual Authoring Tool
    Print-n-Link, 2006

    View full-size slide

  15. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Conclusions
    ▪ Various approaches for interactive paper and
    paper computing
    ▪ are we missing a common abstraction layer in existing
    architectures and do we need Interactive Paper 2.0?
    ▪ It might be the right time to think about the
    integration of existing solutions to share efforts
    ▪ cross-disciplinary workshops
    - e.g. CoPADD and PaperComp
    ▪ Network of Excellence (NoE)?

    View full-size slide

  16. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]
    Further Information
    ▪ Fundamental Concepts for Interactive Paper
    and Cross-Media Information Spaces, Beat
    Signer, ISBN 978-3-8370-2713-6, May 2008
    ▪ Interactive Paper: Past, Present and Future
    ▪ https://vub.academia.edu/BeatSigner/Papers/216727/Inter
    active_Paper_Past_Present_and_Future
    ▪ Research papers about iPaper are available on
    ▪ https://vub.academia.edu/BeatSigner
    ▪ Presentation available on
    ▪ https://www.slideshare.net/signer/

    View full-size slide