Interactive Paper: Past, Present and Future

Presentation given at PaperComp 2010, 1st International Workshop on Paper Computing, Copenhagen, Denmark.

ABSTRACT: Over the last few years, there has been a significant increase in the number of researchers dealing with the integration of paper and digital information or services. While recent technological developments enable new forms of paper-digital integration and interaction, some of the original research on interactive paper dates back almost twenty years. We give a brief overview of the most relevant past and current interactive paper developments. Then, based on our experience in developing a wide variety of interactive paper solutions over the last decade, as well as the results of other research groups, we outline future directions and challenges for the realisation of innovative interactive paper solutions.
Further, we propose the definition of common data formats and interactive paper design patterns to ensure future cross-application and framework interoperability.

Research paper: https://beatsigner.com/publications/interactive-paper-past-present-and-future.pdf

Transcript

1. PaperComp 2010, September 26, 2010
   Interactive Paper: Past, Present and Future
   Beat Signer and Moira C. Norrie
   Department of Computer Science
   Vrije Universiteit Brussel
   beatsigner.com
   

   View Slide

2. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Paper Computing in the Past
   Reading Wheel, Ramelli, 1588
   Punch Cards, since ca. 1725
   Electro Junior Toy
   

   View Slide

3. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Paper Computing in the Past ...
   DigitalDesk, Wellner, 1991 Listen Reader, Back et al., 2000
   Ariel, Mackay et al., 1995 Audio Notebook, Stifelman, 1993
   

   View Slide

4. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Current Approaches
   Amazon Kindle Anoto Digital Pen and Paper Technology
   Augmented Paper
   Electronic Paper
   

   View Slide

5. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Interactive Paper Frameworks
   ▪ Tools offered by Anoto
   ▪ SDK for PC applications and network applications
   ▪ Forms Design Kit (FDK)
   ▪ PaperToolkit
   ▪ integration of interactive and batched input handling
   ▪ Letras
   ▪ distributed event processing pipeline
   

   View Slide

6. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Interactive Paper Frameworks
   ▪ iPaper
   ▪ information-centric approach supports different
   technologies, functionalities and applications
   ▪ separation of authoring and programming
   ▪ rapid prototyping (active components)
   ▪ Livescribe's Smartpen SDK
   ▪ application sharing and the user as a developer
   ▪ ...
   

   View Slide

7. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Future Challenges and Directions
   ▪ Future challenges for augmented and interactive
   paper solutions include
   ▪ software framework interoperability and scalability
   ▪ automatic application deployment
   ▪ hardware and material sciences
   ▪ visual and interaction design
   ▪ cross-media information management
   ▪ deeper understanding of existing work practices
   ▪ …
   

   View Slide

8. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Input Device Independence
   iPaper, Paper++ Project, 2001 iPaper, Paper++ Project, 2003
   iPaper, EdFest Project, 2005 iPaper, The Lost Cosmonaut Project, 2004
   

   View Slide

9. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
   Input Device Independence ...
   Bähr et al., PaperComp 2010 Bonnard et al., PaperComp 2010
   Portocarrero et al., PaperComp 2010 Suzuki et al., PaperComp 2010
   

   View Slide

10. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Digital Ink Abstraction
    ▪ Most frameworks and toolkits define their own
    proprietary digital ink representation
    ▪ existing standards (e.g. InkML) are often not used
    ▪ is there a need for new common data formats?
    ▪ Common data formats can help to
    ▪ exchange data between applications and across
    different interactive paper frameworks
    ▪ realise mixed-media environments
    

    View Slide

11. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Scalability and Application Deployment
    ▪ Problem of existing augmented paper solutions
    ▪ isolated applications
    ▪ missing cross-application interaction
    ▪ Interactive Paper 2.0
    ▪ global and open architecture
    ▪ unique resolving of interactive paper services based
    on a global paper lookup service (PLS)
    - automatic application deployment
    ▪ service oriented architecture to enable cross-
    application interaction and composition
    

    View Slide

12. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Visual and Interaction Design
    ▪ Visualisation of interactive
    areas and functionality
    • design patterns
    ▪ Interaction design
    • online versus offline
    input processing
    • lack of modal dialogues
    • multimodal interaction
    EdFest Project, 2004
    EdFest Project, 2005
    ▪ Findings might be applicable to traditional GUIs
    ▪ e.g. cross-application widget interaction
    

    View Slide

13. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Innovative Hardware and Materials
    ▪ Mobile solutions for feed-
    back on paper documents
    • spatially aware pro-
    jection of information
    • digital pen with display
    • voice feedback
    • ...
    ▪ Fusion of electronic paper
    and interactive paper
    • printed electronics
    MouseLight, Song et al., 2010
    PaperWorks Project, 2007
    

    View Slide

14. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Paper-Digital Authoring and Publishing
    ▪ Manual authoring
    ▪ Content-driven publishing
    • e.g. EdFest brochure
    • integration with third-
    party applications
    • what about versioning?
    ▪ Automatic link authoring
    • e.g. Print-n-Link
    ▪ Collaborative authoring
    iPaper Manual Authoring Tool
    Print-n-Link, 2006
    

    View Slide

15. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Conclusions
    ▪ Various approaches for interactive paper and
    paper computing
    ▪ are we missing a common abstraction layer in existing
    architectures and do we need Interactive Paper 2.0?
    ▪ It might be the right time to think about the
    integration of existing solutions to share efforts
    ▪ cross-disciplinary workshops
    - e.g. CoPADD and PaperComp
    ▪ Network of Excellence (NoE)?
    

    View Slide

16. PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - bsigner@vub.ac.be
    Further Information
    ▪ Fundamental Concepts for Interactive Paper
    and Cross-Media Information Spaces, Beat
    Signer, ISBN 978-3-8370-2713-6, May 2008
    ▪ Interactive Paper: Past, Present and Future
    ▪ https://vub.academia.edu/BeatSigner/Papers/216727/Inter
    active_Paper_Past_Present_and_Future
    ▪ Research papers about iPaper are available on
    ▪ https://vub.academia.edu/BeatSigner
    ▪ Presentation available on
    ▪ https://www.slideshare.net/signer/
    

    View Slide