Integrating Paper and Digital Information Spaces - The iServer / iPaper Solution

Presentation given at DFKI research seminar, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany.

1. 31 March 2008 Integrating Paper and Digital Information Spaces The iServer / iPaper Solution Beat Signer Global Information Systems Group Department of Computer Science ETH Zurich
2. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Paper in Everyday Settings
3. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Input Devices
4. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar 4 4 Digital Pen and Paper ▪ Developed by Anoto ▪ Different pen manufacturers ▪ Logitech, Maxel, Nokia, Adapx, Livescribe ... ▪ Pattern space ▪ 60 million km2
5. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Interactive Paper Linking active areas to resources image video clip
6. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar iPaper @ ETH Zurich Cross-Media Link Infrastructure Tools Publishing Applications
7. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Interactive Paper Applications ▪ Enhanced Reading ▪ interactive paper maps ▪ interactive festival brochures ▪ educational materials ▪ auction brochures ▪ scientific publications ▪ … ▪ Enhanced Writing ▪ proof-editing system ▪ photo album ▪ researcher's notebook ▪ mammography ▪ search system ▪ … ▪ Paper-Based Interfaces ▪ PaperPoint ▪ image retrieval / digital libraries ▪ video analysis tool ▪ educational games ▪ Artists' Installations ▪ Lost Cosmonaut ▪ Generosa Enterprise ▪ Interactive TableTops http://www.globis.ethz.ch/research/paper/applications/
8. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar PaperPoint Presentation Tool ▪ Mobile presentation tool ▪ Non-linear presentations ▪ Paper-based real-time annotations ▪ Digital whiteboard ▪ Multi-pen support ▪ brainstorming
9. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar EdFest Project
10. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar EdFest Demo
11. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar EdFest Architecture Overview XCM content publishing platform iServer/iPaper cross-media link server Context Engine Client Controller Active Components Text-to-Speech Engine ICR Software handwriting recognition Metadata DB Appln DB Link DB Context DB iPaper Client
12. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Content Publishing Framework XCM content publishing XML data of festival venues and events iServer / iPaper cross-media link server • paper link data • active areas • layers • digital resources • user model import publish PDF XML link definition data iPublish publishing framework Structure Style XSL CSS
13. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Design of Interactive Paper Documents
14. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Rough Guide
15. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar PaperProof
16. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Paper-Digital Structural Mapping ▪ Dual document representation in digital and physical document spaces
17. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Print-n-Link ▪ Citations build the basis for a scientific web of publications ▪ Use digital services to search / retrieve cited publications ▪ Automatic authoring
18. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Other iPaper Applications … PaperWeb Natural History Museum Lost Cosmonaut (Axel Vogelsang) iTable (Google Earth)
19. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Different Types of Link Authoring ▪ Manual authoring of links ▪ Content publishing framework for Interactive Paper ▪ EdFest brochure – PDF and links generated from publishing database ▪ Automatic authoring of links based on document analysis (PDF) ▪ Print-n-Link system for scientific publications ▪ Collaborative authoring based on P2P link sharing
20. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Digital Link Authoring Tool
21. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar iPaper Architecture
22. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar RSL Metamodel and Resource Plug-ins iPaper Shape Page Application Database DB Object Data/Metadata Query Movie Clips Time Span / Spatial Info Movie Clip HTML Documents XPointer XHTML Document Selectors Entities Resources link
23. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Links Users Layers Plug-ins Structure Active Content
24. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar RSL Links
25. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar RSL Structural Links
26. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar RSL Structural Links … ▪ Structure over data ▪ e.g. regular document (chapters, sections, ...) ▪ reuse of resources → transclusion (Ted Nelson) ▪ context-dependant structures ▪ Structure over structures ▪ structural composition of data and substructures can be combined
27. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar RSL Structural Links … ▪ Structure over links ▪ put different navigational links in relation to each other ▪ e.g. single structural link to define linear order over set of links → trails and tours
28. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Active Content ▪ Execute code (services) on the client and server side Active Component A Active Component B Active Component C iServer AC Manager Server Request Sender Active Component Stub B AC Names ACS Manager Client Device AC Names Client HTTP
29. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Active Components Button Slider Slider2D DateSelector Browser MapSelector Rating Capture CaptureAndSpeak Image Sound Movie SQLClient XCMRequest ClientCtrlRequest PaperPointControl PaperPointAnnot ...
30. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar iServer Interfaces ▪ Java API ▪ XML import and export ▪ Web Service ▪ Interface based on XML and XSLT ▪ XHTML ▪ WAP, i-mode ▪ VoiceXML
31. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar Conclusions ▪ General framework for interactive paper ▪ Cross-media information server ▪ extensibility (resource plug-ins) ▪ link service acessible through various APIs ▪ active content ▪ Novel forms of interactive paper publishing and paper-based user interfaces
32. 31 March 2008 Beat Signer <signer@inf.ethz.ch> / ETH Zurich DFKI Seminar References ▪ iPaper webpage ▪ http://www.ipaper.inf.ethz.ch ▪ YouTube videos ▪ http://www.youtube.com/user/ethglobis ▪ Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, B. Signer, Dissertation ETH Zurich Nr. 16218, 2006