31 March 2008
Integrating Paper and Digital Information Spaces
The iServer / iPaper Solution
Beat Signer
Global Information Systems Group
Department of Computer Science
ETH Zurich
Slide 2
Slide 2 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Paper in Everyday Settings
Slide 3
Slide 3 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Input Devices
Slide 4
Slide 4 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
4
4
Digital Pen and Paper
▪ Developed by Anoto
▪ Different pen manufacturers
▪ Logitech, Maxel, Nokia,
Adapx, Livescribe ...
▪ Pattern space
▪ 60 million km2
Slide 5
Slide 5 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Interactive Paper
Linking active areas to resources
image
video clip
Slide 6
Slide 6 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
iPaper @ ETH Zurich
Cross-Media
Link Infrastructure
Tools
Publishing
Applications
Slide 7
Slide 7 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Interactive Paper Applications
▪ Enhanced Reading
▪ interactive paper maps
▪ interactive festival brochures
▪ educational materials
▪ auction brochures
▪ scientific publications
▪ …
▪ Enhanced Writing
▪ proof-editing system
▪ photo album
▪ researcher's notebook
▪ mammography
▪ search system
▪ …
▪ Paper-Based Interfaces
▪ PaperPoint
▪ image retrieval / digital libraries
▪ video analysis tool
▪ educational games
▪ Artists' Installations
▪ Lost Cosmonaut
▪ Generosa Enterprise
▪ Interactive TableTops
http://www.globis.ethz.ch/research/paper/applications/
Slide 8
Slide 8 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
PaperPoint Presentation Tool
▪ Mobile presentation tool
▪ Non-linear presentations
▪ Paper-based real-time
annotations
▪ Digital whiteboard
▪ Multi-pen support
▪ brainstorming
Slide 9
Slide 9 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
EdFest Project
Slide 10
Slide 10 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
EdFest Demo
Slide 11
Slide 11 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
EdFest Architecture Overview
XCM
content publishing
platform
iServer/iPaper
cross-media
link server
Context
Engine
Client
Controller
Active
Components
Text-to-Speech
Engine
ICR Software
handwriting
recognition
Metadata DB Appln DB
Link DB
Context DB
iPaper Client
Slide 12
Slide 12 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Content Publishing Framework
XCM
content publishing
XML data of
festival venues
and events
iServer / iPaper
cross-media link server
• paper link data
• active areas
• layers
• digital resources
• user model
import
publish
PDF
XML link
definition
data
iPublish
publishing framework
Structure Style
XSL CSS
Slide 13
Slide 13 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Design of Interactive Paper Documents
Slide 14
Slide 14 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Rough Guide
Slide 15
Slide 15 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
PaperProof
Slide 16
Slide 16 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Paper-Digital Structural Mapping
▪ Dual document representation in digital and
physical document spaces
Slide 17
Slide 17 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Print-n-Link
▪ Citations build the basis
for a scientific web of
publications
▪ Use digital services to
search / retrieve cited
publications
▪ Automatic authoring
Slide 18
Slide 18 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Other iPaper Applications …
PaperWeb Natural History Museum
Lost Cosmonaut (Axel Vogelsang) iTable (Google Earth)
Slide 19
Slide 19 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Different Types of Link Authoring
▪ Manual authoring of links
▪ Content publishing framework for Interactive Paper
▪ EdFest brochure – PDF and links generated from
publishing database
▪ Automatic authoring of links based on document
analysis (PDF)
▪ Print-n-Link system for scientific publications
▪ Collaborative authoring based on P2P link sharing
Slide 20
Slide 20 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Digital Link Authoring Tool
Slide 21
Slide 21 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
iPaper Architecture
Slide 22
Slide 22 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
RSL Metamodel and Resource Plug-ins
iPaper
Shape Page
Application Database
DB Object
Data/Metadata
Query
Movie Clips
Time Span /
Spatial Info
Movie Clip
HTML Documents
XPointer XHTML
Document
Selectors
Entities
Resources
link
Slide 23
Slide 23 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Links
Users
Layers
Plug-ins
Structure
Active
Content
Slide 24
Slide 24 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
RSL Links
Slide 25
Slide 25 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
RSL Structural Links
Slide 26
Slide 26 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
RSL Structural Links …
▪ Structure over data
▪ e.g. regular document (chapters, sections, ...)
▪ reuse of resources → transclusion (Ted Nelson)
▪ context-dependant structures
▪ Structure over structures
▪ structural composition of data and substructures can
be combined
Slide 27
Slide 27 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
RSL Structural Links …
▪ Structure over links
▪ put different navigational links in relation to each other
▪ e.g. single structural link to define linear order over
set of links → trails and tours
Slide 28
Slide 28 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Active Content
▪ Execute code (services) on the client and server side
Active Component
A
Active Component
B
Active Component
C
iServer
AC Manager
Server
Request Sender
Active Component
Stub B
AC Names
ACS Manager
Client Device
AC Names
Client
HTTP
Slide 29
Slide 29 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Active Components
Button
Slider
Slider2D
DateSelector
Browser
MapSelector
Rating
Capture
CaptureAndSpeak
Image
Sound
Movie
SQLClient
XCMRequest
ClientCtrlRequest
PaperPointControl
PaperPointAnnot
...
Slide 30
Slide 30 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
iServer Interfaces
▪ Java API
▪ XML import and export
▪ Web Service
▪ Interface based on XML and XSLT
▪ XHTML
▪ WAP, i-mode
▪ VoiceXML
Slide 31
Slide 31 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
Conclusions
▪ General framework for interactive paper
▪ Cross-media information server
▪ extensibility (resource plug-ins)
▪ link service acessible through various APIs
▪ active content
▪ Novel forms of interactive paper publishing and
paper-based user interfaces
Slide 32
Slide 32 text
31 March 2008 Beat Signer / ETH Zurich DFKI Seminar
References
▪ iPaper webpage
▪ http://www.ipaper.inf.ethz.ch
▪ YouTube videos
▪ http://www.youtube.com/user/ethglobis
▪ Fundamental Concepts for Interactive Paper and
Cross-Media Information Spaces, B. Signer,
Dissertation ETH Zurich Nr. 16218, 2006