Interactive Paper - Introduction and Basic Technology & Interactive Paper - Applications and Future Developments

Presentation given at Y-Toolbox, Workshop about Paper, Y (Institute for Transdisciplinarity), Bern University of Arts, Bern, Switzerland.

Transcript

1. Y-Toolbox, April 17, 2008 Interactive Paper Introduction and Basic Technology Beat Signer Global Information Systems Research Group Department of Computer Science ETH Zurich
2. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The Paperless Office (1975)
3. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The "Paperless Office" (2003)
4. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The Myth of the Paperless Office ▪ For decades, people have predicted the office of the future as a paperless office ▪ documents generated, published and distributed electronically ▪ documents read electronically ▪ What has happened to this imminent revolution?
5. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Affordances of Paper ▪ The physical properties of an object determine how people use that object ▪ Properties of paper ▪ light, flexible, robust, porous, opaque, transparent, …. ▪ Human actions ▪ grasping, folding, tearing, carrying, writing, on …. ▪ Paper supports forms of collaboration and interaction difficult to mimic in the digital world
6. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Paper in Everyday Settings
7. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Electronic Paper (e-paper) ▪ E-Ink Cooperation ▪ paper-like high contrast appearance ▪ low power consumption ▪ thin, light form
8. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Augmenting the Physical Space ▪ Embedding computing functionality in everyday objects instead of digitising the physical environment At breakfast Sal reads the news. She still prefers the paper form, as do most people. She spots an interesting quote from a columnist in the business section. She wipes her pen over the newspaper’s name, date, section, and page number and then circles the quote. The pen sends a message to the paper, which transmits the quote to her office. The Computer for the 21st Century, Weiser, 1991
9. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Paper-Digital Integration Technologies ▪ Document (object) identification / tracking ▪ barcodes ▪ RFID tags ▪ optical tracking ▪ … ▪ Within-document position tracking ▪ relative/absolute positions ▪ support for mobility ▪ …
10. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Listen Reader (Maribeth Back et al.) ▪ Combines the look and feel of a real book with an interactive soundtrack ▪ RFID tags embedded in each page ▪ Electric field sensors in the book binding
11. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Digital Pen and Paper ▪ Developed by Anoto ▪ Different pen manufacturers ▪ Logitech, Maxel, Nokia, Adapx, Livescribe ... ▪ Pattern space ▪ 60 million km2
12. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Forms Automation Systems ▪ Capture form data ▪ data is processed and stored in a database ▪ Applications ▪ policies ▪ hospitals ▪ transporation ▪ ... ▪ No real-time interaction!
13. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Active Areas and Virtual Page Layers image video clip
14. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Cross-Media Link Server (iServer) consumers / publishers books publisher web pages videos presentation slides
15. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch iPaper @ ETH Zurich Cross-Media Link Infrastructure Tools Publishing Applications
16. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Edinburgh Fringe Festival ▪ World's largest international arts festival ▪ 4 weeks ▪ ~1700 events ▪ ~27000 performances
17. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch EdFest Project
18. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch EdFest User Trials
19. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch EdFest Demo
20. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Design of Interactive Paper Documents
21. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch References ▪ The Myth of the Paperless Office, A.J. Sellen and R. Harper, MIT Press, November 2001 ▪ Scrolling Forward: Making Sense of Documents in the Digital Age, D.M. Levy, October 2001 ▪ Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, B. Signer, Diss ETH Zurich Nr. 16218, 2006 ▪ https://beatsigner.com/interactive-paper.html
22. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Interactive Paper Applications ▪ Enhanced Reading ▪ interactive paper maps ▪ interactive festival brochures ▪ educational materials ▪ auction brochures ▪ scientific publications ▪ … ▪ Enhanced Writing ▪ photo album ▪ researcher's notebook ▪ mammography ▪ search system ▪ … ▪ Paper-Based Interfaces ▪ PaperPoint ▪ digital libraries ▪ video analysis tool ▪ educational games ▪ Artists' Installations ▪ Lost Cosmonaut ▪ Generosa Enterprise ▪ Interactive TableTops http://www.globis.ethz.ch/research/paper/applications/
23. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch PaperPoint Presentation Tool ▪ Mobile presentation tool ▪ Non-linear presentations ▪ Paper-based real-time annotations ▪ Digital whiteboard ▪ Multi-pen support ▪ brainstorming
24. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch PaperPoint Stickers ▪ Empty Stickers linked to specific PowerPoint slides ▪ Digital information (text, image, movie, ...) embedded in slides ▪ Mock-ups for interactive paper applications
25. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Rough Guide
26. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Natural History Museum, London
27. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Natural History Museum, London ...
28. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Natural History Museum, London ...
29. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Natural History Museum, London ...
30. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch DiDA (Diploma in Digital Applications)
31. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Mammography Annotations
32. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Print-n-Link ▪ Citations build the basis for a scientific web of publications ▪ Use digital services to search / retrieve cited publications ▪ Automatic authoring
33. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Print-n-Link …
34. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch PaperWeb ▪ Print arbitrary web pages with iDoc printer driver ▪ All hyperlinks become interactive on the printout version ▪ Automatic authoring of links
35. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Document Editing ▪ Digital and paper-based user interface ▪ Support for collaborative editing ▪ Multiple digital/physical editing iteration cycles Digital Document Printed Document
36. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch PaperProof
37. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Paper-Digital Structural Mapping ▪ Dual document representation in digital and physical document spaces
38. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch PaperProof
39. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The Lost Cosmonaut ▪ Writing as a collaborative act of memory and story- telling ▪ Reading, writing and narrative as an act of making sense ▪ Handwriting as a tool for human computer interaction In collaboration with Axel Vogelsang, Artists in Labs Programme
40. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The Lost Cosmonaut …
41. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch The Lost Cosmonaut …
42. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Generosa Enterprise ▪ Interactive drawing installation ▪ Exhibited at the 150 Years ETH Zurich Jubilee (more than 200'000 visitors)
43. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Generosa Enterprise … ▪ Generation of a new artwork
44. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Generosa Enterprise …
45. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Interactive Table (iTable) Pen-Based Google Earth Browser Pen-Based Drawing Tool Photo Browser Photo Browser (Slider)
46. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Interactive Table (iTable) …
47. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Remote Sketching on Paper ▪ Integration of Skype and paper-based remote sketching, Hermann Hofstetter ▪ HCI group University of Konstanz, H. Reiterer ▪ GlobIS group
48. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Query by Sketching (QbS) ▪ Pen-based sketching interface ▪ University of Basel ▪ GlobIS group
49. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch FLY Fusion™ Pentop Computer ▪ Everything integrated into the pen ▪ Voice feedback ▪ Applications on cartridge ▪ english to spanish translator ▪ calculator ▪ ...
50. Y-Toolbox, April 17, 2008 Beat Signer, signer@inf.ethz.ch Pulse Smartpen ▪ Record and replay synchronised ink & audio ▪ 1 GB memory ▪ 16'000 pages ▪ 200 hours voice recording ▪ 96x18 OLED Display ▪ Open application platform