Slide 1

Slide 1 text

2 December 2005 Next Generation User Interfaces Pen-based Interaction Prof. Beat Signer Department of Computer Science Vrije Universiteit Brussel beatsigner.com Department of Computer Science Vrije Universiteit Brussel beatsigner.com

Slide 2

Slide 2 text

Beat Signer - Department of Computer Science - [email protected] 2 March 4, 2024 History of Pens and Writing Instruments [https://en.wikipedia.org/wiki/Cave_painting] stones as writing instruments for cave paintings starting ~40 000 BC

Slide 3

Slide 3 text

Beat Signer - Department of Computer Science - [email protected] 3 March 4, 2024 History of Pens and Writing Instruments ... reed pen ~3000 BC quill pen ~500-1900 AD ink brush pen ~300 BC stylus ~3200 BC silver pencil ~1000 BC

Slide 4

Slide 4 text

Beat Signer - Department of Computer Science - [email protected] 4 March 4, 2024 History of Pens and Writing Instruments ... ▪ Clay and wax tablets ▪ ~3200 BC ▪ Papyrus ▪ ~3000 BC ▪ Parchment ▪ ~300 BC ▪ made from animal skin ▪ Paper ▪ invented in China in 105 AD - brought to Europe by Arabs - produced in Europe ~1100 AD - rags were only replaced by wood pulp ~1850 AD Papyrus Paper

Slide 5

Slide 5 text

Beat Signer - Department of Computer Science - [email protected] 5 March 4, 2024 History of Pens and Writing Instruments ... fountain pen 1884 dip pen ~1800 ruling pen radiograph 1953 pencil 1795

Slide 6

Slide 6 text

Beat Signer - Department of Computer Science - [email protected] 6 March 4, 2024 History of Pens and Writing Instruments ... ballpoint pen 1938 rollerball pen 1963 marker pen ~1910 ceramic tip pen ?

Slide 7

Slide 7 text

Beat Signer - Department of Computer Science - [email protected] 7 March 4, 2024 40000 Years of Evolution in Writing Tools ▪ Existing pens and writing tools have evolved over the last 40000 years ▪ Pens have been optimised for the corresponding writing surfaces ▪ It sometimes took a long time before a new writing tool got adopted (e.g.paper) ▪ There has been a coevolution of paper and work practices over a long period of time ▪ Everybody knows how to use pen and paper and has some expectations when using these artefacts

Slide 8

Slide 8 text

Beat Signer - Department of Computer Science - [email protected] 8 March 4, 2024 The Paperless Office

Slide 9

Slide 9 text

Beat Signer - Department of Computer Science - [email protected] 9 March 4, 2024 The Myth of the Paperless Office ... ▪ For decades, people have predicted the office of the future as a paperless office ▪ documents generated, published and distributed electronically ▪ documents read electronically ▪ What has happened to this imminent revolution?

Slide 10

Slide 10 text

Beat Signer - Department of Computer Science - [email protected] 10 March 4, 2024 The Myth of the Paperless Office

Slide 11

Slide 11 text

Beat Signer - Department of Computer Science - [email protected] 11 March 4, 2024 Worldwide Paper Consumption Release Date: September 2023, Source: https://www.statista.com/statistics/1089078/demand-paper-globally-until-2030/

Slide 12

Slide 12 text

Beat Signer - Department of Computer Science - [email protected] 12 March 4, 2024 Affordances of Pen and Paper ▪ An affordance of an object tells us something (gives us a clue) about how to use the object ▪ Affordances of paper ▪ light, flexible, mobile and cheap ▪ robust ▪ porous ▪ opaque or transparent ▪ high resolution ▪ ease of navigation - flipping through pages or across documents ▪ easy to annotate ▪ hard to replicate and must be accessed locally ▪ ...

Slide 13

Slide 13 text

Beat Signer - Department of Computer Science - [email protected] 13 March 4, 2024 Affordances of Pen and Paper ... ▪ Human interaction with paper ▪ grasping ▪ folding ▪ tearing ▪ carrying ▪ writing on ▪ juxtaposing paper documents ▪ arranging paper documents in space ▪ ... ▪ Paper supports some forms of collaboration and interaction that are difficult to mimic in digital space!

Slide 14

Slide 14 text

Beat Signer - Department of Computer Science - [email protected] 14 March 4, 2024 Affordances of Pen and Paper ... ▪ Affordances of pens ▪ robust ▪ light ▪ mobile ▪ colour ▪ erasable ▪ cheap ▪ durable ▪ easy to draw on different surfaces ▪ ...

Slide 15

Slide 15 text

Beat Signer - Department of Computer Science - [email protected] 15 March 4, 2024 IKEA Bookbook (Video)

Slide 16

Slide 16 text

Beat Signer - Department of Computer Science - [email protected] 16 March 4, 2024 Replacing Pen and Paper? ▪ Study shows advantages of handwriting in education ▪ generative note-taking rather than transcribing on a laptop ▪ Another study from 2024 by Van der Weel et al.shows that handwriting (but not typewriting) leads to wide- spread brain connectivity ▪ “Switching off: Sweden says back-to-basics schooling works on paper” [2023]

Slide 17

Slide 17 text

Beat Signer - Department of Computer Science - [email protected] 17 March 4, 2024 Today's Human-Computer Interaction ▪ How are pen and paper currently integrated in our daily work with computers? ▪ How to deal with the paper-digital divide?

Slide 18

Slide 18 text

Beat Signer - Department of Computer Science - [email protected] 18 March 4, 2024 Bridging the Paper-Digital Divide picture1.png PIC00008.jpg map1.jpg IMG_0738.JPG

Slide 19

Slide 19 text

Beat Signer - Department of Computer Science - [email protected] 19 March 4, 2024 Paper-Digital Integration reMarkable 2 Anoto Digital Pen and Paper Technology Augmented / Interactive Paper Electronic Paper

Slide 20

Slide 20 text

Beat Signer - Department of Computer Science - [email protected] 20 March 4, 2024 Telautograph ▪ Telautograph invented in 1888 by Elisha Gray ▪ Transforms pen writing at the sending station into electrical impulses (via potentiometers) ▪ Reproduces the drawing at the receiving station via a pen attached to a servomechanism ▪ e.g.remote signatures Telautograph [https://www.ndl.go.jp/exposition/e/data/L/399l.html]

Slide 21

Slide 21 text

Beat Signer - Department of Computer Science - [email protected] 21 March 4, 2024 Telautograph ... Telautograph Receiver Telautograph Transmitter

Slide 22

Slide 22 text

Beat Signer - Department of Computer Science - [email protected] 22 March 4, 2024 Memex ▪ Vannevar Bush's article 'As We May Think' (1945) introduces the Memex (memory extender) ▪ Store and access information on microfilms ▪ create and follow cross- references in the form of associative trails ▪ pen-based creation and annotation of content Memex, Vannevar Bush, 1945 Pen-based Memex interaction

Slide 23

Slide 23 text

Beat Signer - Department of Computer Science - [email protected] 23 March 4, 2024 Stylator and RAND Tablet ▪ Stylator (stylus translator) was the first computer with pen-based input ▪ demonstrated by Tom Dimond in 1957 ▪ handwriting recognition (single character) ▪ Another early pen- operated computing device was the RAND Tablet in 1961 ▪ pressure-sensitive pen tip [https://alltabletpc.blogspot.be/2011/07/history-of-tablet-pc-from-ancient-times.html] Stylator

Slide 24

Slide 24 text

Beat Signer - Department of Computer Science - [email protected] 24 March 4, 2024 Sketchpad (1963) ▪ Sketchpad developed as part of Ivan Sutherland’s PhD thesis at MIT ▪ drawing tool ▪ light pen and buttons ▪ first graphical user interface ▪ direct manipulation of graphical objects ▪ basis for many new interface ideas

Slide 25

Slide 25 text

Beat Signer - Department of Computer Science - [email protected] 25 March 4, 2024 Light Pen ▪ Light-sensitive pen input device for cathode ray tube (CRT) screens ▪ creates a signal each time the screen's electron beam passes the position of the pen ▪ Disadvantages ▪ not very accurate due to rounding errors and noise ▪ entire screen image has to be rather bright HES [http://en.wikipedia.org/wiki/Light_Pen]

Slide 26

Slide 26 text

Beat Signer - Department of Computer Science - [email protected] 26 March 4, 2024 Graphics Tablet ▪ Digitises hand-drawn sketches ▪ Passive tablets ▪ pen powered by the tablet (electromagnetic induction) ▪ Active tablets ▪ pen has its own battery ▪ In addition to the electromagnetic tracking there exist other solutions ▪ acoustic tracking ▪ optical tracking Wacom Bamboo Wacom Cintiq

Slide 27

Slide 27 text

Beat Signer - Department of Computer Science - [email protected] 27 March 4, 2024 Ultrasonic Position Detection Pens ▪ Paper clip to track hand- writing on paper via ultra- sonic position detection ▪ Larger versions transform standard whiteboards from a simple writing medium into a powerful collabo- ration and communication tool ▪ Calibration might be an issue Seiko InkLink Mimio Xi

Slide 28

Slide 28 text

Beat Signer - Department of Computer Science - [email protected] 28 March 4, 2024 DigitalDesk ▪ DigitalDesk developed by Pierre Wellner at Xerox EuroPARC ▪ camera-based tracking and projection ▪ "Instead of making the workstation more like a desk, make the desk more like a workstation" ▪ Many follow-up augmented desk projects ▪ What about mobility? Pierre Wellner, DigitalDesk, 1991

Slide 29

Slide 29 text

Beat Signer - Department of Computer Science - [email protected] 29 March 4, 2024 Digital Pen and Paper Technology ▪ Anoto offers ▪ camera technology ▪ pattern license (virtual paper space of 60 million km2) ▪ Pen manufacturers ▪ Nokia ▪ Maxell ▪ Adapx ▪ Livescribe ▪ … ▪ Recent alternative by NeoLAB ▪ Neo Smartpen

Slide 30

Slide 30 text

Beat Signer - Department of Computer Science - [email protected] 30 March 4, 2024 Digital Pens Nokia SU-1B Magicomm G303 Livescribe Echo Smartpen FLY Fusion Pentop Computer

Slide 31

Slide 31 text

Beat Signer - Department of Computer Science - [email protected] 31 March 4, 2024 Notetaking ▪ Audio Notebook by Lisa Stifelman (1996) ▪ records audio and synchronises it with the handwriting ▪ uses graphics tablet for pen tracking ▪ Livescribe Echo Pen (2010) ▪ records audio on the pen and synchronises it with the handwriting ▪ uses Anoto pattern for the pen tracking Lisa Stifelman, Audio Notebook Livescribe Echo Pen

Slide 32

Slide 32 text

Beat Signer - Department of Computer Science - [email protected] 32 March 4, 2024 iPaper Research Link Metamodel (RSL) Tools Cross-Media Server / Publishing Applications links_blue adminTab edfestComponents temp1

Slide 33

Slide 33 text

Beat Signer - Department of Computer Science - [email protected] 33 March 4, 2024 Cross-Media Server (iServer) ipaperArchitecture.jpg

Slide 34

Slide 34 text

Beat Signer - Department of Computer Science - [email protected] 34 March 4, 2024 Active Page Areas and Layers image video clip

Slide 35

Slide 35 text

Beat Signer - Department of Computer Science - [email protected] 35 March 4, 2024 RSL Hypermedia Metamodel iwebfirefox movieplugin ipaper Global Information Systems Group, ETH Zurich

Slide 36

Slide 36 text

Beat Signer - Department of Computer Science - [email protected] 36 March 4, 2024 iserverNew_blue Links Users Layers Plug-ins Structure Active Content Global Information Systems Group, ETH Zurich

Slide 37

Slide 37 text

Beat Signer - Department of Computer Science - [email protected] 37 March 4, 2024 Input Device Independence barcode.jpg arjo1.jpg nokia.jpg cosmo iPaper, Paper++ Project, 2001 iPaper, Paper++ Project, 2003 iPaper, EdFest Project, ETH Zurich, 2005 iPaper, The Lost Cosmonaut Project, ETH Zurich, 2004

Slide 38

Slide 38 text

Beat Signer - Department of Computer Science - [email protected] 38 March 4, 2024 Digital Pen and Paper Applications ▪ Enhanced Reading ▪ interactive paper maps ▪ interactive festival brochures ▪ educational materials ▪ auction brochures ▪ scientific publications ▪ … ▪ Enhanced Writing ▪ photo album ▪ researcher's notebook ▪ mammography annotation ▪ query by sketching ▪ … ▪ Paper-based Interfaces ▪ PaperPoint ▪ document proof-editing ▪ digital libraries ▪ video analysis tool ▪ educational games ▪ Art Installations ▪ Lost Cosmonaut ▪ Generosa Enterprise ▪ Interactive Tabletops ▪ photo browser ▪ collaborative sketch tool

Slide 39

Slide 39 text

Beat Signer - Department of Computer Science - [email protected] 39 March 4, 2024 PaperPoint Presentation Tool ▪ Mobile PowerPoint presentation tool ▪ non-linear presentations ▪ real-time annotations ▪ digital whiteboard ▪ ... ▪ Multi-pen support ▪ brainstorming paperpoint1 paperpoint2

Slide 40

Slide 40 text

Beat Signer - Department of Computer Science - [email protected] 40 March 4, 2024 edfestComponents EdFest Project Global Information Systems Group, ETH Zurich

Slide 41

Slide 41 text

Beat Signer - Department of Computer Science - [email protected] 41 March 4, 2024 EdFest User Trials picture1 Picture2 Global Information Systems Group, ETH Zurich

Slide 42

Slide 42 text

Beat Signer - Department of Computer Science - [email protected] 42 March 4, 2024 EdFest Documents bookmarknew brochurenew mapnew Global Information Systems Group, ETH Zurich

Slide 43

Slide 43 text

Beat Signer - Department of Computer Science - [email protected] 43 March 4, 2024 Cross-Media Publishing Framework XCM content publishing XML data of festival venues and events iServer cross-media link server • paper link data • active areas on paper • layers • digital resources • user model import publish PDF XML link definition data iPublish publishing framework Structure Style XSL CSS information-centric approach Global Information Systems Group, ETH Zurich

Slide 44

Slide 44 text

Beat Signer - Department of Computer Science - [email protected] 44 March 4, 2024 Natural History Museum, London Picture6 Paper++ Project

Slide 45

Slide 45 text

Beat Signer - Department of Computer Science - [email protected] 45 March 4, 2024 Natural History Museum, London ... Picture6

Slide 46

Slide 46 text

Beat Signer - Department of Computer Science - [email protected] 46 March 4, 2024 Natural History Museum, London ... Picture6

Slide 47

Slide 47 text

Beat Signer - Department of Computer Science - [email protected] 47 March 4, 2024 Natural History Museum, London ... Picture6

Slide 48

Slide 48 text

Beat Signer - Department of Computer Science - [email protected] 48 March 4, 2024 Print-n-Link ▪ Handle existing PDF documents ▪ e.g. research papers ▪ Automatic link authoring at print time ▪ applicable to other domains references references1 Global Information Systems Group, ETH Zurich

Slide 49

Slide 49 text

Beat Signer - Department of Computer Science - [email protected] 49 March 4, 2024 Document Authoring and Editing ▪ Digital pen and paper-based user interface ▪ Support for collaborative editing ▪ Multiple digital/physical editing iteration cycles ▪ seamless transition between paper and digital information Digital Document Printed Document

Slide 50

Slide 50 text

Beat Signer - Department of Computer Science - [email protected] 50 March 4, 2024 PaperProof: Paper-Digital Proof-Editing paper.jpg openoffice.png Global Information Systems Group, ETH Zurich

Slide 51

Slide 51 text

Beat Signer - Department of Computer Science - [email protected] 51 March 4, 2024 Digital Ink Processing ▪ Parse proprietary pen formats ▪ position, timestamp, force, tilt, … ▪ Stroke detection ▪ pen up and pen down events ▪ time difference between succeeding points ▪ distance between succeeding points, … ▪ Interpolation/Filtering

Slide 52

Slide 52 text

Beat Signer - Department of Computer Science - [email protected] 52 March 4, 2024 Ink Markup Language (InkML) ▪ XML language for representing digital ink ▪ Pen movement data ▪ and elements ▪ x,y coordinates, force, angles ▪ Device-specific information ▪ resolution, sample rate, … W3C Recommendation

Slide 53

Slide 53 text

Beat Signer - Department of Computer Science - [email protected] 53 March 4, 2024 Ink Markup Language (InkML) … W3C Recommendation 10 0, 9 14, 8 28, 7 42, 6 56, 6 70, 8 84, 8 98, 8 112, 9 126, 10 140, 13 154, 14 168, 17 182, 18 188 130 155, 144 159, 158 160, 170 154, 179 143, 179 129, 166 125, 152 128, 140 136, 131 149, 126 163 ... ...

Slide 54

Slide 54 text

Beat Signer - Department of Computer Science - [email protected] 54 March 4, 2024 Rough Guide Global Information Systems Group, ETH Zurich

Slide 55

Slide 55 text

Beat Signer - Department of Computer Science - [email protected] 55 March 4, 2024 DiDA Learning Material ▪ Diploma in Digital Applications ▪ includes Using ICT, Multimedia, Graphics and ICT in Enterprise ▪ "...designed to stimulate students' creativity and develop real-world, practical skills..." ▪ Published by Edexcel (Pearson Education) ▪ Interactive DiDA book combines printed information with CD-ROM and web content

Slide 56

Slide 56 text

Beat Signer - Department of Computer Science - [email protected] 56 March 4, 2024 DiDA ... dida1 dida2 Global Information Systems Group, ETH Zurich

Slide 57

Slide 57 text

Beat Signer - Department of Computer Science - [email protected] 57 March 4, 2024 The Lost Cosmonaut ▪ Writing as a collaborative act of memory and story- telling ▪ Reading, writing and narrative as an act of making sense ▪ Handwriting as a tool for human-computer interaction In collaboration with Axel Vogelsang, Artists in Labs Programme Global Information Systems Group, ETH Zurich

Slide 58

Slide 58 text

Beat Signer - Department of Computer Science - [email protected] 58 March 4, 2024 Interactive Tables test2 itable test3 test4 Pen-Based Google Earth Browser Pen-Based Drawing Tool Photo Browser Photo Browser (Slider) Global Information Systems Group, ETH Zurich

Slide 59

Slide 59 text

Beat Signer - Department of Computer Science - [email protected] 59 March 4, 2024 Interactive Table (iTable) Video Global Information Systems Group, ETH Zurich

Slide 60

Slide 60 text

Beat Signer - Department of Computer Science - [email protected] 60 March 4, 2024 Visual and Interaction Design ▪ Visualisation of interactive areas and functionality ▪ design patterns ▪ Interaction design ▪ online versus offline input processing ▪ lack of modal dialogues ▪ multimodal interaction ▪ Findings might be appli- cable to traditional GUIs ▪ e.g. cross-application widget interaction booklet 2004 booklet 2005 Global Information Systems Group, ETH Zurich

Slide 61

Slide 61 text

Beat Signer - Department of Computer Science - [email protected] 61 March 4, 2024 Innovative Hardware and Materials ▪ Mobile solutions for feed- back on paper documents ▪ spatially aware projection of information ▪ digital pen with display ▪ voice feedback ▪ ... ▪ Fusion of electronic paper and interactive paper ▪ printed electronics PaperWorks project MouseLight

Slide 62

Slide 62 text

Beat Signer - Department of Computer Science - [email protected] 62 March 4, 2024 Innovative Hardware and Materials … ▪ Feedback via HoloLens in HoloDoc ▪ lookup of references as in Print-n-Link ▪ freeform search as in Rough Guide ▪ … HoloDoc, 2019

Slide 63

Slide 63 text

Beat Signer - Department of Computer Science - [email protected] 63 March 4, 2024 Conclusions ▪ Pen input is not always the most effective input ▪ sometimes it is faster to type on a keyboard rather than to write ▪ New challenges in terms of interaction design ▪ what are the user's expectations (based on known use of pen)? ▪ combination with other modalities and lack of control ▪ visual encoding and design ▪ how to provide feedback if used without a screen? - might need modes and timeouts ▪ Device independence and digital ink abstraction ▪ different pens can be used to control an application ▪ Automatic application deployment and installation ▪ easy interaction with arbitrary digital or physical documents

Slide 64

Slide 64 text

Beat Signer - Department of Computer Science - [email protected] 64 March 4, 2024 Exercise 2 ▪ 3D Printing

Slide 65

Slide 65 text

Beat Signer - Department of Computer Science - [email protected] 65 March 4, 2024 References ▪ Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Beat Signer, Books on Demand, April 2017 (second edition) ISBN-13: 978-3837027136 ▪ The Myth of the Paperless Office, Abigail Sellen and Richard Harper, The MIT Press, February 2003 ISBN-13: 978-0262692830 Technology in Action, Christian Heath and Paul Luff, Cambridge University Press, June 2000 ISBN-13: 978-0521560337 cover2.jpg

Slide 66

Slide 66 text

Beat Signer - Department of Computer Science - [email protected] 66 March 4, 2024 References … ▪ B.Signer, Pen-based Interaction, Handbook of Human Computer Interaction, Major Reference Work, Springer Nature, 2024 ▪ https://beatsigner.com/publications/signer_HCI2024.pdf ▪ M.R. Davis and T.O. Ellis, The RAND Tablet: A Man-Machine Graphical Communication Device, Proceedings of AFIPS 1964 ▪ https://doi.org/10.1145/1464052.1464080 ▪ I. Sutherland, Sketchpad: A Man-Machine Graphical Communication System, PhD Thesis, Massachusetts Institute of Technology, January 1963 ▪ https://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-574.pdf

Slide 67

Slide 67 text

Beat Signer - Department of Computer Science - [email protected] 67 March 4, 2024 References … ▪ Sketchpad Demo ▪ https://www.youtube.com/watch?v=6orsmFndx_o ▪ P. Wellner, The DigitalDesk Calculator: Tangible Manipulation on a Desk Top Display, Proceedings of ACM UIST 1991, Hilton Head, USA, November 1991 ▪ https://dx.doi.org/10.1145/120782.120785 ▪ L.J. Stifelman, Augmenting Real-World Objects: A Paper-based Audio Notebook, Proceedings of CHI 1996, International Conference on Human Factors in Com- puting Systems, Vancouver, Canada, April 1996 ▪ https://dx.doi.org/10.1145/257089.257279

Slide 68

Slide 68 text

Beat Signer - Department of Computer Science - [email protected] 68 March 4, 2024 References … ▪ B. Signer and M.C. Norrie, Interactive Paper: Past, Present and Future, Proceedings of PaperComp 2010, 1st International Workshop on Paper Computing, Copenhagen Denmark, September 2010 ▪ https://beatsigner.com/publications/signer_PaperComp2010.pdf ▪ B. Signer and M.C. Norrie, PaperPoint: A Paper-based Presentation and Interactive Paper Prototyping Tool, Proceedings of TEI 2007, 1st International Conference on Tangible and Embedded Interaction, Baton Rouge, USA, February 2007 ▪ https://beatsigner.com/publications/signer_TEI2007.pdf

Slide 69

Slide 69 text

Beat Signer - Department of Computer Science - [email protected] 69 March 4, 2024 References … ▪ M.C. Norrie, B. Signer, M. Grossniklaus, R. Belotti, C. Decurtins and N. Weibel, Context-Aware Platform for Mobile Data Management, ACM/Baltzer Wireless Networks (WINET), 13(6), December 2007 ▪ https://beatsigner.com/publications/norrie_WINET2007.pdf ▪ P. Luff, C. Heath, M.C. Norrie, B. Signer and P. Herdman, Only Touching the Surface: Creating Affinities Between Digital Content and Paper, Proceedings of CSCW 2004, ACM Conference on Computer Supported Cooperative Work, Chicago, USA, November 2004 ▪ https://beatsigner.com/publications/luff_CSCW2014.pdf

Slide 70

Slide 70 text

Beat Signer - Department of Computer Science - [email protected] 70 March 4, 2024 References … ▪ M.C. Norrie, B. Signer and N. Weibel, Print-n-Link: Weaving the Paper Web, Proceedings of DocEng 2006, ACM Symposium on Document Engi- neering, Amsterdam, The Netherlands, October 2006 ▪ https://beatsigner.com/publications/norrie_DocEng2006.pdf ▪ N. Weibel, B. Signer, P. Ponti and M.C. Norrie, PaperProof: A Paper-Digital Proof-Editing System, CoPADD 2007, 2nd International Workshop on Collaborating over Paper and Digital Documents, London, UK, November 2007 ▪ https://beatsigner.com/publications/weibel_CHI2008.pdf

Slide 71

Slide 71 text

Beat Signer - Department of Computer Science - [email protected] 71 March 4, 2024 References … ▪ A. Vogelsang and B. Signer, The Lost Cosmo- naut: An Interactive Narrative Environment on Basis of Digitally Enhanced Paper, Proceedings of the International Conference on Virtual Storytelling 2005, Strasbourg, France, December 2005 ▪ https://beatsigner.com/publications/vogelsang_ICVS2005.pdf ▪ H. Song, F. Guimbretière, T. Grossman and G. Fitzmaurice, MouseLight: Bimanual Interactions on Digital Paper Using a Pen and a Spatially-aware Mobile Projector, Proceedings of CHI 2010, Atlanta, USA ▪ https://doi.org/10.1145/1753326.1753697

Slide 72

Slide 72 text

Beat Signer - Department of Computer Science - [email protected] 72 March 4, 2024 References … ▪ P.A. Mueller and D.M. Oppenheimer, The Pen Is Mightier Than the Keyboard: Advantages of Longhand Over Laptop Note Taking, Psychological Science, 25(6), 2014 ▪ https://doi.org/10.1177/0956797614524581 ▪ F.R. Van der Weel and A.L.H. Van der Meer, Hand- writing But Not Typewriting Leads to Widespread Brain Connectivity: A High-Density EEG Study With Impli- cations for the Classroom, Frontiers in Psychology, 14, January 2024 ▪ https://doi.org/10.3389/fpsyg.2023.1219945

Slide 73

Slide 73 text

Beat Signer - Department of Computer Science - [email protected] 73 March 4, 2024 References … ▪ Switching Off: Sweden Says Back-to-Basics Schooling Works on Paper ▪ https://www.theguardian.com/world/2023/sep/11/sweden-says-back-to- basics-schooling-works-on-paper ▪ Z. Li, M. Annett, K. Hinckley, K. Singh and D. Wigdor, HoloDoc: Enabling Mixed Reality Workspaces that Harness Physical and Digital Content, Proceedings of CHI 2019, Glasgow, UK, May 2019 ▪ https://doi.org/10.1145/3290605.3300917

Slide 74

Slide 74 text

Beat Signer - Department of Computer Science - [email protected] 74 March 4, 2024 References … ▪ IKEA Bookbook ▪ https://www.youtube.com/watch?v=MOXQo7nURs0 ▪ Interactive Paper ▪ https://beatsigner.com/interactivePaper.html ▪ Print-n-Link Video ▪ https://www.youtube.com/watch?v=d-lXzi8mPMY ▪ PaperProof Video ▪ https://www.youtube.com/watch?v=8ZW2Msw6HM0 ▪ The Lost Cosmonaut Video ▪ https://www.youtube.com/watch?v=fu27Cmr1aX4 ▪ Interactive Table (iTable) Video ▪ https://www.youtube.com/watch?v=rc7I5h6XirY ▪ Paper++ Project ▪ https://beatsigner.com/paperpp.html

Slide 75

Slide 75 text

2 December 2005 Next Lecture Interactive Tabletops and Surfaces