Slide 1

Slide 1 text

Exploring Spatial Computing 24th August 2021 Oliver Weidlich Director of Design & Innovation Designing for the Augmented Human Mobile Experience

Slide 2

Slide 2 text

1. Augmenting Humans

Slide 3

Slide 3 text

2. Spatial Computing

Slide 4

Slide 4 text

3. Designing Experiences

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

1. Augmenting Humans

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

No content

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

No content

Slide 14

Slide 14 text

2. Spatial Computing

Slide 15

Slide 15 text

Cronin & Scoble (2020) Infinite Retina “Spatial Computing is a series of technologies that can “see” and map the real world, understand it, and predict the next moves of objects within it, while doing the same for digital worlds that may or may not have ties to the real, physical world, all the while helping humans and/or machines navigate either.”

Slide 16

Slide 16 text

Cronin & Scoble (2020) Infinite Retina “Spatial Computing is a series of technologies that can “see” and map the real world, understand it, and predict the next moves of objects within it, while doing the same for digital worlds that may or may not have ties to the real, physical world, all the while helping humans and/or machines navigate either more naturally.”

Slide 17

Slide 17 text

Spatial Computing

Slide 18

Slide 18 text

Designing Experiences

Slide 19

Slide 19 text

Internet of Things

Slide 20

Slide 20 text

Proximity Temperature CO2 Pulse On/Off State Lighting Lock State Blood Pressure Direction Ambient Light Movement Activity Sleep Weight

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

Yoga Pants Mobile App Wearable tech for health improvement and injury prevention

Slide 23

Slide 23 text

Fitbit for Your Car “GOFAR helps your car save gas, reduce emissions and drive safer.”

Slide 24

Slide 24 text

No content

Slide 25

Slide 25 text

No content

Slide 26

Slide 26 text

No content

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

Intelligent Agents

Slide 29

Slide 29 text

2011 2012 2013 2014 2015 2016 2017 2018 2019 12!

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

The Intelligence Amplifier by Brian Roemmele • @BrianRoemmele • Personal Intelligent Agents • Three Personas • Alfred • Agatha • Hoss • Deploys its own intelligent agents to gather information

Slide 34

Slide 34 text

Augmented Reality

Slide 35

Slide 35 text

AR on Mobile

Slide 36

Slide 36 text

No content

Slide 37

Slide 37 text

Shopify “Interactions with products having 3D/AR content showed a 94% higher conversion rate than for products without AR/3D”

Slide 38

Slide 38 text

No content

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

No content

Slide 41

Slide 41 text

QR to Link Experience

Slide 42

Slide 42 text

No content

Slide 43

Slide 43 text

User Journey QR code Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Camera Website Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum App Store App Trigger Interact/Rate Share Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum

Slide 44

Slide 44 text

No content

Slide 45

Slide 45 text

No content

Slide 46

Slide 46 text

Glasses

Slide 47

Slide 47 text

No content

Slide 48

Slide 48 text

No content

Slide 49

Slide 49 text

No content

Slide 50

Slide 50 text

No content

Slide 51

Slide 51 text

AR Cloud

Slide 52

Slide 52 text

“Creation, management, and use of persistent, dynamic, shareable 3D machine-readable representations of physical spaces, and real time services to offer AR Experiences to users.” Open AR Cloud Definition

Slide 53

Slide 53 text

No content

Slide 54

Slide 54 text

AR Cloud • MirrorWorld • Livemaps (Facebook) • Spatial Web • Magicverse (MagicLeap) • Real World Web • Superverse (Jan-Erik Vinje) • Spatial Maps • Metaverse (Snowcrash) • 3D Soft copy of the world • Location Anchors (Apple) • Digital Twin • Spatial Anchors (Microsoft)

Slide 55

Slide 55 text

3. Designing Experiences

Slide 56

Slide 56 text

No content

Slide 57

Slide 57 text

Putting it Together

Slide 58

Slide 58 text

Section Title

Slide 59

Slide 59 text

Layers of Experience

Slide 60

Slide 60 text

Layers of Experience Notifications Relay relevant information based on context Services Simple focussed features at the system level that can be applied to various situations Lenses Specific layers of information that overlay the world Applications More complex sets of features that support specific experiences

Slide 61

Slide 61 text

Notification: Reminders

Slide 62

Slide 62 text

No content

Slide 63

Slide 63 text

No content

Slide 64

Slide 64 text

No content

Slide 65

Slide 65 text

No content

Slide 66

Slide 66 text

No content

Slide 67

Slide 67 text

“Directions to Daily Chai please”

Slide 68

Slide 68 text

No content

Slide 69

Slide 69 text

Application: Wedding Venue

Slide 70

Slide 70 text

No content

Slide 71

Slide 71 text

No content

Slide 72

Slide 72 text

No content

Slide 73

Slide 73 text

Wrap Up

Slide 74

Slide 74 text

Silke Sietsma, Head of Emerging Design at Adobe “With spatial computing we can use our voice, sight, touch (in 3D), gestures, and other natural inputs to directly connect with information. We no longer need to think and behave like a computer for it to under‐ stand us, because it will relate humanly to us.”

Slide 75

Slide 75 text

References • Augmented Reality: Unboxing Tech's Next Big Thing (2020) Pesce, M. • Connecting and Controlling Appliances Through Wearable Augmented Reality. (2020) Becker, V., Rauchenstein, F. & Sörös, G. https://doi.org/10.1007/s41133-019-0019-0 • Creating Augmented and Virtual Realities (2019) Pangilinan, E., Lukas, S., Mohan V. • Proxemic-aware controls: designing remote controls for ubiquitous computing ecologies. In: Proceedings of the 2015 international conference on human–computer interaction with mobile devices and services, MobileHCI ’15 (2015) Ledo D., Greenberg S., Marquardt N., Boring S. • The Augmented Human: How Technology is Shaping the New Reality (2017) Papagiannis, H. • The Infinite Retina (2020) Cronin, I., Scoble, R. • The Spatial Web: How Web 3.0 will connect humans, machines and AI to transform the world (2019) Rene, G., Mapes, D.

Slide 76

Slide 76 text

Oliver Weidlich Director of Design & Innovation [email protected] 0411 551 561 @oliverw Thanks!