Oliver Weidlich - Designing Experiences for the Augmented Human

UX Australia 2021 Day 1

Since the earliest tools humans have been augmenting their capability with technology. In the modern era we are starting to mainstream digital enhancement of our capabilities in new and interesting ways. Oliver will explore the areas of Augmented Reality, Intelligent Agents and the Internet of Things and how the combinations of these can create powerful experiences.

Transcript

1. Exploring Spatial Computing 24th August 2021 Oliver Weidlich Director of Design & Innovation Designing for the Augmented Human Mobile Experience
2. 1. Augmenting Humans
3. 2. Spatial Computing
4. 3. Designing Experiences
6. 1. Augmenting Humans
14. 2. Spatial Computing
15. Cronin & Scoble (2020) Infinite Retina “Spatial Computing is a series of technologies that can “see” and map the real world, understand it, and predict the next moves of objects within it, while doing the same for digital worlds that may or may not have ties to the real, physical world, all the while helping humans and/or machines navigate either.”
16. Cronin & Scoble (2020) Infinite Retina “Spatial Computing is a series of technologies that can “see” and map the real world, understand it, and predict the next moves of objects within it, while doing the same for digital worlds that may or may not have ties to the real, physical world, all the while helping humans and/or machines navigate either more naturally.”
17. Spatial Computing
18. Designing Experiences
19. Internet of Things
20. Proximity Temperature CO2 Pulse On/Off State Lighting Lock State Blood Pressure Direction Ambient Light Movement Activity Sleep Weight
22. Yoga Pants Mobile App Wearable tech for health improvement and injury prevention
23. Fitbit for Your Car “GOFAR helps your car save gas, reduce emissions and drive safer.”
28. Intelligent Agents
29. 2011 2012 2013 2014 2015 2016 2017 2018 2019 12!
33. The Intelligence Amplifier by Brian Roemmele • @BrianRoemmele • Personal Intelligent Agents • Three Personas • Alfred • Agatha • Hoss • Deploys its own intelligent agents to gather information
34. Augmented Reality
35. AR on Mobile
37. Shopify “Interactions with products having 3D/AR content showed a 94% higher conversion rate than for products without AR/3D”
41. QR to Link Experience
43. User Journey QR code Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Camera Website Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum App Store App Trigger Interact/Rate Share Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum Metrics 1. Lorem Ipsum 2. Lorem Ipsum 3. Lorem Ipsum 4. Lorem Ipsum
46. Glasses
51. AR Cloud
52. “Creation, management, and use of persistent, dynamic, shareable 3D machine-readable representations of physical spaces, and real time services to offer AR Experiences to users.” Open AR Cloud Definition
54. AR Cloud • MirrorWorld • Livemaps (Facebook) • Spatial Web • Magicverse (MagicLeap) • Real World Web • Superverse (Jan-Erik Vinje) • Spatial Maps • Metaverse (Snowcrash) • 3D Soft copy of the world • Location Anchors (Apple) • Digital Twin • Spatial Anchors (Microsoft)
55. 3. Designing Experiences
57. Putting it Together
58. Section Title
59. Layers of Experience
60. Layers of Experience Notifications Relay relevant information based on context Services Simple focussed features at the system level that can be applied to various situations Lenses Specific layers of information that overlay the world Applications More complex sets of features that support specific experiences
61. Notification: Reminders
67. “Directions to Daily Chai please”
69. Application: Wedding Venue
73. Wrap Up
74. Silke Sietsma, Head of Emerging Design at Adobe “With spatial computing we can use our voice, sight, touch (in 3D), gestures, and other natural inputs to directly connect with information. We no longer need to think and behave like a computer for it to under‐ stand us, because it will relate humanly to us.”
75. References • Augmented Reality: Unboxing Tech's Next Big Thing (2020) Pesce, M. • Connecting and Controlling Appliances Through Wearable Augmented Reality. (2020) Becker, V., Rauchenstein, F. & Sörös, G. https://doi.org/10.1007/s41133-019-0019-0 • Creating Augmented and Virtual Realities (2019) Pangilinan, E., Lukas, S., Mohan V. • Proxemic-aware controls: designing remote controls for ubiquitous computing ecologies. In: Proceedings of the 2015 international conference on human–computer interaction with mobile devices and services, MobileHCI ’15 (2015) Ledo D., Greenberg S., Marquardt N., Boring S. • The Augmented Human: How Technology is Shaping the New Reality (2017) Papagiannis, H. • The Infinite Retina (2020) Cronin, I., Scoble, R. • The Spatial Web: How Web 3.0 will connect humans, machines and AI to transform the world (2019) Rene, G., Mapes, D.
76. Oliver Weidlich Director of Design & Innovation oliverw@mobileexperience.com.au 0411 551 561 @oliverw Thanks!