Oliver Weidlich - Designing Experiences for the Augmented Human

UX Australia 2021 Day 1

Since the earliest tools humans have been augmenting their capability with technology. In the modern era we are starting to mainstream digital enhancement of our capabilities in new and interesting ways. Oliver will explore the areas of Augmented Reality, Intelligent Agents and the Internet of Things and how the combinations of these can create powerful experiences.

Transcript

1. Exploring Spatial Computing
   24th August 2021
   Oliver Weidlich
   Director of Design & Innovation
   Designing for the Augmented Human
   Mobile Experience
   

   View Slide

2. 1. Augmenting Humans
   

   View Slide

3. 2. Spatial Computing
   

   View Slide

4. 3. Designing Experiences
   

   View Slide

5. View Slide

6. 1. Augmenting Humans
   

   View Slide

7. View Slide

8. View Slide

9. View Slide

10. View Slide

11. View Slide

12. View Slide

13. View Slide

14. 2. Spatial Computing
    

    View Slide

15. Cronin & Scoble (2020) Infinite Retina
    “Spatial Computing is a series of technologies that can “see” and map the real
    world, understand it, and predict the next moves of objects within it, while doing
    the same for digital worlds that may or may not have ties to the real, physical
    world, all the while helping humans and/or machines navigate either.”
    

    View Slide

16. Cronin & Scoble (2020) Infinite Retina
    “Spatial Computing is a series of technologies that can “see” and map the real
    world, understand it, and predict the next moves of objects within it, while doing the
    same for digital worlds that may or may not have ties to the real, physical world, all
    the while helping humans and/or machines navigate either more naturally.”
    

    View Slide

17. Spatial Computing
    

    View Slide

18. Designing Experiences
    

    View Slide

19. Internet of Things
    

    View Slide

20. Proximity
    Temperature
    CO2
    Pulse
    On/Off State
    Lighting
    Lock State Blood Pressure
    Direction
    Ambient Light
    Movement
    Activity
    Sleep
    Weight
    

    View Slide

21. View Slide

22. Yoga Pants Mobile App
    Wearable tech for health improvement and injury prevention
    

    View Slide

23. Fitbit for Your Car
    “GOFAR helps your car save gas, reduce emissions and drive safer.”
    

    View Slide

24. View Slide

25. View Slide

26. View Slide

27. View Slide

28. Intelligent Agents
    

    View Slide

29. 2011 2012 2013 2014 2015 2016 2017 2018 2019
    12!
    

    View Slide

30. View Slide

31. View Slide

32. View Slide

33. The Intelligence Amplifier by Brian Roemmele
    • @BrianRoemmele
    • Personal Intelligent Agents
    • Three Personas
    • Alfred
    • Agatha
    • Hoss
    • Deploys its own intelligent
    agents to gather
    information
    

    View Slide

34. Augmented Reality
    

    View Slide

35. AR on Mobile
    

    View Slide

36. View Slide

37. Shopify
    “Interactions with products having 3D/AR
    content showed a 94% higher conversion rate
    than for products without AR/3D”
    

    View Slide

38. View Slide

39. View Slide

40. View Slide

41. QR to Link Experience
    

    View Slide

42. View Slide

43. User Journey
    QR code
    Metrics
    1. Lorem Ipsum
    2. Lorem Ipsum
    3. Lorem Ipsum
    4. Lorem Ipsum
    Camera Website
    Metrics
    1. Lorem Ipsum
    2. Lorem Ipsum
    3. Lorem Ipsum
    4. Lorem Ipsum
    App Store App Trigger Interact/Rate Share
    Metrics
    1. Lorem Ipsum
    2. Lorem Ipsum
    3. Lorem Ipsum
    4. Lorem Ipsum
    Metrics
    1. Lorem Ipsum
    2. Lorem Ipsum
    3. Lorem Ipsum
    4. Lorem Ipsum
    Metrics
    1. Lorem Ipsum
    2. Lorem Ipsum
    3. Lorem Ipsum
    4. Lorem Ipsum
    

    View Slide

44. View Slide

45. View Slide

46. Glasses
    

    View Slide

47. View Slide

48. View Slide

49. View Slide

50. View Slide

51. AR Cloud
    

    View Slide

52. “Creation, management, and use of persistent, dynamic,
    shareable 3D machine-readable representations of physical
    spaces, and real time services to offer AR Experiences to
    users.”
    Open AR Cloud Definition
    

    View Slide

53. View Slide

54. AR Cloud
    • MirrorWorld
    • Livemaps (Facebook)
    • Spatial Web
    • Magicverse (MagicLeap)
    • Real World Web
    • Superverse (Jan-Erik Vinje)
    • Spatial Maps
    • Metaverse (Snowcrash)
    • 3D Soft copy of the world
    • Location Anchors (Apple)
    • Digital Twin
    • Spatial Anchors (Microsoft)
    

    View Slide

55. 3. Designing Experiences
    

    View Slide

56. View Slide

57. Putting it Together
    

    View Slide

58. Section Title
    

    View Slide

59. Layers of Experience
    

    View Slide

60. Layers of Experience
    Notifications Relay relevant information based on context
    Services Simple focussed features at the system level that can be applied to various situations
    Lenses Specific layers of information that overlay the world
    Applications
    More complex sets of features that support specific experiences
    

    View Slide

61. Notification: Reminders
    

    View Slide

62. View Slide

63. View Slide

64. View Slide

65. View Slide

66. View Slide

67. “Directions to Daily
    Chai please”
    

    View Slide

68. View Slide

69. Application: Wedding Venue
    

    View Slide

70. View Slide

71. View Slide

72. View Slide

73. Wrap Up
    

    View Slide

74. Silke Sietsma, Head of Emerging Design at Adobe
    “With spatial computing we can use our voice, sight, touch (in 3D),
    gestures, and other natural inputs to directly connect with information.
    We no longer need to think and behave like a computer for it to under‐
    stand us, because it will relate humanly to us.”
    

    View Slide

75. References
    • Augmented Reality: Unboxing Tech's Next Big Thing (2020) Pesce, M.
    • Connecting and Controlling Appliances Through Wearable Augmented Reality. (2020) Becker, V.,
    Rauchenstein, F. & Sörös, G. https://doi.org/10.1007/s41133-019-0019-0
    • Creating Augmented and Virtual Realities (2019) Pangilinan, E., Lukas, S., Mohan V.
    • Proxemic-aware controls: designing remote controls for ubiquitous computing ecologies. In:
    Proceedings of the 2015 international conference on human–computer interaction with mobile
    devices and services, MobileHCI ’15 (2015) Ledo D., Greenberg S., Marquardt N., Boring S.
    • The Augmented Human: How Technology is Shaping the New Reality (2017) Papagiannis, H.
    • The Infinite Retina (2020) Cronin, I., Scoble, R.
    • The Spatial Web: How Web 3.0 will connect humans, machines and AI to transform the world (2019)
    Rene, G., Mapes, D.
    

    View Slide

76. Oliver Weidlich
    Director of Design & Innovation
    oliverw@mobileexperience.com.au
    0411 551 561
    @oliverw
    Thanks!
    

    View Slide