Building xR Experiences With ARCore & Unity

The idea for this talk was to expand upon not just HOW to build AR experiences with ARCore but WHY you should consider it.

Transcript

1. xR Experiences
   with ARCore &
   Unity
   /c/nobleackerson
   @nobleackerson
   

   View Slide

2. What is Augmented
   Reality?
   

   View Slide

3. Sort of...
   

   View Slide

4. The mixture of the real world
   and virtual worlds so that
   one understands the other.
   This creates experiences that
   cannot possibly happen
   anywhere else.
   - Graeme Devine, Magic Leap
   

   View Slide

5. The R is for Data
   Image Credit: https://dribbble.com/AndrewCoyleDesign
   xR works when
   computers interpret the
   environment and return
   responses that engage
   our senses.
   

   View Slide

6. Hi, I’m Noble
   Technical Product Manager, Independent Dev
   

   View Slide

7. View Slide

8. View Slide

9. So what is ARCore?
   

   View Slide

10. Motion Tracking
    

    View Slide

11. Area Learning
    

    View Slide

12. Depth Perception
    

    View Slide

13. ARCore
    Environmental
    Understanding
    Motion
    Tracking
    Light
    Estimation
    

    View Slide

14. Development
    environment
    ● Unity 2017.2.0b9 or later
    ● Configure Player Settings:
    ○ Other Settings > Multithreaded Rendering: Off
    ○ Other Settings > Minimum/Target API Level:
    Android 7.0 or higher
    ○ XR Settings > ARCore Supported: On
    ● Prepare your phone
    

    View Slide

15. Editor/Code
    

    View Slide

16. Tracked Plane
    HelloARController.cs
    

    View Slide

17. Point cloud
    /SDK/.../PointClud.cs (/PointCloudVisualizer.cs)
    

    View Slide

18. Managing Our Model
    HelloARController.cs
    

    View Slide

19. Light Estimation
    /SDK/.../LightEstimate.cs
    

    View Slide

20. Some Design Principles for Augmented Reality
    Be mindful of the user's safety.
    Avoid separate onscreen
    controls.
    Use the entire display to
    engage people.
    

    View Slide

21. Visual clutter in AR
    

    View Slide

22. ?
    

    View Slide

23. Building
    Engaging AR
    Experiences
    That Matter
    Factors Effort/Cost Marketability Better in AR
    - Unique
    Solves a
    problem
    Score
    Weights 20% 25% 20% 35% 100%
    Metro Issues AR
    Visualizer
    3
    (0.6)
    5
    (1.25)
    2
    (0.4)
    3
    (1.05)
    3.3
    Workout with
    AR/AI Assistant
    4
    (0.8)
    3
    (0.75)
    1
    (0.2)
    1
    (0.35)
    Other idea 2
    (0.4)
    3
    (0.6)
    5
    (1)
    2
    (0.7)
    

    View Slide

24. Demos
    

    View Slide

25. What About Audio?
    

    View Slide

26. Audio and haptic
    feedback enhances
    xR experiences.
    Provide confirmation that a virtual object
    has come into contact with a physical
    surface or other virtual object
    

    View Slide

27. Safety, Comfort, Happiness, Engagement,
    Utility
    Image Credit: Luden.io
    Testing & Validation
    

    View Slide

28. In summary
    ● It is still the early days of AR (xR generally)
    ● The R in AR is Data
    ● Make it obvious you’re gathering data
    ● Build for mobile AR
    ● Consider WebAR for quick demos
    ● Be mindful of the user's safety
    ● Favor functional experiences that matter
    

    View Slide

29. Thank you!
    @nobleackerson
    

    View Slide