Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Building xR Experiences With ARCore & Unity

Building xR Experiences With ARCore & Unity

The idea for this talk was to expand upon not just HOW to build AR experiences with ARCore but WHY you should consider it.

Noble Ackerson

October 10, 2017
Tweet

More Decks by Noble Ackerson

Other Decks in Technology

Transcript

  1. xR Experiences
    with ARCore &
    Unity
    /c/nobleackerson
    @nobleackerson

    View full-size slide

  2. What is Augmented
    Reality?

    View full-size slide

  3. The mixture of the real world
    and virtual worlds so that
    one understands the other.
    This creates experiences that
    cannot possibly happen
    anywhere else.
    - Graeme Devine, Magic Leap

    View full-size slide

  4. The R is for Data
    Image Credit: https://dribbble.com/AndrewCoyleDesign
    xR works when
    computers interpret the
    environment and return
    responses that engage
    our senses.

    View full-size slide

  5. Hi, I’m Noble
    Technical Product Manager, Independent Dev

    View full-size slide

  6. So what is ARCore?

    View full-size slide

  7. Motion Tracking

    View full-size slide

  8. Area Learning

    View full-size slide

  9. Depth Perception

    View full-size slide

  10. ARCore
    Environmental
    Understanding
    Motion
    Tracking
    Light
    Estimation

    View full-size slide

  11. Development
    environment
    ● Unity 2017.2.0b9 or later
    ● Configure Player Settings:
    ○ Other Settings > Multithreaded Rendering: Off
    ○ Other Settings > Minimum/Target API Level:
    Android 7.0 or higher
    ○ XR Settings > ARCore Supported: On
    ● Prepare your phone

    View full-size slide

  12. Tracked Plane
    HelloARController.cs

    View full-size slide

  13. Point cloud
    /SDK/.../PointClud.cs (/PointCloudVisualizer.cs)

    View full-size slide

  14. Managing Our Model
    HelloARController.cs

    View full-size slide

  15. Light Estimation
    /SDK/.../LightEstimate.cs

    View full-size slide

  16. Some Design Principles for Augmented Reality
    Be mindful of the user's safety.
    Avoid separate onscreen
    controls.
    Use the entire display to
    engage people.

    View full-size slide

  17. Visual clutter in AR

    View full-size slide

  18. Building
    Engaging AR
    Experiences
    That Matter
    Factors Effort/Cost Marketability Better in AR
    - Unique
    Solves a
    problem
    Score
    Weights 20% 25% 20% 35% 100%
    Metro Issues AR
    Visualizer
    3
    (0.6)
    5
    (1.25)
    2
    (0.4)
    3
    (1.05)
    3.3
    Workout with
    AR/AI Assistant
    4
    (0.8)
    3
    (0.75)
    1
    (0.2)
    1
    (0.35)
    Other idea 2
    (0.4)
    3
    (0.6)
    5
    (1)
    2
    (0.7)

    View full-size slide

  19. What About Audio?

    View full-size slide

  20. Audio and haptic
    feedback enhances
    xR experiences.
    Provide confirmation that a virtual object
    has come into contact with a physical
    surface or other virtual object

    View full-size slide

  21. Safety, Comfort, Happiness, Engagement,
    Utility
    Image Credit: Luden.io
    Testing & Validation

    View full-size slide

  22. In summary
    ● It is still the early days of AR (xR generally)
    ● The R in AR is Data
    ● Make it obvious you’re gathering data
    ● Build for mobile AR
    ● Consider WebAR for quick demos
    ● Be mindful of the user's safety
    ● Favor functional experiences that matter

    View full-size slide

  23. Thank you!
    @nobleackerson

    View full-size slide