Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ARCore Parkour | A technical talk on building Augmented Reality experiences with ARCore

ARCore Parkour | A technical talk on building Augmented Reality experiences with ARCore

Today there are lots of case studies for Spatial Computing (Augmented reality, virtual reality, and even mixed reality) in education and entertainment unfortunately for some of the newly released ARCore features like Augmented Images lack practical example use-cases and tutorials. In this interactive session, Noble Ackerson, a seasoned Technical Product Lead and GDE, shares insights with examples, on how AR creates experiences can leverage Augmented Images or marker-based AR technology to transform data from the world into practical utility for your users.

Noble Ackerson

February 23, 2019
Tweet

More Decks by Noble Ackerson

Other Decks in Technology

Transcript

  1. ARCore Parkour
    A technical talk on building Augmented
    Reality experiences with ARCore
    With Noble Ackerson

    View Slide

  2. Sugar Puffs Frosties
    #AR #CYOP
    @nobleackerson
    Feedback

    View Slide

  3. Hi, I’m Noble
    Product Strategist, Independent Dev
    /c/nobleackerson @nobleackerson www.nobles.page

    View Slide

  4. Assumes
    ● You have basic knowledge of Unity3D
    ● You have setup an Android environment before
    ● You are armed with curiosity about AR?

    View Slide

  5. Spatial Computing
    Augmented
    1
    Mixed
    2
    Virtual
    3
    Reality
    /c/nobleackerson @nobleackerson www.nobles.page

    View Slide

  6. The mixture of the real world
    and virtual worlds so that one
    understands the other.
    This creates experiences that cannot
    possibly happen anywhere else.
    AR/MR

    View Slide

  7. Image (Slide) credit Rony Abovitz @rabovitz Twitter

    View Slide

  8. AR use-cases About ARCore

    View Slide

  9. AR: Common business use-cases
    Data capture & markup Entertainment Commerce & Marketing Maintenance and repair
    /c/nobleackerson @nobleackerson www.nobles.page

    View Slide

  10. Use-case #1: Data
    capture & markup

    View Slide

  11. View Slide

  12. Use-case #2:
    Entertainment

    View Slide

  13. Magic Leap

    View Slide

  14. Use case #3:
    Commerce and
    Marketing

    View Slide

  15. View Slide

  16. Use case #4: Aided Maintenance
    and Repair

    View Slide

  17. View Slide

  18. Data Visualization

    View Slide

  19. Credit: AR Experiments

    View Slide

  20. LynxFit

    View Slide

  21. Design Principles About ARCore

    View Slide

  22. Augmented Faces
    ARCore Anchors
    Cloud Anchors
    Augmented Images

    View Slide

  23. Development Environment for ARCore
    Unity 2017.4.15f1 +
    2018.3.1f1
    ARCore SDK 1.6.0 +
    A compatible phone
    developers.google.com/ar/discover/supported-devices

    View Slide

  24. Building with Unity3D Design Principles

    View Slide

  25. How do augmented images work?
    Precompile up to 1000
    images via DB
    1
    Add Images to DB
    2
    Detect Images
    3
    Render Assets
    (video, 3D prefabs, etc.)

    View Slide

  26. Create database file

    View Slide

  27. View Slide

  28. Create Session: Use DB File

    View Slide

  29. 2
    Detect Images

    View Slide

  30. 3
    Render Assets
    (video, 3D prefabs, etc.)

    View Slide

  31. Anatomy of your app
    ➔ ARCore Device
    ➔ Environmental Light
    ➔ A Plane Detector
    ➔ A Raycast from Device
    ➔ A Plane Visualizer
    ➔ System Controller
    ➔ An Event System
    ➔ A 2D Canvas
    ➔ Interactions
    ➔ Some Magic

    View Slide

  32. Pro-tips
    ➔ Supports PNG, JPEG and JPG formats
    ➔ Detection is based on points of high contrast
    ➔ Image’s resolution must be at least 300 X 300 pixels
    ➔ Images with repetitive features suck
    ➔ Don’t try to track moving objects.

    View Slide

  33. Design Considerations Trends

    View Slide

  34. Design Principles for Augmented Reality
    ACCESSIBILITY
    Be mindful of the user's safety
    and privacy
    CONTENT
    Avoid separate onscreen
    controls.
    UX
    Use the entire display to engage
    people.

    View Slide

  35. Accessibility

    View Slide

  36. View Slide

  37. UI
    INITIALIZATION PLACEMENT SOUND/HAPTICS

    View Slide

  38. Audio enhances
    AR experiences.
    Provide confirmation that a
    virtual object has come into
    contact with a physical surface
    or other virtual object
    Use sound to aid with getting
    interactions with precision for
    your users.

    View Slide

  39. User Experience

    View Slide

  40. UI: Translation

    View Slide

  41. Privacy, Safety &
    Comfort

    View Slide

  42. Safety, Comfort, Happiness, Engagement, Utility
    Image Credit: Luden.io
    Testing & Validation

    View Slide

  43. 2019 in Spatial Computing
    Oculus Quest
    Oculus Quest promises portability and 6-DOF - $400
    Microsoft Hololens 2
    Expect improvement with FOV and lower price point
    Magic Leap One
    Cinematic Reality for all.
    Focals by North - $999
    No public SDKs but Vuzix does
    Bose Frames

    View Slide

  44. Available devices

    View Slide

  45. View Slide

  46. AR Compatible mobile devices

    View Slide

  47. Heads up Displays

    View Slide

  48. AR Capable head-worn devices

    View Slide

  49. Mix-Reality head-worn devices

    View Slide

  50. In summary
    ➔ AR has practical use cases
    ➔ Reality in Augmented Reality is Data
    ➔ Have Accessibility, Safety, & Privacy in mind
    /c/nobleackerson @nobleackerson

    View Slide

  51. Thank you!
    @nobleackerson www.nobles.page

    View Slide

  52. View Slide