Upgrade to Pro — share decks privately, control downloads, hide ads and more …

GDGDC 2019 - ARCore Parkour | Immersive Experiences and Beyond

GDGDC 2019 - ARCore Parkour | Immersive Experiences and Beyond

Today there are lots of case studies for Spatial Computing (Augmented Reality, Virtual Reality, Mixed Reality etc) in education and entertainment. Unfortunately, the newly released ARCore features like Augmented Images still lack tutorials and practical examples.

This interactive session covers 'the how' about Augmented Reality. We learn how to build using Unity3D and the ARCore SDK

Noble Ackerson

March 25, 2019
Tweet

More Decks by Noble Ackerson

Other Decks in Technology

Transcript

  1. ARCore Parkour
    A technical talk on building Augmented
    Reality experiences with ARCore
    With Noble Ackerson

    View full-size slide

  2. EVERYONE HAS A PLAN
    UNTIL THEY GET PUNCHED IN
    THE MOUTH.
    Mike Tyson

    View full-size slide

  3. Sugar Puffs Frosties
    #ARCoreParkour
    #CYOP
    @nobleackerson
    Feedback

    View full-size slide

  4. @nobleackerson
    Product Strategist
    Open ARCloud Privacy WGC acting co-chair
    www.nobles.page
    Hi, I’m Noble!

    View full-size slide

  5. 5
    5
    Help you understand how easy it is to build
    for Augmented Reality
    Convey that AR is more than
    “Pokemon-Go” it brings real utility to your
    apps.
    Today’s Goals

    View full-size slide

  6. Assumes
    ● You have basic knowledge of Unity3D
    ● You have setup an Android environment before
    ● You are armed with curiosity about AR?

    View full-size slide

  7. Spatial Computing
    Augmented
    1
    Mixed
    2
    Virtual
    3
    Reality
    /c/nobleackerson @nobleackerson www.nobles.page

    View full-size slide

  8. The mixture of the real world
    and virtual worlds so that one
    understands the other.
    This creates experiences that cannot
    possibly happen anywhere else.
    AR/MR

    View full-size slide

  9. Image (Slide) credit Rony Abovitz @rabovitz

    View full-size slide

  10. AR use-cases About ARCore

    View full-size slide

  11. AR: Common business use-cases
    Data capture & markup Entertainment Commerce & Marketing Maintenance and repair
    /c/nobleackerson @nobleackerson www.nobles.page

    View full-size slide

  12. Use-case #1: Data
    capture & markup

    View full-size slide

  13. Use-case #2:
    Entertainment

    View full-size slide

  14. Use case #3:
    Commerce and
    Marketing

    View full-size slide

  15. Use case #4: Aided Maintenance
    and Repair

    View full-size slide

  16. Data Visualization

    View full-size slide

  17. Credit: AR Experiments

    View full-size slide

  18. Design Principles About ARCore

    View full-size slide

  19. So what is ARCore?

    View full-size slide

  20. ARCore fundamentals
    ENVIRONMENTAL
    UNDERSTANDING
    MOTION TRACKING LIGHT ESTIMATION
    /c/nobleackerson @nobleackerson www.nobles.page

    View full-size slide

  21. Augmented Faces
    ARCore Anchors
    Cloud Anchors
    Augmented Images

    View full-size slide

  22. Demo(s)
    /c/nobleackerson @nobleackerson www.nobles.page

    View full-size slide

  23. Development Environment for ARCore
    Unity 2017.4.15f1 +
    2018.3.1f1
    ARCore SDK 1.6.0 +
    A compatible phone
    developers.google.com/ar/discover/supported-devices

    View full-size slide

  24. Building with Unity3D Design Principles

    View full-size slide

  25. How do augmented images work?
    Precompile up to 1000
    images via DB
    1
    Add Images to DB
    2
    Detect Images
    3
    Render Assets
    (video, 3D prefabs, etc.)

    View full-size slide

  26. Add Images to Database
    Precompile up to 1000
    images via DB
    1

    View full-size slide

  27. Create database file

    View full-size slide

  28. Create Session: Use DB File

    View full-size slide

  29. Detect Images
    2

    View full-size slide

  30. myARController.cs

    View full-size slide

  31. Render Assets
    3

    View full-size slide

  32. Rendering
    ● Utilities
    ○ Blender
    ○ Maya
    etc.
    ○ SketchFab
    ○ Asset Store
    ○ Mixamo
    ● Asset Formats
    ○ OBJ
    ○ FBX
    ○ GLTF 2.0

    View full-size slide

  33. Anatomy of your app
    ➔ ARCore Device
    ➔ Environmental Light
    ➔ A Plane Detector
    ➔ A Raycast from Device
    ➔ A Plane Visualizer
    ➔ System Controller
    ➔ An Event System
    ➔ A 2D Canvas
    ➔ Interactions
    ➔ Some Magic

    View full-size slide

  34. Pro-tips
    ➔ Supports PNG, JPEG and JPG formats
    ➔ Detection is based on points of high contrast
    ➔ Image’s resolution must be at least 300 X 300 pixels
    ➔ Images with repetitive features suck
    ➔ Don’t try to track moving objects.

    View full-size slide

  35. Design Considerations Trends

    View full-size slide

  36. Design Principles for Augmented Reality
    CONTENT
    Avoid separate onscreen
    controls.
    UX
    Use the entire display to engage
    people.
    ACCESSIBILITY
    Be mindful of the user's safety
    and privacy

    View full-size slide

  37. Accessibility

    View full-size slide

  38. UI
    INITIALIZATION PLACEMENT SOUND/HAPTICS

    View full-size slide

  39. Audio enhances
    AR experiences.
    Provide confirmation that a
    virtual object has come into
    contact with a physical surface
    or other virtual object
    Use sound to aid with getting
    interactions with precision for
    your users.

    View full-size slide

  40. User Experience

    View full-size slide

  41. UI: Translation

    View full-size slide

  42. Privacy, Safety &
    Comfort

    View full-size slide

  43. Safety, Comfort, Happiness, Engagement, Utility
    Image Credit: Luden.io
    Testing & Validation

    View full-size slide

  44. Augmented Images About ARCore

    View full-size slide

  45. In summary
    ➔ AR has practical use cases
    ➔ Reality in Augmented Reality is Data
    ➔ Have Accessibility, Safety, & Privacy in mind
    /c/nobleackerson @nobleackerson

    View full-size slide

  46. Thank you!
    @nobleackerson www.nobles.page

    View full-size slide

  47. Resources
    AR Concepts:
    https://developers.google.com/ar/di
    scover/concepts
    Google Developers ARCore
    https://developers.google.com/ar/
    Github projects for ARCore:
    https://github.com/google-ar
    AR experiments for inspiration and
    to see what could be possible:
    https://experiments.withgoogle.com/ar

    View full-size slide