Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Building your first Augmented Reality Experiences

Building your first Augmented Reality Experiences

Augmented reality allows you to create richer and more immersive experiences in your apps
In this interactive session, Noble Ackerson, a seasoned Technical Product Lead and GDE, shares insights with examples through a fun "choose your own adventure" technical talk (Bandersnatch-style), on how to build marker-based AR with Augmented Images to create experiences to transform data from the world into practical utility for your users.

Noble Ackerson

August 22, 2019

More Decks by Noble Ackerson

Other Decks in Technology


  1. 2 Help you understand how easy it is to build

    for Augmented Reality Convey that AR is more than “Pokemon-Go” it brings real utility to your apps. Today’s Goals
  2. The mixture of the real world and virtual worlds so

    that one understands the other. This creates experiences that cannot possibly happen anywhere else. AR/MR
  3. Assumes • You have a use-case that is better with

    AR • You have basic knowledge of Unity3D • You have setup an Android environment before • You are armed with curiosity about AR?

    HDR) /c/nobleackerson @nobleackerson www.nobles.page CLOUD ANCHORS (Interactions)
  5. Social AR experiences with Cloud Anchors Fundamentals • Environment ◦

    Reduce UI elements • User ◦ Encourage user movement when interacting with objects but don’t require it always. • AR Content ◦ Realism is important ◦ Highlighting, Sizing & Movement should be familiar gestures • Interface ◦ The interface is the viewport, & also, the hub of interactions for mobile AR. • Communicate the intent of camera usage clearly before permission prompts. • Be responsive with your UI components. • Volumetric UI ◦ Annotate on focus ◦ Holograms are good previews
  6. Development Environment for ARCore Unity 2017.4.15f1 + 2018.3.1f1 ARCore SDK

    1.6.0 + A compatible phone developers.google.com/ar/discover/supported-devices
  7. How do augmented images work? Precompile up to 1000 images

    via DB 1 Add Images to DB 2 Detect Images 3 Render Assets (video, 3D prefabs, etc.)
  8. An example of how the Augmented Images API can be

    used with moving targets by JD.com Credit Google Developer Blog - https://developers.googleblog.com/2019/05/AR Core-IO19.html
  9. Rendering • Utilities ◦ Blender ◦ Maya etc. ◦ SketchFab

    ◦ Asset Store ◦ Mixamo • Asset Formats ◦ OBJ ◦ FBX ◦ GLTF 2.0
  10. Anatomy of your app ➔ ARCore Device ➔ Environmental Light

    ➔ A Plane Detector ➔ A Raycast from Device ➔ A Plane Visualizer ➔ System Controller ➔ An Event System ➔ A 2D Canvas ➔ Interactions ➔ Some Magic
  11. Pro-tips ➔ Supports PNG, JPEG and JPG formats ➔ Detection

    is based on points of high contrast ➔ Image’s resolution must be at least 300 X 300 pixels ➔ Images with repetitive features suck ➔ Don’t try to track moving objects.
  12. Design Principles for Augmented Reality CONTENT Avoid separate onscreen controls.

    UX Use the entire display to engage people. ACCESSIBILITY Be mindful of the user's safety and privacy
  13. Audio enhances AR experiences. Provide confirmation that a virtual object

    has come into contact with a physical surface or other virtual object Use sound to aid with getting interactions with precision for your users.
  14. In summary ➔ AR has practical use cases & brings

    immersion ➔ Reality in Augmented Reality is Data ➔ Have Accessibility, Safety, & Privacy in mind /c/nobleackerson @nobleackerson