Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Augmented Reality, the future of our history

Augmented Reality, the future of our history

Using tools such as ARCore, ARKit, ARFoundations from Unity, we are able to inspire apps that understand space and motion in high fidelity while seamlessly blending the digital and physical worlds.

In my example, I am recording interviews with my family and blending that recorded audio with physical artifacts such as photos, urns, and heirlooms owned by my relatives.

I’ve been leveraging these tools to build AR apps that can respond to these artifacts in my environment.

D831a0a407eca3c29c6b20b3430212d0?s=128

Noble Ackerson

June 06, 2019
Tweet

Transcript

  1. ARCore Parkour A technical talk on building Augmented Reality experiences

    with ARCore With Noble Ackerson
  2. Sugar Puffs Frosties #ARCoreParkour #CYOP @nobleackerson Feedback

  3. @nobleackerson Product Strategist Open ARCloud Privacy WGC acting co-chair www.nobles.page

    Hi, I’m Noble!
  4. None
  5. None
  6. None
  7. What is AR/MR? How is this possible?

  8. Hi, I’m Noble Product Strategist, OpenARCloud founding member /c/nobleackerson @nobleackerson

    www.nobles.page HOW
  9. 9 9 Help you understand how easy it is to

    build for Augmented Reality Convey that AR is more than “Pokemon-Go” it brings real utility to your apps. Today’s Goals HOW
  10. The mixture of the real world and virtual worlds so

    that one understands the other. This creates experiences that cannot possibly happen anywhere else. AR/MR HOW
  11. Augmented 1 Mixed 2 Virtual 3 HOW Spatial Cloud

  12. Assumes • You have a use-case that is better with

    AR • You have basic knowledge of Unity3D • You have setup an Android environment before • You are armed with curiosity about AR? HOW
  13. AR use-cases About ARCore

  14. So what is ARCore? HOW

  15. ARCore fundamentals ENVIRONMENTAL UNDERSTANDING MOTION TRACKING (Persistence) LIGHT ESTIMATION (Environmental

    HDR) /c/nobleackerson @nobleackerson www.nobles.page HOW CLOUD ANCHORS (Interactions)
  16. Augmented Faces ARCore Anchors Cloud Anchors Augmented Images HOW

  17. Social AR experiences with Cloud Anchors Fundamentals • Environment ◦

    Reduce UI elements • User ◦ Encourage user movement when interacting with objects but don’t require it always. • AR Content ◦ Realism is important ◦ Highlighting, Sizing & Movement should be familiar gestures • Interface ◦ The interface is the viewport, & also, the hub of interactions for mobile AR. • Communicate the intent of camera usage clearly before permission prompts. • Be responsive with your UI components. • Volumetric UI ◦ Annotate on focus ◦ Holograms are good previews youtube.com/c/nobleackerson
  18. Demo(s) /c/nobleackerson @nobleackerson www.nobles.page

  19. EVERYONE HAS A PLAN UNTIL THEY GET PUNCHED IN THE

    MOUTH. Mike Tyson
  20. Development Environment for ARCore Unity 2017.4.15f1 + 2018.3.1f1 ARCore SDK

    1.6.0 + A compatible phone developers.google.com/ar/discover/supported-devices
  21. Building with Unity3D Design Principles

  22. How do augmented images work? Precompile up to 1000 images

    via DB 1 Add Images to DB 2 Detect Images 3 Render Assets (video, 3D prefabs, etc.) HOW
  23. Add Images to Database Precompile up to 1000 images via

    DB 1 HOW
  24. Create database file HOW

  25. HOW

  26. Create Session: Use DB File HOW

  27. Detect Images 2 HOW

  28. myARController.cs Update Method

  29. myARController.cs Update Method

  30. Render Assets 3 HOW

  31. An example of how the Augmented Images API can be

    used with moving targets by JD.com Credit Google Developer Blog - https://developers.googleblog.com/2019/05/AR Core-IO19.html
  32. Rendering • Utilities ◦ Blender ◦ Maya etc. ◦ SketchFab

    ◦ Asset Store ◦ Mixamo • Asset Formats ◦ OBJ ◦ FBX ◦ GLTF 2.0
  33. Anatomy of your app ➔ ARCore Device ➔ Environmental Light

    ➔ A Plane Detector ➔ A Raycast from Device ➔ A Plane Visualizer ➔ System Controller ➔ An Event System ➔ A 2D Canvas ➔ Interactions ➔ Some Magic
  34. Pro-tips ➔ Supports PNG, JPEG and JPG formats ➔ Detection

    is based on points of high contrast ➔ Image’s resolution must be at least 300 X 300 pixels ➔ Images with repetitive features suck ➔ Don’t try to track moving objects.
  35. In summary ➔ AR has practical use cases ➔ Reality

    in Augmented Reality is Data ➔ Have Accessibility, Safety, & Privacy in mind /c/nobleackerson @nobleackerson
  36. Thank you! @nobleackerson github.com/stigsfoot/ARCoreParkour