Augmented Reality, the future of our history

Using tools such as ARCore, ARKit, ARFoundations from Unity, we are able to inspire apps that understand space and motion in high fidelity while seamlessly blending the digital and physical worlds.

In my example, I am recording interviews with my family and blending that recorded audio with physical artifacts such as photos, urns, and heirlooms owned by my relatives.

I’ve been leveraging these tools to build AR apps that can respond to these artifacts in my environment.

Transcript

1. ARCore Parkour A technical talk on building Augmented Reality experiences with ARCore With Noble Ackerson
2. Sugar Puffs Frosties #ARCoreParkour #CYOP @nobleackerson Feedback
3. @nobleackerson Product Strategist Open ARCloud Privacy WGC acting co-chair www.nobles.page Hi, I’m Noble!
7. What is AR/MR? How is this possible?
8. Hi, I’m Noble Product Strategist, OpenARCloud founding member /c/nobleackerson @nobleackerson www.nobles.page HOW
9. 9 9 Help you understand how easy it is to build for Augmented Reality Convey that AR is more than “Pokemon-Go” it brings real utility to your apps. Today’s Goals HOW
10. The mixture of the real world and virtual worlds so that one understands the other. This creates experiences that cannot possibly happen anywhere else. AR/MR HOW
11. Augmented 1 Mixed 2 Virtual 3 HOW Spatial Cloud
12. Assumes • You have a use-case that is better with AR • You have basic knowledge of Unity3D • You have setup an Android environment before • You are armed with curiosity about AR? HOW
13. AR use-cases About ARCore
14. So what is ARCore? HOW
15. ARCore fundamentals ENVIRONMENTAL UNDERSTANDING MOTION TRACKING (Persistence) LIGHT ESTIMATION (Environmental HDR) /c/nobleackerson @nobleackerson www.nobles.page HOW CLOUD ANCHORS (Interactions)
16. Augmented Faces ARCore Anchors Cloud Anchors Augmented Images HOW
17. Social AR experiences with Cloud Anchors Fundamentals • Environment ◦ Reduce UI elements • User ◦ Encourage user movement when interacting with objects but don’t require it always. • AR Content ◦ Realism is important ◦ Highlighting, Sizing & Movement should be familiar gestures • Interface ◦ The interface is the viewport, & also, the hub of interactions for mobile AR. • Communicate the intent of camera usage clearly before permission prompts. • Be responsive with your UI components. • Volumetric UI ◦ Annotate on focus ◦ Holograms are good previews youtube.com/c/nobleackerson
18. Demo(s) /c/nobleackerson @nobleackerson www.nobles.page
19. EVERYONE HAS A PLAN UNTIL THEY GET PUNCHED IN THE MOUTH. Mike Tyson
20. Development Environment for ARCore Unity 2017.4.15f1 + 2018.3.1f1 ARCore SDK 1.6.0 + A compatible phone developers.google.com/ar/discover/supported-devices
21. Building with Unity3D Design Principles
22. How do augmented images work? Precompile up to 1000 images via DB 1 Add Images to DB 2 Detect Images 3 Render Assets (video, 3D prefabs, etc.) HOW
23. Add Images to Database Precompile up to 1000 images via DB 1 HOW
24. Create database file HOW
25. HOW
26. Create Session: Use DB File HOW
27. Detect Images 2 HOW
28. myARController.cs Update Method
29. myARController.cs Update Method
30. Render Assets 3 HOW
31. An example of how the Augmented Images API can be used with moving targets by JD.com Credit Google Developer Blog - https://developers.googleblog.com/2019/05/AR Core-IO19.html
32. Rendering • Utilities ◦ Blender ◦ Maya etc. ◦ SketchFab ◦ Asset Store ◦ Mixamo • Asset Formats ◦ OBJ ◦ FBX ◦ GLTF 2.0
33. Anatomy of your app ➔ ARCore Device ➔ Environmental Light ➔ A Plane Detector ➔ A Raycast from Device ➔ A Plane Visualizer ➔ System Controller ➔ An Event System ➔ A 2D Canvas ➔ Interactions ➔ Some Magic
34. Pro-tips ➔ Supports PNG, JPEG and JPG formats ➔ Detection is based on points of high contrast ➔ Image’s resolution must be at least 300 X 300 pixels ➔ Images with repetitive features suck ➔ Don’t try to track moving objects.
35. In summary ➔ AR has practical use cases ➔ Reality in Augmented Reality is Data ➔ Have Accessibility, Safety, & Privacy in mind /c/nobleackerson @nobleackerson
36. Thank you! @nobleackerson github.com/stigsfoot/ARCoreParkour