ARCore Parkour | A technical talk on building Augmented Reality experiences with ARCore

Today there are lots of case studies for Spatial Computing (Augmented reality, virtual reality, and even mixed reality) in education and entertainment unfortunately for some of the newly released ARCore features like Augmented Images lack practical example use-cases and tutorials. In this interactive session, Noble Ackerson, a seasoned Technical Product Lead and GDE, shares insights with examples, on how AR creates experiences can leverage Augmented Images or marker-based AR technology to transform data from the world into practical utility for your users.

Transcript

1. ARCore Parkour A technical talk on building Augmented Reality experiences with ARCore With Noble Ackerson
2. Sugar Puffs Frosties #AR #CYOP @nobleackerson Feedback
3. Hi, I’m Noble Product Strategist, Independent Dev /c/nobleackerson @nobleackerson www.nobles.page
4. Assumes • You have basic knowledge of Unity3D • You have setup an Android environment before • You are armed with curiosity about AR?
5. Spatial Computing Augmented 1 Mixed 2 Virtual 3 Reality /c/nobleackerson @nobleackerson www.nobles.page
6. The mixture of the real world and virtual worlds so that one understands the other. This creates experiences that cannot possibly happen anywhere else. AR/MR
7. Image (Slide) credit Rony Abovitz @rabovitz Twitter
8. AR use-cases About ARCore
9. AR: Common business use-cases Data capture & markup Entertainment Commerce & Marketing Maintenance and repair /c/nobleackerson @nobleackerson www.nobles.page
10. Use-case #1: Data capture & markup
12. Use-case #2: Entertainment
13. Magic Leap
14. Use case #3: Commerce and Marketing
16. Use case #4: Aided Maintenance and Repair
18. Data Visualization
19. Credit: AR Experiments
20. LynxFit
21. Design Principles About ARCore
22. Augmented Faces ARCore Anchors Cloud Anchors Augmented Images
23. Development Environment for ARCore Unity 2017.4.15f1 + 2018.3.1f1 ARCore SDK 1.6.0 + A compatible phone developers.google.com/ar/discover/supported-devices
24. Building with Unity3D Design Principles
25. How do augmented images work? Precompile up to 1000 images via DB 1 Add Images to DB 2 Detect Images 3 Render Assets (video, 3D prefabs, etc.)
26. Create database file
28. Create Session: Use DB File
29. 2 Detect Images
30. 3 Render Assets (video, 3D prefabs, etc.)
31. Anatomy of your app ➔ ARCore Device ➔ Environmental Light ➔ A Plane Detector ➔ A Raycast from Device ➔ A Plane Visualizer ➔ System Controller ➔ An Event System ➔ A 2D Canvas ➔ Interactions ➔ Some Magic
32. Pro-tips ➔ Supports PNG, JPEG and JPG formats ➔ Detection is based on points of high contrast ➔ Image’s resolution must be at least 300 X 300 pixels ➔ Images with repetitive features suck ➔ Don’t try to track moving objects.
33. Design Considerations Trends
34. Design Principles for Augmented Reality ACCESSIBILITY Be mindful of the user's safety and privacy CONTENT Avoid separate onscreen controls. UX Use the entire display to engage people.
35. Accessibility
37. UI INITIALIZATION PLACEMENT SOUND/HAPTICS
38. Audio enhances AR experiences. Provide confirmation that a virtual object has come into contact with a physical surface or other virtual object Use sound to aid with getting interactions with precision for your users.
39. User Experience
40. UI: Translation
41. Privacy, Safety & Comfort
42. Safety, Comfort, Happiness, Engagement, Utility Image Credit: Luden.io Testing & Validation
43. 2019 in Spatial Computing Oculus Quest Oculus Quest promises portability and 6-DOF - $400 Microsoft Hololens 2 Expect improvement with FOV and lower price point Magic Leap One Cinematic Reality for all. Focals by North - $999 No public SDKs but Vuzix does Bose Frames
44. Available devices
46. AR Compatible mobile devices
47. Heads up Displays
48. AR Capable head-worn devices
49. Mix-Reality head-worn devices
50. In summary ➔ AR has practical use cases ➔ Reality in Augmented Reality is Data ➔ Have Accessibility, Safety, & Privacy in mind /c/nobleackerson @nobleackerson
51. Thank you! @nobleackerson www.nobles.page