ARCore Parkour | A technical talk on building Augmented Reality experiences with ARCore

Today there are lots of case studies for Spatial Computing (Augmented reality, virtual reality, and even mixed reality) in education and entertainment unfortunately for some of the newly released ARCore features like Augmented Images lack practical example use-cases and tutorials. In this interactive session, Noble Ackerson, a seasoned Technical Product Lead and GDE, shares insights with examples, on how AR creates experiences can leverage Augmented Images or marker-based AR technology to transform data from the world into practical utility for your users.

Transcript

1. ARCore Parkour
   A technical talk on building Augmented
   Reality experiences with ARCore
   With Noble Ackerson
   

   View Slide

2. Sugar Puffs Frosties
   #AR #CYOP
   @nobleackerson
   Feedback
   

   View Slide

3. Hi, I’m Noble
   Product Strategist, Independent Dev
   /c/nobleackerson @nobleackerson www.nobles.page
   

   View Slide

4. Assumes
   ● You have basic knowledge of Unity3D
   ● You have setup an Android environment before
   ● You are armed with curiosity about AR?
   

   View Slide

5. Spatial Computing
   Augmented
   1
   Mixed
   2
   Virtual
   3
   Reality
   /c/nobleackerson @nobleackerson www.nobles.page
   

   View Slide

6. The mixture of the real world
   and virtual worlds so that one
   understands the other.
   This creates experiences that cannot
   possibly happen anywhere else.
   AR/MR
   

   View Slide

7. Image (Slide) credit Rony Abovitz @rabovitz Twitter
   

   View Slide

8. AR use-cases About ARCore
   

   View Slide

9. AR: Common business use-cases
   Data capture & markup Entertainment Commerce & Marketing Maintenance and repair
   /c/nobleackerson @nobleackerson www.nobles.page
   

   View Slide

10. Use-case #1: Data
    capture & markup
    

    View Slide

11. View Slide

12. Use-case #2:
    Entertainment
    

    View Slide

13. Magic Leap
    

    View Slide

14. Use case #3:
    Commerce and
    Marketing
    

    View Slide

15. View Slide

16. Use case #4: Aided Maintenance
    and Repair
    

    View Slide

17. View Slide

18. Data Visualization
    

    View Slide

19. Credit: AR Experiments
    

    View Slide

20. LynxFit
    

    View Slide

21. Design Principles About ARCore
    

    View Slide

22. Augmented Faces
    ARCore Anchors
    Cloud Anchors
    Augmented Images
    

    View Slide

23. Development Environment for ARCore
    Unity 2017.4.15f1 +
    2018.3.1f1
    ARCore SDK 1.6.0 +
    A compatible phone
    developers.google.com/ar/discover/supported-devices
    

    View Slide

24. Building with Unity3D Design Principles
    

    View Slide

25. How do augmented images work?
    Precompile up to 1000
    images via DB
    1
    Add Images to DB
    2
    Detect Images
    3
    Render Assets
    (video, 3D prefabs, etc.)
    

    View Slide

26. Create database file
    

    View Slide

27. View Slide

28. Create Session: Use DB File
    

    View Slide

29. 2
    Detect Images
    

    View Slide

30. 3
    Render Assets
    (video, 3D prefabs, etc.)
    

    View Slide

31. Anatomy of your app
    ➔ ARCore Device
    ➔ Environmental Light
    ➔ A Plane Detector
    ➔ A Raycast from Device
    ➔ A Plane Visualizer
    ➔ System Controller
    ➔ An Event System
    ➔ A 2D Canvas
    ➔ Interactions
    ➔ Some Magic
    

    View Slide

32. Pro-tips
    ➔ Supports PNG, JPEG and JPG formats
    ➔ Detection is based on points of high contrast
    ➔ Image’s resolution must be at least 300 X 300 pixels
    ➔ Images with repetitive features suck
    ➔ Don’t try to track moving objects.
    

    View Slide

33. Design Considerations Trends
    

    View Slide

34. Design Principles for Augmented Reality
    ACCESSIBILITY
    Be mindful of the user's safety
    and privacy
    CONTENT
    Avoid separate onscreen
    controls.
    UX
    Use the entire display to engage
    people.
    

    View Slide

35. Accessibility
    

    View Slide

36. View Slide

37. UI
    INITIALIZATION PLACEMENT SOUND/HAPTICS
    

    View Slide

38. Audio enhances
    AR experiences.
    Provide confirmation that a
    virtual object has come into
    contact with a physical surface
    or other virtual object
    Use sound to aid with getting
    interactions with precision for
    your users.
    

    View Slide

39. User Experience
    

    View Slide

40. UI: Translation
    

    View Slide

41. Privacy, Safety &
    Comfort
    

    View Slide

42. Safety, Comfort, Happiness, Engagement, Utility
    Image Credit: Luden.io
    Testing & Validation
    

    View Slide

43. 2019 in Spatial Computing
    Oculus Quest
    Oculus Quest promises portability and 6-DOF - $400
    Microsoft Hololens 2
    Expect improvement with FOV and lower price point
    Magic Leap One
    Cinematic Reality for all.
    Focals by North - $999
    No public SDKs but Vuzix does
    Bose Frames
    

    View Slide

44. Available devices
    

    View Slide

45. View Slide

46. AR Compatible mobile devices
    

    View Slide

47. Heads up Displays
    

    View Slide

48. AR Capable head-worn devices
    

    View Slide

49. Mix-Reality head-worn devices
    

    View Slide

50. In summary
    ➔ AR has practical use cases
    ➔ Reality in Augmented Reality is Data
    ➔ Have Accessibility, Safety, & Privacy in mind
    /c/nobleackerson @nobleackerson
    

    View Slide

51. Thank you!
    @nobleackerson www.nobles.page
    

    View Slide

52. View Slide