Augmented Reality, the future of our history

Using tools such as ARCore, ARKit, ARFoundations from Unity, we are able to inspire apps that understand space and motion in high fidelity while seamlessly blending the digital and physical worlds.

In my example, I am recording interviews with my family and blending that recorded audio with physical artifacts such as photos, urns, and heirlooms owned by my relatives.

I’ve been leveraging these tools to build AR apps that can respond to these artifacts in my environment.

Transcript

1. ARCore Parkour
   A technical talk on building Augmented
   Reality experiences with ARCore
   With Noble Ackerson
   

   View Slide

2. Sugar Puffs Frosties
   #ARCoreParkour
   #CYOP
   @nobleackerson
   Feedback
   

   View Slide

3. @nobleackerson
   Product Strategist
   Open ARCloud Privacy WGC acting co-chair
   www.nobles.page
   Hi, I’m Noble!
   

   View Slide

4. View Slide

5. View Slide

6. View Slide

7. What is AR/MR? How is this possible?
   

   View Slide

8. Hi, I’m Noble
   Product Strategist, OpenARCloud founding member
   /c/nobleackerson @nobleackerson www.nobles.page
   HOW
   

   View Slide

9. 9
   9
   Help you understand how easy it is to build
   for Augmented Reality
   Convey that AR is more than
   “Pokemon-Go” it brings real utility to your
   apps.
   Today’s Goals
   HOW
   

   View Slide

10. The mixture of the real world
    and virtual worlds so that one
    understands the other.
    This creates experiences that cannot
    possibly happen anywhere else.
    AR/MR
    HOW
    

    View Slide

11. Augmented
    1
    Mixed
    2
    Virtual
    3
    HOW
    Spatial Cloud
    

    View Slide

12. Assumes
    ● You have a use-case that is better with AR
    ● You have basic knowledge of Unity3D
    ● You have setup an Android environment before
    ● You are armed with curiosity about AR?
    HOW
    

    View Slide

13. AR use-cases About ARCore
    

    View Slide

14. So what is ARCore?
    HOW
    

    View Slide

15. ARCore fundamentals
    ENVIRONMENTAL
    UNDERSTANDING
    MOTION TRACKING
    (Persistence)
    LIGHT ESTIMATION
    (Environmental HDR)
    /c/nobleackerson @nobleackerson www.nobles.page
    HOW
    CLOUD ANCHORS
    (Interactions)
    

    View Slide

16. Augmented Faces
    ARCore Anchors
    Cloud Anchors
    Augmented Images
    HOW
    

    View Slide

17. Social AR experiences with Cloud Anchors
    Fundamentals
    ● Environment
    ○ Reduce UI elements
    ● User
    ○ Encourage user movement when
    interacting with objects but don’t
    require it always.
    ● AR Content
    ○ Realism is important
    ○ Highlighting, Sizing & Movement
    should be familiar gestures
    ● Interface
    ○
    The interface is the viewport, & also,
    the hub of interactions for mobile AR.
    ● Communicate the intent of
    camera usage clearly before
    permission prompts.
    ● Be responsive with your UI
    components.
    ● Volumetric UI
    ○ Annotate on focus
    ○ Holograms are good previews
    youtube.com/c/nobleackerson
    

    View Slide

18. Demo(s)
    /c/nobleackerson @nobleackerson www.nobles.page
    

    View Slide

19. EVERYONE HAS A PLAN UNTIL
    THEY GET PUNCHED IN THE
    MOUTH.
    Mike Tyson
    

    View Slide

20. Development Environment for ARCore
    Unity 2017.4.15f1 +
    2018.3.1f1
    ARCore SDK 1.6.0 +
    A compatible phone
    developers.google.com/ar/discover/supported-devices
    

    View Slide

21. Building with Unity3D Design Principles
    

    View Slide

22. How do augmented images work?
    Precompile up to 1000
    images via DB
    1
    Add Images to DB
    2
    Detect Images
    3
    Render Assets
    (video, 3D prefabs, etc.)
    HOW
    

    View Slide

23. Add Images to Database
    Precompile up to 1000
    images via DB
    1
    HOW
    

    View Slide

24. Create database file
    HOW
    

    View Slide

25. HOW
    

    View Slide

26. Create Session: Use DB File
    HOW
    

    View Slide

27. Detect Images
    2
    HOW
    

    View Slide

28. myARController.cs
    Update Method
    

    View Slide

29. myARController.cs
    Update Method
    

    View Slide

30. Render Assets
    3
    HOW
    

    View Slide

31. An example of how the
    Augmented Images API can be
    used with moving targets by
    JD.com
    Credit Google Developer Blog -
    https://developers.googleblog.com/2019/05/AR
    Core-IO19.html
    

    View Slide

32. Rendering
    ● Utilities
    ○ Blender
    ○ Maya
    etc.
    ○ SketchFab
    ○ Asset Store
    ○ Mixamo
    ● Asset Formats
    ○ OBJ
    ○ FBX
    ○ GLTF 2.0
    

    View Slide

33. Anatomy of your app
    ➔ ARCore Device
    ➔ Environmental Light
    ➔ A Plane Detector
    ➔ A Raycast from Device
    ➔ A Plane Visualizer
    ➔ System Controller
    ➔ An Event System
    ➔ A 2D Canvas
    ➔ Interactions
    ➔ Some Magic
    

    View Slide

34. Pro-tips
    ➔ Supports PNG, JPEG and JPG formats
    ➔ Detection is based on points of high contrast
    ➔ Image’s resolution must be at least 300 X 300 pixels
    ➔ Images with repetitive features suck
    ➔ Don’t try to track moving objects.
    

    View Slide

35. In summary
    ➔ AR has practical use cases
    ➔ Reality in Augmented Reality is Data
    ➔ Have Accessibility, Safety, & Privacy in mind
    /c/nobleackerson @nobleackerson
    

    View Slide

36. Thank you!
    @nobleackerson github.com/stigsfoot/ARCoreParkour
    

    View Slide