Building xR Experiences With ARCore & Unity

Slide 1

Slide 1 text

xR Experiences with ARCore & Unity /c/nobleackerson @nobleackerson

Slide 2

Slide 2 text

What is Augmented Reality?

Slide 3

Slide 3 text

Sort of...

Slide 4

Slide 4 text

The mixture of the real world and virtual worlds so that one understands the other. This creates experiences that cannot possibly happen anywhere else. - Graeme Devine, Magic Leap

Slide 5

Slide 5 text

The R is for Data Image Credit: https://dribbble.com/AndrewCoyleDesign xR works when computers interpret the environment and return responses that engage our senses.

Slide 6

Slide 6 text

Hi, I’m Noble Technical Product Manager, Independent Dev

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

So what is ARCore?

Slide 10

Slide 10 text

Motion Tracking

Slide 11

Slide 11 text

Area Learning

Slide 12

Slide 12 text

Depth Perception

Slide 13

Slide 13 text

ARCore Environmental Understanding Motion Tracking Light Estimation

Slide 14

Slide 14 text

Development environment ● Unity 2017.2.0b9 or later ● Configure Player Settings: ○ Other Settings > Multithreaded Rendering: Off ○ Other Settings > Minimum/Target API Level: Android 7.0 or higher ○ XR Settings > ARCore Supported: On ● Prepare your phone

Slide 15

Slide 15 text

Editor/Code

Slide 16

Slide 16 text

Tracked Plane HelloARController.cs

Slide 17

Slide 17 text

Point cloud /SDK/.../PointClud.cs (/PointCloudVisualizer.cs)

Slide 18

Slide 18 text

Managing Our Model HelloARController.cs

Slide 19

Slide 19 text

Light Estimation /SDK/.../LightEstimate.cs

Slide 20

Slide 20 text

Some Design Principles for Augmented Reality Be mindful of the user's safety. Avoid separate onscreen controls. Use the entire display to engage people.

Slide 21

Slide 21 text

Visual clutter in AR

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Building Engaging AR Experiences That Matter Factors Effort/Cost Marketability Better in AR - Unique Solves a problem Score Weights 20% 25% 20% 35% 100% Metro Issues AR Visualizer 3 (0.6) 5 (1.25) 2 (0.4) 3 (1.05) 3.3 Workout with AR/AI Assistant 4 (0.8) 3 (0.75) 1 (0.2) 1 (0.35) Other idea 2 (0.4) 3 (0.6) 5 (1) 2 (0.7)

Slide 24

Slide 24 text

Demos

Slide 25

Slide 25 text

What About Audio?

Slide 26

Slide 26 text

Audio and haptic feedback enhances xR experiences. Provide confirmation that a virtual object has come into contact with a physical surface or other virtual object

Slide 27

Slide 27 text

Safety, Comfort, Happiness, Engagement, Utility Image Credit: Luden.io Testing & Validation

Slide 28

Slide 28 text

In summary ● It is still the early days of AR (xR generally) ● The R in AR is Data ● Make it obvious you’re gathering data ● Build for mobile AR ● Consider WebAR for quick demos ● Be mindful of the user's safety ● Favor functional experiences that matter

Slide 29

Slide 29 text

Thank you! @nobleackerson