Today there are lots of case studies for Spatial Computing (Augmented Reality, Virtual Reality, Mixed Reality etc) in education and entertainment. Unfortunately, the newly released ARCore features like Augmented Images still lack tutorials and practical examples.
In this interactive session, Noble Ackerson, a seasoned Technical Product Lead and GDE, shares insights with examples through a fun "choose your own adventure" technical talk (Bandersnatch-style), on how to build marker-based AR with Augmented Images to create experiences to transform data from the world into practical utility for your users.
This audience chose to focus on practical use-cases of Marker Based AR
How Augmented Images
Brings data to apps
A choose your own adventure-style technical talk
With Noble Ackerson
Hi, I’m Noble
Product Strategist, Independent Dev
/c/nobleackerson @nobleackerson www.nobles.page
The mixture of the real world
and virtual worlds so that one
understands the other.
This creates experiences that cannot
possibly happen anywhere else.
The R is for Data
Image Credit: https://dribbble.com/AndrewCoyleDesign
Spatial computing works
best when computers
interpret the environment
and return responses that
engage our senses.
AR: Common business use-cases
Data capture & markup Entertainment Commerce & Marketing Maintenance and repair
Use-case #1: Data
capture & markup
Use-case #2: Entertainment
Use case #3: Commerce
Use case #4: Aided Maintenance
Credit: AR Experiments
So what is ARCore?
Marker-based AR where the digital world is
anchored to the real world
Development Environment for ARCore
Unity 2017.4.15f1 +
ARCore SDK 1.6.0 +
A compatible phone
How do augmented images work?
Precompile up to 1000
images via DB
Add Images to DB
(video, 3D prefabs, etc.)
Create database file
● Supports PNG, JPEG and JPG formats
● Detection is based on points of high contrast
● Image’s resolution must be at least 300 X 300 pixels
● Images with repetitive features suck
● Don’t try to track moving objects.
Some Design Principles for Augmented Reality
Be mindful of the user's safety
Avoid separate onscreen
Use the entire display to
Safety, Comfort, Happiness, Engagement, Utility
Image Credit: Luden.io
Testing & Validation
What About Audio?
Provide confirmation that a
virtual object has come into
contact with a physical surface
or other virtual object
Use sound to aid with getting
interactions with precision for
● AR has practical usecases
● Reality in Augmented Reality is Data
● Make sure your editor/devices are supported
● Build for your device (mobile vs head-worn)
● Augmented Images have privacy implications
● Be mindful of the user's safety
● Favor functional experiences that matter
Google Developers ARCore
Github projects for ARCore:
AR experiments for inspiration and
to see what could be possible: