Slide 1

Slide 1 text

Your Reality Here Extended Reality and the Web

Slide 2

Slide 2 text

Peter Gasston @stopsatgreen Innovation Lead at rehab

Slide 3

Slide 3 text

I’m going to talk about four things: The post-mobile platform The reasons What’s missing The role of the Web

Slide 4

Slide 4 text

The post-mobile platform

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

Gartner hype cycle 2017

Slide 8

Slide 8 text

Benedict Evans / a16z

Slide 9

Slide 9 text

XR will be the next platform.

Slide 10

Slide 10 text

Extended reality (XR) is a spectrum REAL DIGITAL Reality Virtual Reality Augmented Reality Mixed Reality

Slide 11

Slide 11 text

The reasons

Slide 12

Slide 12 text

Why XR is the next platform: Because we’re told so Because of human nature Because we have the foundation

Slide 13

Slide 13 text

Because we’re told so

Slide 14

Slide 14 text

One day, we believe this kind of immersive, augmented reality will become part of daily life for billions of people.” —Mark Zuckerberg “

Slide 15

Slide 15 text

I regard [AR] as a big idea, like the smartphone.” —Tim Cook “

Slide 16

Slide 16 text

Some of Apple’s moves in XR 2013: Buy PrimeSense 2015: Buy Metaio 2016: Buy Flyby 2017: Buy VRVana 2017: Launch ARKit

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

Because of human nature

Slide 19

Slide 19 text

XR meets two persistent human desires: to know, and to be tricked.

Slide 20

Slide 20 text

The desire to know

Slide 21

Slide 21 text

Knowledge is power. Scientia potestas est.

Slide 22

Slide 22 text

Spoken language developed so that we could pass on knowledge; and written language so that we could record it.

Slide 23

Slide 23 text

No content

Slide 24

Slide 24 text

Answering questions you can’t articulate “… A cushion that’s orange and brown and beige with a pattern of thick and thin bars and squares.”

Slide 25

Slide 25 text

No content

Slide 26

Slide 26 text

The desire to be tricked

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

No content

Slide 29

Slide 29 text

Perspectival representation aimed to give viewers the illusion that they had been transported into geometrically coherent and psychologically convincing other worlds.” — Margaret Wertheim “

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

Because we have the foundation

Slide 35

Slide 35 text

No content

Slide 36

Slide 36 text

Mixed reality is a display problem, a sensor problem and a decision problem.” — Benedict Evans “

Slide 37

Slide 37 text

The sensor

Slide 38

Slide 38 text

Top three most-photographed subjects Source: Creative Strategies, Inc Smartphone Photography Survey. n=965. Audience: Mainstream.

Slide 39

Slide 39 text

We’re going from computers with cameras, that take photos, to computers with eyes, that can see.” — Benedict Evans “

Slide 40

Slide 40 text

No content

Slide 41

Slide 41 text

Information I’d never have had unless I’d asked whoever I was with to describe it to me. Having the ability to do that independently is really quite remarkable.” — Léonie Watson “

Slide 42

Slide 42 text

Computer vision has become commoditised in a very short time.

Slide 43

Slide 43 text

Simultaneous Location And Mapping (SLAM)

Slide 44

Slide 44 text

The display

Slide 45

Slide 45 text

Video see-through (VST) Optical see-through (OST)

Slide 46

Slide 46 text

Phone-based AR is a social impediment and can be uncomfortable for more than short bursts.

Slide 47

Slide 47 text

Having your hands free to manipulate, hold, touch or help while you’re taking a snap… greatly increases the sense of ‘place’ that you get out of it.” — Matthew Panzarino “

Slide 48

Slide 48 text

Digital in physical spaces & remixing digital input

Slide 49

Slide 49 text

Digital things sharing space with physical things

Slide 50

Slide 50 text

The decision-maker

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

In XR, what you don’t see could be as important as what you see.

Slide 53

Slide 53 text

No content

Slide 54

Slide 54 text

Google’s Knowledge Graph aims to give you an answer, not a page of links.

Slide 55

Slide 55 text

“… An intent represents a mapping between what a user says and what action should be taken by your software.”

Slide 56

Slide 56 text

What’s missing

Slide 57

Slide 57 text

Diverse voices

Slide 58

Slide 58 text

A platform that’s closely integrated with the real world should reflect real world values—not just those of Silicon Valley.

Slide 59

Slide 59 text

In the Renaissance, new concepts of scientific thinking such as perspective and space were brought into the public sphere by artists and philosophers.

Slide 60

Slide 60 text

A shared public space

Slide 61

Slide 61 text

AR has the ability to re-enable scarcity. Many AR experiences will be tied to the location in which you experience it.” — Matt Miesniks “

Slide 62

Slide 62 text

“… The future of Nike and of sneaker culture is to be able to seamlessly blend real-world charm with digital world convenience.”

Slide 63

Slide 63 text

The biggest thing that’s been missing for the entire last decade was our physical embodied space.” — Anjney Midha “

Slide 64

Slide 64 text

SLAM

Slide 65

Slide 65 text

The AR Cloud is a shared [digital] memory of the physical world. It’s the single most important software infrastructure in computing.” — Ori Inbar “

Slide 66

Slide 66 text

Cloud Anchors + Shared AR (Apple)

Slide 67

Slide 67 text

How do we stop massive platforms dominating the AR Cloud in the same way they dominate the Web?

Slide 68

Slide 68 text

Camera Positioning Standard (CPS), Fantasmo.io

Slide 69

Slide 69 text

The role of the Web

Slide 70

Slide 70 text

The Web has transformed the world, but stands aloof from it.” — Mark Pesce “

Slide 71

Slide 71 text

51.523155, -0.085156 35.0 false //londonwebstandards.org Mixed Reality Service (MRS) adds a missing metadata layer to the real world, adding links in space.

Slide 72

Slide 72 text

Hololens App Model

Slide 73

Slide 73 text

No content

Slide 74

Slide 74 text

No content

Slide 75

Slide 75 text

No content

Slide 76

Slide 76 text

Facebook 3D post

Slide 77

Slide 77 text

Article (Google prototype)

Slide 78

Slide 78 text

AR Quick Look in Safari 12

Slide 79

Slide 79 text

WebXR lets you create VR/AR experiences that are embedded in the web.

Slide 80

Slide 80 text

What the WebXR Device API does Discovers compatible devices Begins an XR session Runs a 60fps loop github.com/immersive-web

Slide 81

Slide 81 text

How to experiment with XR on the Web now AR.js, three.ar.js WebXR XR on the Web

Slide 82

Slide 82 text

We have an opportunity to more fundamentally reconsider what we want the Web to be.

Slide 83

Slide 83 text

The limitations are less about technical constraints, and more in our ability to conceptualise, structure and prioritise the aspects of the world we want to build.” — Keiichi Matsuda “

Slide 84

Slide 84 text

A richer, more shareable Web

Slide 85

Slide 85 text

We expect Stories are on track to overtake posts in Feed as the most common way that people share across all social apps.” — Mark Zuckerberg “

Slide 86

Slide 86 text

The rise of Stories

Slide 87

Slide 87 text

Our current idea of what qualifies as a site, and the value (or lack thereof) that this implies, may be holding the web back.” — Stephanie Rieger “

Slide 88

Slide 88 text

Hopscotch (concept)—fluffy-shanks.glitch.me

Slide 89

Slide 89 text

There’s a disconnect between the Web we have — which is largely text — and the Web we need, which is richly visualised. “

Slide 90

Slide 90 text

Our world is not text, and the Web, as it becomes more a part of this world, must become more like the world.” — Mark Pesce “

Slide 91

Slide 91 text

“… We use ‘X’ not as part of an acronym but as an algebraic variable to indicate ‘Your Reality Here’.”

Slide 92

Slide 92 text

Let’s make the Web be the X in XR.

Slide 93

Slide 93 text

The End