Interactions in parallel worlds with Android

Today the parallel experience can be done in two ways:
The augmented reality in which our physical environment is increased.
Virtual reality where we are completely immersed in a new universe.
These two implementations are of course very different and do not respond to the same needs. But what are the interactions at our disposal?

With the rise of technologies of parallel realities, it is important to know the best methods of interaction within these worlds.

Once immersed in a virtual environment, should we privilege the physical buttons on the helmets or the interactions of the gaze?
By increasing our real world, should we add virtual buttons to this increased environment or back to physical interactions on the smartphone?

We will show you the different ways to develop a parallel experience and show the best practices of interaction in the increased world then in the virtual environment under Android.

Link to virtual reality project :
https://github.com/wajdibr/interaction_google_daydream
Link to augmented reality project :
https://github.com/wajdibr/interaction_vuforia_virtual_buttons

Transcript

1. INTERACTIONS IN PARALLEL WORLDS WITH ANDROID Wajdi Ben Rabah www.wajdibr.com/ @WajdiBenRabah
3. #appbuilders17
4. Plan ⬡Android as an OS ⬡Parallel realities ? ⬡Application area ⬡Interactions in parallel dimensions ⬡Live coding ⬡What’s coming next
5. Android ⬡Linux based OS. ⬡Open source. ⬡Android TV, Android Auto, Android Wear. ⬡Android Nougat 7.1 1/25
6. Android 2/25
7. Parallel realities 3/25
8. Virtual Reality ⬡Artificial environment, presented as reality alternative. ⬡Experienced senses: ⬡Hearing. ⬡Sight. 4/25
9. Headsets 5/25
10. Google Daydream ⬡New Google platform for virtual reality. ⬡Sensors ⬡Screen resolutions QHD 1440p + OLED ⬡Android N. ⬡CPU (snapdragon 820) +GPU+RAM ⬡60fps stereoscopic. 6/25
11. Application areas ⬡Health ⬡Entertainment ⬡automobile ⬡Ads ⬡Education ⬡Tourism ⬡Space / Military 7/25
12. Augmented reality ⬡A way of fusing the real and the virtual world by overlaying digital data on to real-world analogue views. ⬡Anyone with a mobile phone or laptop with built-in video capability can augment and extend their reality with easy-to-use applications. 8/25
13. Application areas ⬡Games ⬡Marketing ⬡Fashion ⬡Social media ⬡Health ⬡Tourism ⬡Industry (cars, boats …) ⬡Press ⬡Ads 9/25
14. Application areas 10/25
15. Marker-based VS Location-based 11/25
16. VR or AR ? ⬡AR: ⬡Combine the real world and virtual data in real time. ⬡Be interactive in real world. ⬡Using a 3D environment. ⬡VR: ⬡Alternative to the real world. ⬡Creation of content. 12/25
17. VR and AR tinker with our reality — but AR enhances it, while VR diverts us from it. 13/25
18. Interact in the parallel dimension 14/25
19. Daydream controller 15/25
20. Eyes tracking / Gaze input 16/25
21. Virtual buttons 17/25
22. Requirements ⬡Android smartphone (Android Nougat as a min version). ⬡Daydream SDK. ⬡Android SDK. ⬡Unity 3D / Android Studio 1.0 and above. 18/25
23. Android <manifest ... <uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" /> ... <uses-sdk android:minSdkVersion="19" android:targetSdkVersion="25"/> ... <uses-feature android:glEsVersion="0x00020000" android:required="true" /> <uses-feature android:name="android.software.vr.mode" android:required="false"/> <uses-feature android:name="android.software.vr.high_performance" android:required="false"/> ... 19/25
24. Android <application ... <activity android:name=".TreasureHuntActivity" android:screenOrientation="landscape" android:configChanges="orientation|keyboardHidden|screenSize" android:enableVrMode="@string/gvr_vr_mode_component" android:theme="@style/VrActivityTheme" android:resizeableActivity="false"> ... <intent-filter> <action android:name="android.intent.action.MAIN" /> <category android:name="android.intent.category.LAUNCHER" /> <category android:name="com.google.intent.category.CARDBOARD" /> <category android:name="com.google.intent.category.DAYDREAM" /> </intent-filter> </activity> 20/25
25. Unity3D ⬡Unity is a platform for creating experiences in 2D and 3D. ⬡SDK : simplify the creation of a VR/AR experience. 21/25
26. Google Design Lab 22/25
27. Demo 23/25
28. Download the project 24/25 Interactions in virtual dimension Interactions in augmented dimension
29. Future of parallel worlds ⬡Lower price for devices. ⬡“VR/motion sickness” ⬡Tango project. ⬡Loneliness/Isolation. 25/25
30. References ⬡https://developer.vuforia.com ⬡https://developers.google.com/ ⬡http://www.vrs.org.uk/virtual-reality-games/future-expectations.html ⬡https://www.google.com/atap/project-tango/ ⬡http://answers.unity3d.com/ ⬡https://www.assetstore.unity3d.com ⬡http://www.augment.com/
31. Thank you ! @WajdiBenRabah