The magic box: Google Cardboard

by Andrea Lucibello & Luca Piras
Talk at droidcon Italy 2015

Transcript

2. The magic box: Google Cardboard Introduction to Cardboard development and practical use with augmented reality Andrea Lucibello Android developer @ Synesthesia +AndreaLucibello @andreoid82 Luca Piras Android developer @ Synesthesia +LucaPiras0 @chivaspip
3. LET’S START!
4. Dispell some myths Can I do it?
5. NO
6. NO
7. YET NO
8. STILL NO
9. 2014 +DavidCozFTW +BorisSmus +ChristianPlagemann
10. Ivan Sutherland 1968 2014
12. Sword of Damocle The first experiment
13. I’m your father!
15. Virtual Reality From Wikipedia, the free encyclopedia
16. Immersion into virtual reality is a perception of being physically present in a non-physical world. “ ”
17. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment. “ ”
20. Cardboard Google Inc. - 26 febbraio 2015 Librerie e demo Install
22. Stereogram for Cardboard 2.0 David Quaid - December 6th 2014 Entertainment Install
23. Paul McCartney Jaunt Inc. - April 1st 2015 Entertainment Install
24. Renault VR para Cardboard DroidersLabs - March 5th 2015 Simulation Install
25. Mercedes VR for Cardboard VISUALISE - January 22nd 2015 Sport Install
30. Let’s look inside
32. Cardboard
33. Eyes
34. Eyes + Lens
36. PINCUSHION DISTORTION
38. GIROSCOPE & ACCELEROMETERS
39. MAGNET
40. TRIGGER
41. NFC [Back] PHONE MODE VR MODE
42. LET’S DIVE INTO CODE
43. SDK Chrome Android Unity
44. Android
45. Include Jars • download jars from: https://developers.google.com/cardboard/android/download • include jars in your project • make sure your build.gradle include the following lines dependencies { ... compile fileTree(dir: ‘libs’, include: [‘*.jar’]) }
46. Layout <?xml version=”1.0” encoding=”utf-8”?> <RelativeLayout xmlns:android=”http://schemas.android.com/apk/res/android” android:id=”@+id/ui_layout” android:layout_width=”match_parent” android:layout_height=”match_parent” > <com.google.vrtoolkit.cardboard.CardboardView android:id=”@+id/cardboard_view” android:layout_width=”match_parent” android:layout_height=”match_parent”/> </RelativeLayout>
47. Cardboard Activity public class MyActivity extends CardboardActivity { … … … @Override public void onCreate(Bundle savedInstanceState) { super.onCreate(savedInstanceState); setContentView(R.layout.common_ui); cardboardView = (CardboardView) findViewById(R.id.cardboard_view); cardboardView.setRenderer(new MyRender()); setCardboardView(cardboardView); }
48. Stereo Render public class MyRender implements CardboardView.StereoRender { … … … public void onNewFrame (HeadTransform headTransform); public void onDrawEye (Eye eye); public void onFinishFrame (Viewport viewport);
49. onNewFrame public void onNewFrame (HeadTransform headTransform); • called at the begginning of each new frame • gives us the HeadTransform which tracks the orientation of the device
50. onDrawEye public void onDrawEye (Eye eye); • It’s called 2 times for each frame (2 eyes) • Give us the eye to render, including the transformations to be applied.
51. onFinishFrame public void onFinishFrame (Viewport viewport); • Called before a frame is finished • Used to add additional overlay rendering over the frame results
52. Trigger & NFC public void onCardboardTrigger (); public void onInsertedIntoCardboard (); public void onRemovedFromCardboard ();
53. AUGMENTED REALITY
54. GEOLOCATION BASED AR
55. MARKER BASED AR
56. Frameworks
57. Vuforia
58. Cardria Synesthesia - April 10th 2015 Entertainment Install
60. • Google Nexus 5 • Google Nexus 4 • Samsung Galaxy S2 • Samsung Galaxy S4 • OnePlus One • HTC One (new edition) Supported devices Did you know?
61. Nexus 6: too large to fit in Cardboard. Samsung Galaxy S3: While the application works fine, the magnet did not. Apparently the magnometer sensor might be on the right side of the de- vice. SOLUTION: Detach and move the magnet to the right side of the head- set. Known Issues Did you know?
62. Samsung Galaxy S3, S4 Mini (and other small devices): Screen too small. User can see but- tons while looking through the len- ses. Samsung Galaxy Notes: Most Note devices were too large to fit in Cardboard. Known Issues Did you know?
63. Thanks for watching
64. Luca Piras Android developer @ Synesthesia +LucaPiras0 @chivaspip Andrea Lucibello Android developer @ Synesthesia +AndreaLucibello @andreoid82