Google VR SDK 101

Describe how to use Google VR SDK to display 360 images and videos in 3 mins.

Transcript

1. Google VR SDK 101 Samuel Huang
2. Agenda 1. Support Platform / SDK 2. Requirement 3. Image / Video Format 4. Show 360 Image 5. Show 360 Video 2
3. Supported VR platform Cardboard Almost any smartphone on Android or iOS Daydream Pixel, Pixel XL, Galaxy S8, ZenFone AR, etc. Daydream ready phone 3
4. SDKs 1. Unity 2. Android/NDK 3. iOS 4. Unreal (game engine) 4
5. Requirements Hardware • Daydream: Daydream-ready phone and a Daydream View • Cardboard: Android device running Android 4.4 'KitKat' (API 19) or higher and a Cardboard viewer Software • Android Studio version 2.3.3 or higher • Android SDK 7.1.1 'Nougat' (API 25) or higher • Google VR SDK for Android version 1.80.0 or higher 5
6. Supported Formats 6
7. Image Specifications • png, jpeg, or gif. recommend use jpeg for improved compression. • Image dimensions should be powers of two (e.g. 2048 or 4096). • Mono images should be 2:1 aspect ratio (e.g. 4096 x 2048). • Stereo images should be 1:1 aspect ratio (e.g. 4096 x 4096). • Image need to be equirectangular format. 7
8. Equirectangular Projection 等距長方投影 Equirectangular projection - wiki 8
9. Video specifications • mp4s encoded with h264. • Mono videos should be 2:1 aspect ratio. • Stereo videos should be 1:1 aspect ratio. • For maximum compatibility and quality.Provide both a monoscopic 1920x1080 video and a stereo video at 2048x2048 or higher. 9
10. Capture a Panoramic Image 10
11. Image Conversion Tool Cardboard Camera Converter Convert to stereo 360 image. 11
12. How to Use def vrVersion = "1.80.0" dependencies { compile 'com.android.support:appcompat-v7:26.0.0' compile 'com.android.support:design:26.0.0' compile "com.google.vr:sdk-base:$vrVersion" compile "com.google.vr:sdk-audio:$vrVersion" compile "com.google.vr:sdk-common:$vrVersion" compile "com.google.vr:sdk-commonwidget:$vrVersion" compile "com.google.vr:sdk-panowidget:$vrVersion" compile "com.google.vr:sdk-videowidget:$vrVersion" } 12
13. VrPanoramaView Since the image is large we load it asynchronously. (AsyncTask, RxJava, etc.) Load image from: 1. asset 2. file system (png, jpeg, gif) 3. URL 4. anything can convert to Bitmap 13 vrPanoramaView.loadImageFromBitmap(bitmap, viewOptions);
14. VrPanoramaView.Options • TYPE_MONO single equirectangular panorama • TYPE_STEREO_OVER_UNDER two vertically-stacked equirectangular panoramaspanoramas 14 vrPanoramaView.loadImageFromBitmap(bitmap, viewOptions);
15. Panorama Demo 15
16. Cardboard Mode Demo 16
17. VrVideoView Load video form: 1. asset 2. file system (mp4, webm, ogg, aac.) 3. MPEG-DASH format (Dynamic Adaptive Streaming over HTTP wiki) 4. HTTP Live Streaming (HLS wiki) format (ts, m3u8) 17 vrVideoView.loadVideoFromAsset(filename, videoOptions); vrVideoView.loadVideo(uri, videoOptions);
18. VrVideoView.Options inputFormat • FORMAT_DEFAULT - In a standalone, non-streaming format using container formats such as mp4, webm, ogg, aac. • FORMAT_DASH - MPEG-DASH format. (a kind of adaptive bitrate streaming) • FORMAT_HLS - HTTP Live Streaming (HLS) format. inputType • TYPE_MONO - single equirectangular panorama. • TYPE_STEREO_OVER_UNDER - two vertically-stacked equirectangular panoramas. 18
19. Video Demo 19
20. View Lifecycle @Override public void onPause() { super.onPause(); panoWidgetView.pauseRendering(); videoWidgetView.pauseRendering(); } @Override public void onResume() { super.onResume(); panoWidgetView.resumeRendering(); videoWidgetView.resumeRendering(); } @Override public void onDestroy() { super.onDestroy(); panoWidgetView.shutdown(); videoWidgetView.shutdown(); } 20
21. Reference Google VR https://developers.google.com/vr Google VR for Android https://developers.google.com/vr/android VR View sample code https://developers.google.com/vr/android/samples/vrview googlevr/gvr-android-sdk https://github.com/googlevr/gvr-android-sdk Google Codelabs #vr https://codelabs.developers.google.com/?cat=Virtual+Reality 21
22. Q&A 22