Bringing Cable TV to Virtual Reality

Jack Zankowski and I walk through some design and technology challenges in building the Comcast X1 VR experience

Transcript

1. B R I N G I N G YO U R C A B L E T V TO V R J U N E 3 0 T H 2 0 1 6 • W I C T T E C H I T O U T
2. ARPIT MATHUR C O M C A S T I N N O VAT I O N L A B S JACK ZANKOWSKI C O M C A S T E X P E R I E N C E D E S I G N
3. WHAT DOES TV LOOK LIKE IN VR?
4. L E S S I M M E R S I V E M O R E A C C E S S I B L E M O B I L E G O O G L E C A R D B O A R D M O R E I M M E R S I V E L E S S A C C E S S I B L E H TC V I V E O C U L U S R I F T S A M S U N G G E A R
5. UNDERSTANDING GEAR VR
6. S A M S U N G G E A R C AT E G O R Y H T V V I V E O C U L U S R I F T S O N Y P S V R D I S P L AY 2 5 6 0 X 1 4 4 0 1 2 8 0 X 1 4 4 0 P E R E Y E S U P E R A M O L E D 2 1 6 0 X 1 2 0 0 1 0 8 0 X 1 2 0 0 P E R E Y E O L E D 2 5 6 0 X 1 2 0 0 1 0 8 0 X 1 2 0 0 P E R E Y E O L E D 1 9 2 0 X 1 0 8 0 9 6 0 X 1 0 8 0 P E R E Y E O L E D R E F R E S H R AT E 6 0 H Z 9 0 H Z 9 0 H Z 1 2 0 H Z , 9 0 H Z S E N S O R S A C C E L E R ATO R , G Y R O M E T E R , G E O M A G N E T I C , P R OX I M I T Y A C C E L E R O M E T E R , G Y R O S C O P E , M A G N E TO M E T E R , 3 6 0 º P O S I T I O N A L T R A C K I N G A C C E L E R O M E T E R , G Y R O S C O P E , L A S E R P O S I T I O N S E N S O R , F R O N T- FA C I N G C A M E R A 3 6 0 D E G R E E T R A C K I N G , 9 L E D S F I E L D O F V I E W 9 6 D E G R E E S 1 1 0 D E G R E E S 1 1 0 D E G R E E S 1 0 0 D E G R E E S
7. • Cannot rely on controllers, has to work with default gesture pad • Lower refresh rate = missed frames are extremely apparent • Not great at high poly models but can handle high res textures B E YO N D T H E S P E C S H E E T
8. WHAT THE COMPETITION LOOKS LIKE
12. • 3D Living Room background • Floating Mobile / TV Interface • Hide or fade content fold T V V R C H E C K L I S T
15. C H O O S I N G A 3 D E N G I N E
16. U N I T Y •0 - 125$ per dev per mo. • C#, JavaScript • Reasonable Performance • Very Popular
17. U N R E A L E N G I N E • Free / 5% Revenue over $3000 • C++ • Better Performance (Threads!) • BluePrints
18. A M A Z O N L U M B E R YA R D • Free • Spinoff of CryEngine • C++, Lua • Deeply integrated with Amazon Cloud Services and Twitch TV • Node editor
19. U N I T Y
20. BUILD DESIGN PROTOTYPE
21. D E V I G N E R S
22. DESIGN PROTOTYPE SCALE
26. TRAVERSING MASSIVE LIBRARIES
27. WIDER HORIZONTAL TOLERANCE
29. REMOVING THE SEAMS
31. 2D ASSETS ARE OK
32. FOREGROUND ELEMENT PANORAMA TITLE UI
35. H O W D O YO U M A N A G E I M A G E L O A D S ?
36. • Load a lot of images without using loaders or stuttering • No threads for parallel code execution T H E P R O B L E M
37. • Load images with multiple threads on the Android side • Convert to Texture and maintain texture cache • Load images into Unity app via JNI S O L U T I O N
38. WHAT DOES THE FUTURE LOOK LIKE?
39. T H I N G S W I L L B E L E S S … AW K WA R D
40. S TO R Y T E L L I N G W I L L C H A N G E
41. V R + A I / B OT S
42. V R AVATA R S A R E F O R E V E R ?
43. T H A N K S !