HoloLens Mixed Reality for Fun and Profit

What innovations are the current generation of mixed reality devices capable of providing? Lets explore what a commercial augmented reality solution might look like using the Microsoft HoloLens and how you can get started building real business solutions.

Transcript

1. HoloLens Mixed Reality @GainesK Gaines Kergosien
2. HoloLens Mixed Reality @GainesK • Organizers are AMAZING! –Seize growth opportunities • Thank the sponsors • Join us in Nashville, TN –May 31st – June 2nd –Code, Agile & Data –We have stickers! THANKS!
3. HoloLens Mixed Reality @GainesK
4. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality – 1935
5. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality – 1962
6. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality – 1989
7. HoloLens Mixed Reality @GainesK The Realization of Augmented Reality – 2013
8. HoloLens Mixed Reality @GainesK The Future of Mixed Reality Holograms
9. HoloLens Mixed Reality @GainesK The Rise of Mixed Reality – 2016
10. HoloLens Mixed Reality @GainesK The Hype Cycle
11. HoloLens Mixed Reality @GainesK • Originally created by Kenny W (@Kennywdev) https://github.com/KennyWdev/PortalHoloLens/ The Demonstration – QL Portal
12. HoloLens Mixed Reality @GainesK The Usage – Contextual Information
13. HoloLens Mixed Reality @GainesK The Usage – Contextual Information
14. HoloLens Mixed Reality @GainesK The Usage – 3D Objects
15. HoloLens Mixed Reality @GainesK The Usage – Spatially Aware Holograms
16. HoloLens Mixed Reality @GainesK The Usage – Space Transformation
17. HoloLens Mixed Reality @GainesK The Usage – Collaboration
18. HoloLens Mixed Reality @GainesK The Usage – Assistive Technology
19. HoloLens Mixed Reality @GainesK The Usage – Physical Tasks
20. HoloLens Mixed Reality @GainesK The Usage – Physical Tasks
21. HoloLens Mixed Reality @GainesK The Usage – Kitchen Remodeling
22. HoloLens Mixed Reality @GainesK The Usage – Intelligent Sales & Marketing
23. HoloLens Mixed Reality @GainesK The Usage – Analytics
24. HoloLens Mixed Reality @GainesK The Usage – Real-Time Analytics
25. HoloLens Mixed Reality @GainesK The HoloLens Hardware
26. HoloLens Mixed Reality @GainesK The HoloLens Hardware
27. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Gaze 30°×17.5° Field of View Internal Measurement Unit • Accelerometer • Gyroscope • Magnetometer • (4) Env. Understanding
28. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Gesture 120°×120° Depth Camera 2.4 Megapixel Video Camera (4) Environment Cameras (4) Microphone Array Ambient Light Sensor
29. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Voice Spatial Sound Voice Commands
30. HoloLens Mixed Reality @GainesK The HoloLens Clicker 802.11ac Wifi Bluetooth 4.1 LE
31. HoloLens Mixed Reality @GainesK The HoloLens Wand?
32. HoloLens Mixed Reality @GainesK The HoloLens Headband
33. HoloLens Mixed Reality @GainesK The HoloLens Headband
34. HoloLens Mixed Reality @GainesK • C++ & Direct3D • C# & DirectX • Unity 3D The Development Options
35. HoloLens Mixed Reality @GainesK 1. Unity 3D http://unity3d.com Install Universal Windows Platform (UWP) Build 2. Visual Studio (2015 with update 3 or VS2017*) http://www.visualstudio.com/downloads 3. HoloLens Emulator (optional) http://go.microsoft.com/fwlink/?LinkID=823018 Not compatible with Windows 10 Home The Unity Development Stack Environment
36. HoloLens Mixed Reality @GainesK • Input • Sharing • Spatial Mapping • Spatial Sound • Spatial Understanding • UX Controls • Boundary • Build • Utilities The Mixed Reality Toolkit for Unity Be Features:
37. HoloLens Mixed Reality @GainesK • Fall Creators Update • Windows 10 SDK The Mixed Reality Toolkit for Unity Be Requirements:
38. HoloLens Mixed Reality @GainesK Unity 3D http://unity3d.com • Setup includes Visual Studio • Build Settings has UWP Button The Dev Environment Setup – Unity 3D
39. HoloLens Mixed Reality @GainesK • VS120COMNTOOLS = C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\ • VS140COMNTOOLS = C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\Tools\ The Dev Environment Setup – Env Variables
40. HoloLens Mixed Reality @GainesK The Dev Environment Setup – UWP for VS
41. HoloLens Mixed Reality @GainesK The Dev Environment Setup – Target Framework
42. HoloLens Mixed Reality @GainesK The Unity Development
43. HoloLens Mixed Reality @GainesK The Visual Studio Development
44. HoloLens Mixed Reality @GainesK • Platform = x86 • Debug on –Simulator –Remote Machine (wifi) –Device (USB) • Create App Package (sideload) The Debugging
45. HoloLens Mixed Reality @GainesK Setup • Enable Developer Mode • Connect via Browser (IP) or App The Device Portal
46. HoloLens Mixed Reality @GainesK Features • Mixed Reality Capture • Spatial Mapping • Device Management The Device Portal
47. HoloLens Mixed Reality @GainesK • Google Tango • iOS 11 introduced ARKit The Alternatives – Mixed Reality Platforms
48. HoloLens Mixed Reality @GainesK • Acer ($299) • Asus • Dell ($349) • Lenovo ($349) • HP ($450) • 3 Glasses The Alternatives – New Windows MR Headsets
49. HoloLens Mixed Reality @GainesK Windows Mixed Reality “Core” PCs • integrated graphics support 60Hz Windows Mixed Reality “Ultra” PCs • discrete graphics support 90Hz The Desktop
50. HoloLens Mixed Reality @GainesK • HoloLens Academy and Resources Moved Previously “Windows Holographic” • http://developer.microsoft.com/en-us/windows/mixed-reality • Mixed Reality Toolkit for Unity Previously called the HoloToolkit http://github.com/Microsoft/HoloToolkit-Unity • HoloDevelopers Slack http://holodevelopersslack.azurewebsites.net The Useful Links
51. HoloLens Mixed Reality @GainesK The Spectator View
52. HoloLens Mixed Reality @GainesK @GAINESK Gaines Kergosien gaines@kergosien.net Slides and notes at speaking.dotnetdude.net Attendee Party @ 5:30pm!
53. HoloLens Mixed Reality @GainesK @GAINESK Bloom Gesture Opens the start menu. Used to launch and exit applications. The HoloLens is a stand-alone device and is only tethered to provide higher quality live view and to extend the battery life for demonstration purposes. Slides at hololens.kergosien.net Air Tap Gesture “Clicks” the center of gesture frame. Similar to left-click.