HoloLens Mixed Reality for Fun and Profit

What innovations are the current generation of mixed reality devices capable of providing? Lets explore what a commercial augmented reality solution might look like using the Microsoft HoloLens and how you can get started building real business solutions.

Transcript

1. HoloLens Mixed Reality @GainesK
   Gaines Kergosien
   

   View Slide

2. HoloLens Mixed Reality @GainesK
   • Organizers are AMAZING!
   –Seize growth opportunities
   • Thank the sponsors
   • Join us in Nashville, TN
   –May 31st – June 2nd
   –Code, Agile & Data
   –We have stickers!
   THANKS!
   

   View Slide

3. HoloLens Mixed Reality @GainesK
   

   View Slide

4. HoloLens Mixed Reality @GainesK
   The Dream of Virtual Reality – 1935
   

   View Slide

5. HoloLens Mixed Reality @GainesK
   The Dream of Virtual Reality – 1962
   

   View Slide

6. HoloLens Mixed Reality @GainesK
   The Dream of Virtual Reality – 1989
   

   View Slide

7. HoloLens Mixed Reality @GainesK
   The Realization of Augmented Reality – 2013
   

   View Slide

8. HoloLens Mixed Reality @GainesK
   The Future of Mixed Reality Holograms
   

   View Slide

9. HoloLens Mixed Reality @GainesK
   The Rise of Mixed Reality – 2016
   

   View Slide

10. HoloLens Mixed Reality @GainesK
    The Hype Cycle
    

    View Slide

11. HoloLens Mixed Reality @GainesK
    • Originally created by Kenny W (@Kennywdev)
    https://github.com/KennyWdev/PortalHoloLens/
    The Demonstration – QL Portal
    

    View Slide

12. HoloLens Mixed Reality @GainesK
    The Usage – Contextual Information
    

    View Slide

13. HoloLens Mixed Reality @GainesK
    The Usage – Contextual Information
    

    View Slide

14. HoloLens Mixed Reality @GainesK
    The Usage – 3D Objects
    

    View Slide

15. HoloLens Mixed Reality @GainesK
    The Usage – Spatially Aware Holograms
    

    View Slide

16. HoloLens Mixed Reality @GainesK
    The Usage – Space Transformation
    

    View Slide

17. HoloLens Mixed Reality @GainesK
    The Usage – Collaboration
    

    View Slide

18. HoloLens Mixed Reality @GainesK
    The Usage – Assistive Technology
    

    View Slide

19. HoloLens Mixed Reality @GainesK
    The Usage – Physical Tasks
    

    View Slide

20. HoloLens Mixed Reality @GainesK
    The Usage – Physical Tasks
    

    View Slide

21. HoloLens Mixed Reality @GainesK
    The Usage – Kitchen Remodeling
    

    View Slide

22. HoloLens Mixed Reality @GainesK
    The Usage – Intelligent Sales & Marketing
    

    View Slide

23. HoloLens Mixed Reality @GainesK
    The Usage – Analytics
    

    View Slide

24. HoloLens Mixed Reality @GainesK
    The Usage – Real-Time Analytics
    

    View Slide

25. HoloLens Mixed Reality @GainesK
    The HoloLens Hardware
    

    View Slide

26. HoloLens Mixed Reality @GainesK
    The HoloLens Hardware
    

    View Slide

27. HoloLens Mixed Reality @GainesK
    The HoloLens Hardware – Gaze
    30°×17.5° Field of View
    Internal Measurement Unit
    • Accelerometer
    • Gyroscope
    • Magnetometer
    • (4) Env. Understanding
    

    View Slide

28. HoloLens Mixed Reality @GainesK
    The HoloLens Hardware – Gesture
    120°×120° Depth Camera
    2.4 Megapixel Video Camera
    (4) Environment Cameras
    (4) Microphone Array
    Ambient Light Sensor
    

    View Slide

29. HoloLens Mixed Reality @GainesK
    The HoloLens Hardware – Voice
    Spatial Sound
    Voice Commands
    

    View Slide

30. HoloLens Mixed Reality @GainesK
    The HoloLens Clicker
    802.11ac Wifi
    Bluetooth 4.1 LE
    

    View Slide

31. HoloLens Mixed Reality @GainesK
    The HoloLens Wand?
    

    View Slide

32. HoloLens Mixed Reality @GainesK
    The HoloLens Headband
    

    View Slide

33. HoloLens Mixed Reality @GainesK
    The HoloLens Headband
    

    View Slide

34. HoloLens Mixed Reality @GainesK
    • C++ & Direct3D
    • C# & DirectX
    • Unity 3D
    The Development Options
    

    View Slide

35. HoloLens Mixed Reality @GainesK
    1. Unity 3D
    http://unity3d.com
    Install Universal Windows Platform (UWP) Build
    2. Visual Studio (2015 with update 3 or VS2017*)
    http://www.visualstudio.com/downloads
    3. HoloLens Emulator (optional)
    http://go.microsoft.com/fwlink/?LinkID=823018
    Not compatible with Windows 10 Home
    The Unity Development Stack Environment
    

    View Slide

36. HoloLens Mixed Reality @GainesK
    • Input
    • Sharing
    • Spatial Mapping
    • Spatial Sound
    • Spatial
    Understanding
    • UX Controls
    • Boundary
    • Build
    • Utilities
    The Mixed Reality Toolkit for Unity
    Be
    Features:
    

    View Slide

37. HoloLens Mixed Reality @GainesK
    • Fall Creators Update
    • Windows 10 SDK
    The Mixed Reality Toolkit for Unity
    Be
    Requirements:
    

    View Slide

38. HoloLens Mixed Reality @GainesK
    Unity 3D
    http://unity3d.com
    • Setup includes Visual Studio
    • Build Settings has UWP Button
    The Dev Environment Setup – Unity 3D
    

    View Slide

39. HoloLens Mixed Reality @GainesK
    • VS120COMNTOOLS = C:\Program Files
    (x86)\Microsoft Visual Studio 12.0\Common7\Tools\
    • VS140COMNTOOLS = C:\Program Files
    (x86)\Microsoft Visual Studio 14.0\Common7\Tools\
    The Dev Environment Setup – Env Variables
    

    View Slide

40. HoloLens Mixed Reality @GainesK
    The Dev Environment Setup – UWP for VS
    

    View Slide

41. HoloLens Mixed Reality @GainesK
    The Dev Environment Setup – Target Framework
    

    View Slide

42. HoloLens Mixed Reality @GainesK
    The Unity Development
    

    View Slide

43. HoloLens Mixed Reality @GainesK
    The Visual Studio Development
    

    View Slide

44. HoloLens Mixed Reality @GainesK
    • Platform = x86
    • Debug on
    –Simulator
    –Remote Machine (wifi)
    –Device (USB)
    • Create App Package (sideload)
    The Debugging
    

    View Slide

45. HoloLens Mixed Reality @GainesK
    Setup
    • Enable Developer Mode
    • Connect via Browser (IP) or App
    The Device Portal
    

    View Slide

46. HoloLens Mixed Reality @GainesK
    Features
    • Mixed Reality Capture
    • Spatial Mapping
    • Device Management
    The Device Portal
    

    View Slide

47. HoloLens Mixed Reality @GainesK
    • Google Tango
    • iOS 11 introduced ARKit
    The Alternatives – Mixed Reality Platforms
    

    View Slide

48. HoloLens Mixed Reality @GainesK
    • Acer ($299)
    • Asus
    • Dell ($349)
    • Lenovo ($349)
    • HP ($450)
    • 3 Glasses
    The Alternatives – New Windows MR Headsets
    

    View Slide

49. HoloLens Mixed Reality @GainesK
    Windows Mixed Reality “Core” PCs
    • integrated graphics support 60Hz
    Windows Mixed Reality “Ultra” PCs
    • discrete graphics support 90Hz
    The Desktop
    

    View Slide

50. HoloLens Mixed Reality @GainesK
    • HoloLens Academy and Resources Moved
    Previously “Windows Holographic”
    • http://developer.microsoft.com/en-us/windows/mixed-reality
    • Mixed Reality Toolkit for Unity
    Previously called the HoloToolkit
    http://github.com/Microsoft/HoloToolkit-Unity
    • HoloDevelopers Slack
    http://holodevelopersslack.azurewebsites.net
    The Useful Links
    

    View Slide

51. HoloLens Mixed Reality @GainesK
    The Spectator View
    

    View Slide

52. HoloLens Mixed Reality @GainesK
    @GAINESK
    Gaines Kergosien
    gaines@kergosien.net
    Slides and notes at
    speaking.dotnetdude.net
    Attendee Party @ 5:30pm!
    

    View Slide

53. HoloLens Mixed Reality @GainesK
    @GAINESK
    Bloom Gesture
    Opens the start menu.
    Used to launch and
    exit applications.
    The HoloLens is a stand-alone device and
    is only tethered to provide higher quality
    live view and to extend the battery life for
    demonstration purposes.
    Slides at hololens.kergosien.net
    Air Tap Gesture
    “Clicks” the center of
    gesture frame.
    Similar to left-click.
    

    View Slide