Upgrade to Pro — share decks privately, control downloads, hide ads and more …

HoloLens Mixed Reality for Fun and Profit

HoloLens Mixed Reality for Fun and Profit

What innovations are the current generation of mixed reality devices capable of providing? Lets explore what a commercial augmented reality solution might look like using the Microsoft HoloLens and how you can get started building real business solutions.

99302b39c43015983665d69397695734?s=128

Gaines Kergosien

July 12, 2017
Tweet

Transcript

  1. HoloLens Mixed Reality @GainesK Gaines Kergosien

  2. HoloLens Mixed Reality @GainesK • Organizers are AMAZING! –Seize growth

    opportunities • Thank the sponsors • Join us in Nashville, TN –May 31st – June 2nd –Code, Agile & Data –We have stickers! THANKS!
  3. HoloLens Mixed Reality @GainesK

  4. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality –

    1935
  5. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality –

    1962
  6. HoloLens Mixed Reality @GainesK The Dream of Virtual Reality –

    1989
  7. HoloLens Mixed Reality @GainesK The Realization of Augmented Reality –

    2013
  8. HoloLens Mixed Reality @GainesK The Future of Mixed Reality Holograms

  9. HoloLens Mixed Reality @GainesK The Rise of Mixed Reality –

    2016
  10. HoloLens Mixed Reality @GainesK The Hype Cycle

  11. HoloLens Mixed Reality @GainesK • Originally created by Kenny W

    (@Kennywdev) https://github.com/KennyWdev/PortalHoloLens/ The Demonstration – QL Portal
  12. HoloLens Mixed Reality @GainesK The Usage – Contextual Information

  13. HoloLens Mixed Reality @GainesK The Usage – Contextual Information

  14. HoloLens Mixed Reality @GainesK The Usage – 3D Objects

  15. HoloLens Mixed Reality @GainesK The Usage – Spatially Aware Holograms

  16. HoloLens Mixed Reality @GainesK The Usage – Space Transformation

  17. HoloLens Mixed Reality @GainesK The Usage – Collaboration

  18. HoloLens Mixed Reality @GainesK The Usage – Assistive Technology

  19. HoloLens Mixed Reality @GainesK The Usage – Physical Tasks

  20. HoloLens Mixed Reality @GainesK The Usage – Physical Tasks

  21. HoloLens Mixed Reality @GainesK The Usage – Kitchen Remodeling

  22. HoloLens Mixed Reality @GainesK The Usage – Intelligent Sales &

    Marketing
  23. HoloLens Mixed Reality @GainesK The Usage – Analytics

  24. HoloLens Mixed Reality @GainesK The Usage – Real-Time Analytics

  25. HoloLens Mixed Reality @GainesK The HoloLens Hardware

  26. HoloLens Mixed Reality @GainesK The HoloLens Hardware

  27. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Gaze 30°×17.5°

    Field of View Internal Measurement Unit • Accelerometer • Gyroscope • Magnetometer • (4) Env. Understanding
  28. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Gesture 120°×120°

    Depth Camera 2.4 Megapixel Video Camera (4) Environment Cameras (4) Microphone Array Ambient Light Sensor
  29. HoloLens Mixed Reality @GainesK The HoloLens Hardware – Voice Spatial

    Sound Voice Commands
  30. HoloLens Mixed Reality @GainesK The HoloLens Clicker 802.11ac Wifi Bluetooth

    4.1 LE
  31. HoloLens Mixed Reality @GainesK The HoloLens Wand?

  32. HoloLens Mixed Reality @GainesK The HoloLens Headband

  33. HoloLens Mixed Reality @GainesK The HoloLens Headband

  34. HoloLens Mixed Reality @GainesK • C++ & Direct3D • C#

    & DirectX • Unity 3D The Development Options
  35. HoloLens Mixed Reality @GainesK 1. Unity 3D http://unity3d.com Install Universal

    Windows Platform (UWP) Build 2. Visual Studio (2015 with update 3 or VS2017*) http://www.visualstudio.com/downloads 3. HoloLens Emulator (optional) http://go.microsoft.com/fwlink/?LinkID=823018 Not compatible with Windows 10 Home The Unity Development Stack Environment
  36. HoloLens Mixed Reality @GainesK • Input • Sharing • Spatial

    Mapping • Spatial Sound • Spatial Understanding • UX Controls • Boundary • Build • Utilities The Mixed Reality Toolkit for Unity Be Features:
  37. HoloLens Mixed Reality @GainesK • Fall Creators Update • Windows

    10 SDK The Mixed Reality Toolkit for Unity Be Requirements:
  38. HoloLens Mixed Reality @GainesK Unity 3D http://unity3d.com • Setup includes

    Visual Studio • Build Settings has UWP Button The Dev Environment Setup – Unity 3D
  39. HoloLens Mixed Reality @GainesK • VS120COMNTOOLS = C:\Program Files (x86)\Microsoft

    Visual Studio 12.0\Common7\Tools\ • VS140COMNTOOLS = C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\Tools\ The Dev Environment Setup – Env Variables
  40. HoloLens Mixed Reality @GainesK The Dev Environment Setup – UWP

    for VS
  41. HoloLens Mixed Reality @GainesK The Dev Environment Setup – Target

    Framework
  42. HoloLens Mixed Reality @GainesK The Unity Development

  43. HoloLens Mixed Reality @GainesK The Visual Studio Development

  44. HoloLens Mixed Reality @GainesK • Platform = x86 • Debug

    on –Simulator –Remote Machine (wifi) –Device (USB) • Create App Package (sideload) The Debugging
  45. HoloLens Mixed Reality @GainesK Setup • Enable Developer Mode •

    Connect via Browser (IP) or App The Device Portal
  46. HoloLens Mixed Reality @GainesK Features • Mixed Reality Capture •

    Spatial Mapping • Device Management The Device Portal
  47. HoloLens Mixed Reality @GainesK • Google Tango • iOS 11

    introduced ARKit The Alternatives – Mixed Reality Platforms
  48. HoloLens Mixed Reality @GainesK • Acer ($299) • Asus •

    Dell ($349) • Lenovo ($349) • HP ($450) • 3 Glasses The Alternatives – New Windows MR Headsets
  49. HoloLens Mixed Reality @GainesK Windows Mixed Reality “Core” PCs •

    integrated graphics support 60Hz Windows Mixed Reality “Ultra” PCs • discrete graphics support 90Hz The Desktop
  50. HoloLens Mixed Reality @GainesK • HoloLens Academy and Resources Moved

    Previously “Windows Holographic” • http://developer.microsoft.com/en-us/windows/mixed-reality • Mixed Reality Toolkit for Unity Previously called the HoloToolkit http://github.com/Microsoft/HoloToolkit-Unity • HoloDevelopers Slack http://holodevelopersslack.azurewebsites.net The Useful Links
  51. HoloLens Mixed Reality @GainesK The Spectator View

  52. HoloLens Mixed Reality @GainesK @GAINESK Gaines Kergosien gaines@kergosien.net Slides and

    notes at speaking.dotnetdude.net Attendee Party @ 5:30pm!
  53. HoloLens Mixed Reality @GainesK @GAINESK Bloom Gesture Opens the start

    menu. Used to launch and exit applications. The HoloLens is a stand-alone device and is only tethered to provide higher quality live view and to extend the battery life for demonstration purposes. Slides at hololens.kergosien.net Air Tap Gesture “Clicks” the center of gesture frame. Similar to left-click.