StereoKit: The Open Source SDK for VR/MR

Transcript

1. StereoKit: The Open Source SDK for VR/MR

2. @adoranwodo

3. Hi, I’m Adora! Software Engineer, Microsoft Mixed Reality Tech Content

   Creator, AdoraHack Advisory Board, VRARA Nigeria Co-Founder, unStack Twitter @adoranwodo

4. @adoranwodo

5. StereoKit is designed to solve issues that occur when using

   a game engine to create a Mixed Reality application or tool. Game engines are one of the few places you can currently go to get rendering functionality out of the box, but they lack features that would really streamline MR application development. @adoranwodo

6. StereoKit uses an immediate mode UI system. Since very little

   state is stored, you can add, remove and update your UI elements by writing code. You get to keep track of your data yourself. YOU’RE IN CONTROL . @adoranwodo

7. STEREOKIT FEATURES @adoranwodo

8. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

   Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

9. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

   Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

10. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

11. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

12. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

13. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

14. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

15. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

16. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

17. STEREOKIT FEATURES: • Platforms: HoloLens 2, Windows Mixed Reality, Oculus

    Desktop, SteamVR, eventually everywhere OpenXR is! • Builds your application in seconds, not minutes • Input: articulated hands, pointers, keyboard/mouse • Easy and powerful UI and interactions • Model formats: .gltf, .glb, .fbx(partial), .obj, .stl, procedural • Texture formats: .jpg, .png, .tga, .bmp, .psd, .gif, .hdr, .pic, equirectangular cubemap, procedural • Runtime asset loading • Physics • Performance-by-default render pipeline • Flexible shader/material system @adoranwodo

18. GETTING STARTED @adoranwodo

19. THINGS YOU NEED. • Visual Studio 2019 • An OpenXR

    runtime • StereoKit Visual Studio Template (or NuGet Package). • Enable developer mode for UWP/HoloLens builds @adoranwodo

20. @adoranwodo

21. TEMPLATE CODE: using StereoKit; class Program { static void Main(string[]

    args) { StereoKitApp.Initialize("StereoKitMinimum"); while (StereoKitApp.Step(() => { Default.MeshSphere.Draw(Default.Material, Matrix.Identity); })); StereoKitApp.Shutdown(); } } @adoranwodo

22. MAKING A UI WINDOW @adoranwodo

23. Pose windowPose = new Pose(-.4f, 0, 0, Quat.LookDir(1,0,1)); bool showHeader

    = true; float slider = 0.5f; Sprite powerSprite = Sprite.FromFile("power.png", SpriteType.Single); @adoranwodo

24. REST OF THE UI CODE. // Begin Window UI.WindowBegin("Window", ref

    windowPose, new Vec2(20, 0) * U.cm, showHeader?UIWin.Normal:UIWin.Body); @adoranwodo

25. REST OF THE UI CODE. // Begin Window UI.WindowBegin("Window", ref

    windowPose, new Vec2(20, 0) * U.cm, showHeader?UIWin.Normal:UIWin.Body); // Toggle Button UI.Toggle("Show Header", ref showHeader); @adoranwodo

26. REST OF THE UI CODE. // Begin Window UI.WindowBegin("Window", ref

    windowPose, new Vec2(20, 0) * U.cm, showHeader?UIWin.Normal:UIWin.Body); // Toggle Button UI.Toggle("Show Header", ref showHeader); // Slider UI.Label("Slide"); UI.SameLine(); UI.HSlider("slider", ref slider, 0, 1, 0.2f, 72 * U.mm); @adoranwodo

27. REST OF THE UI CODE. // Begin Window UI.WindowBegin("Window", ref

    windowPose, new Vec2(20, 0) * U.cm, showHeader?UIWin.Normal:UIWin.Body); // Toggle Button UI.Toggle("Show Header", ref showHeader); // Slider UI.Label("Slide"); UI.SameLine(); UI.HSlider("slider", ref slider, 0, 1, 0.2f, 72 * U.mm); // Button if (UI.ButtonRound("Exit", powerSprite)) StereoKitApp.Quit(); @adoranwodo

28. REST OF THE UI CODE. // Begin Window UI.WindowBegin("Window", ref

    windowPose, new Vec2(20, 0) * U.cm, showHeader?UIWin.Normal:UIWin.Body); // Toggle Button UI.Toggle("Show Header", ref showHeader); // Slider UI.Label("Slide"); UI.SameLine(); UI.HSlider("slider", ref slider, 0, 1, 0.2f, 72 * U.mm); // Button if (UI.ButtonRound("Exit", powerSprite)) StereoKitApp.Quit(); // End Window UI.WindowEnd(); @adoranwodo

29. LEARN MORE ABOUT STEREOKIT @adoranwodo

30. https://github.com/maluoi/StereoKit-BingMaps https://github.com/maluoi/StereoKit-PaintTutorial @adoranwodo

31. OTHER LINKS: • StereoKit Official Website https://stereokit.net/ • StereoKit Official

    Source Code https://github.com/maluoi/StereoKit/ • Sample Demos https://github.com/maluoi/StereoKit/tree/master/Examples/StereoKitTest/Demos @adoranwodo

32. MR <3 Open Source CAN WE DO MORE? @adoranwodo

33. Thank you! www.adoranwodo.com @adoranwodo