Mobile AR 101 (GDG Kaliningrad)

Overview of VIO/SLAM and popular AR frameworks (ARKit, ARCore, Tango, Vuforia, etc).

Transcript

1. Mobile AR 101 @AlexKorovyansky
2. Evolution of Technologies
3. Revenues and ROIs
4. Mobile AR History By Example
5. 2010 iPhone 4 with Accelerometer & Gyroscope* * - First iPhone had Accelerometer only
6. Motion Sensors
9. v1 3-axis motion sensing (rotations: pitch, roll & yaw)
10. Visual Odometry RGB Camera Feature Points Processing Motion Tracking
11. SLAM (Simultaneous Localization and Mapping)
12. Lives on Mars since 2004!
13. Motion Sensors Tracking Visual Odometry Tracking Kalman Filter
14. v2 6-DoF Motion Tracking! Real-world Behavior...
15. SDKs Overview
16. Tango
17. Tango • AR with 6 DoF motion tracking ◦ Extend real world with virtual objects ◦ Interact with virtual objects ◦ 6 degrees of freedom for camera movement • Advanced SLAM features ◦ Detect arbitrary surfaces and shapes ◦ Build 3d map of environment ◦ Area Learning (save/restore AR layers) • Strict hardware requirements and low availability
18. https://youtu.be/MzLpoo-EZFE
19. ARKit
20. ARKit • AR with 6 DoF motion tracking ◦ Extend real world with virtual objects ◦ Interact with virtual objects • Horizontal surfaces detection • Light estimation • Lack of advanced SLAM features • Works on millions devices
21. Samples • https://github.com/handsomecode/arkit-shell-game • https://github.com/olucurious/awesome-arkit • https://twitter.com/MadeWithARKit
22. ARCore (24 hours ago)
23. ARCore • AR with 6 DoF motion tracking ◦ Extend real world with virtual objects ◦ Interact with virtual objects • Horizontal surfaces detection • Light estimation • Lack of advanced SLAM features • Works on millions devices
24. Samples • https://github.com/google-ar • https://experiments.withgoogle.com/ar • https://twitter.com/BuiltWithARCore
25. Facebook ARStudio
26. Vuforia, Kudan, and more
27. Microsoft HoloLens
28. Mobile AR 101 @AlexKorovyansky