Shared Augmented Reality Worlds with ARCore

This talk first quickly covers intro to Augmented Reality concept. Then covering current base ARCore capabilities. Then talk about rich 3D content and hard life adding this 3D content into apps. Then moving to possible solutions of 3D content problem - Unity, Unreal Engine, SceneForm (Demo). Finally, having rich 3D content in place talk will cover the ways how we can share 3D scenes for multiple users - demonstrating this with ARCore Cloud Anchors (Demo).
https://youtu.be/APNH9Amc2zk

Transcript

1. ARCore Shared 3D Worlds Sergii Kozyrev
2. What is Augmented Reality
4. Smartphone powered Augmented Reality
5. Technology under the hood
7. SLAM
8. As your device moves through the world, ARCore combines visual data from the device’s camera and IMU to compute the position and orientation of the phone. Motion Tracking
9. ARCore understands the physical structure of your environment, detecting horizontal and vertical surfaces, like tables, desks and walls, and makes these surfaces available for your app as planes. Environmental Understanding
10. ARCore can detect information about the lighting of its environment so you can render your virtual objects under the same conditions as the environment around them. Light Estimation
11. Session Pose Trackable Plane Anchor PointCloud ARCore API
12. How we solved the problem?
13. ARCore Java SDK ARCore Unity SDK Start requires Unity knowledge API exposed in C# Run or export to Android Project Rich 3d editing and scripting Physics engines Artist and Designer Tools Top Engine performance Graphics Rendering Cross Platform* Simple to start Convenient Java api Android Setup, Tests, CI etc. Little to zero 3d editing capabilities No Scene editing capabilities No 3d objects interaction No simple 3d object animations, transformations, shaders Runs in DalvikVM / ART
14. ARCore Java SDK development process
16. ARCore Unity SDK development process
18. Sceneform SDK
19. Sceneform SDK A high-level scene graph API A realistic physically based renderer An Android Studio plugin for importing, viewing, and building 3D assets + Google Poly support
20. ARCore Sceneform SDK development process
21. ViewRenderable.builder() .setView(this, R.layout.test_view) .build() .thenAccept(renderable -> testViewRenderable = renderable);
22. Share your AR world
23. Augmented Images Cloud Anchors
25. Augmented Images Image Database for 1000 images Up to 20 images simultaneously in a frame! PNG and JPEG formats, at least 300x300
27. Cloud Anchors CloudAnchor from any Anchor! Android, Unity and iOS! CloudAnchors expire in 24 hours.
28. Demo Cloud Anchors
29. Useful Links https://codelabs.developers.google.com/ https://en.coursera.org/learn/ar - course on Coursera https://github.com/kozyrevsergey89/devfest-arcore-cloud-anchors @kozyrevsergey89 sergii.kozyrev@gmail.com Demo APK: https://goo.gl/bHLttG Short Code: 672