ARCore is magic

ARCore is the Google library that allows to build new augmented reality experiences that seamlessly blend the digital and physical worlds. We will see all the features supported by ARCore through the development of a "Magic" App

Transcript

1. Mike Trizio DevFest Milan 2018 @mik3lantoni0
2. About me GDG Bari community lead Computer Science Engineer CTO @ Wideverse Android Developers Italy Member
3. Questions Y787
4. Immersive computing spectrum Real World Computer-generated Real reality Augmented reality Virtual reality
5. 5 Intro Augmented Reality AR can bring anything to you. It adds computer-generated information and objects to your everyday world.
6. AR can be useful Image Intro
7. AR can be fun Intro
8. classic Vs Mixed Intro
9. Luke, I’m your father A long time ago... !!!!!!!!!!!!!!!!!!!!!
11. ARCore Overview
12. 12 Who can run ARCore Applications Proprietary and Confidential ARCore is compatible with 100+ million devices (and growing!) ARCore Overview Supported in China too!
13. ARCore Android Capabilities Motion Tracking Environmental Understanding Light Estimation ARCore Overview
14. 14 Motion Tracking Proprietary and Confidential As your mobile device moves through the world, ARCore combines visual data from the device’s camera and IMU to compute the position and orientation of the phone. Image ARCore Overview
15. 15 Environment Understanding Proprietary and Confidential ARCore understands the physical structure of the environment, detecting horizontal surfaces, like tables and desks, and makes these surfaces available to your app as planes. Image ARCore Overview
16. 16 Lighting Estimation Proprietary and Confidential ARCore can detect information about the lighting of its environment so you can render your virtual objects under the same conditions as the environment around them. Image ARCore Overview
17. Oriented points Oriented points lets you place virtual objects on angled surfaces. Image ARCore Overview
18. Augmented Images You’ve wanted to have the ability to trigger AR experiences off of real-world images Image ARCore Overview
20. Augmented images use cases Proprietary and Confidential
21. Use Cases Proprietary and Confidential Advertising Products Education
22. Use Cases Proprietary and Confidential Advertising Products Education
23. Use Cases Proprietary and Confidential Advertising Products Education
24. Cloud anchors ARCore's Cloud Anchors API lets you create collaborative or multiplayer apps Image ARCore Overview
26. 26 Proprietary and Confidential Cloud Anchors are Cross Platform
27. Cloud anchors use cases Proprietary and Confidential
28. Use Cases Gaming Shopping Creative Expression Education
29. Use Cases Gaming Shopping Creative Expression Education
30. Use Cases Gaming Shopping Creative Expression Education
31. Gaming Shopping Creative Expression Use cases Education
32. Developing Magic Broom
34. My design skill
35. Poly & Sketchfab
36. Unity
37. Anatomy of an app ➔ ARCore Device ➔ Environmental Light ➔ Plane Detector ➔ Plane Visualizer ➔ Our custom Controller ➔ Event system ➔ 2D Canvas ➔ Buttons
38. Session if (Session.Status != SessionStatus.Tracking) { const int lostTrackingSleepTimeout = 15; Screen.sleepTimeout = lostTrackingSleepTimeout; } else { Screen.sleepTimeout = SleepTimeout.NeverSleep; }
39. Plane Session.GetTrackables<DetectedPlane>(m_NewPlanes, TrackableQueryFilter.New); for (int i = 0; i < m_NewPlanes.Count; i++) { GameObject planeObject = Instantiate(DetectedPlanePrefab, Vector3.zero, Quaternion.identity, transform); planeObject.GetComponent<DetectedPlaneVisualizer>().Initialize(m_NewPlanes[i]); }
40. Plane visualization
41. Raycast TrackableHit hit; TrackableHitFlags raycastFilter = TrackableHitFlags.PlaneWithinPolygon | TrackableHitFlags.FeaturePointWithSurfaceNormal; if (Frame.Raycast(touch.position.x, touch.position.y, raycastFilter, out hit)) { ... }
42. GameObject Instance GameObject magicBroom = Instantiate(magicBroomPrefab, hit.Pose.position, hit.Pose.rotation);
43. Anchor a GameObject wellObject.transform.SetPositionAndRotation(hit.Pose.position, hit.Pose.rotation); var anchor = hit.Trackable.CreateAnchor(hit.Pose); wellObject.transform.parent = anchor.transform;
44. Putting objects into the scene
45. Light Estimation float lightValue = Shader.GetGlobalFloat("_GlobalLightEstimation"); if (lightValue < 0.4) light.intensity = 1; else light.intensity = 0;
47. What’s next? 15.40 Introduction to SceneForm (Aula U6-6-6) developers.google.com/ar github.com/google-ar stackoverflow.com/questions/tagged/arcore
48. Questions & feedback Thank you! Rate this talk please http://bit.ly/2O5ljlz Follow me @mik3lantoni0
49. Enjoy ARCore Image Conclusion