So you want to build an ARKit app - AppDevCon

Transcript

1. SO YOU WANT TO BUILD AN ARKIT APP NAMRATA BANDEKAR
2. ARKIT BY TUTORIALS
3. PORTAL ARSKETCH
4. AUGMENTED REALITY EXPERIENCE ▸ Detect and understand environment geometry ▸ Render virtual 3D content ▸ User guidance
5. ARKIT ▸ Tracking ▸ Scene Understanding ▸ Light Estimation
6. TRACKING ▸ World Tracking ▸ Visual Inertial Odometry CORE MOTION AVFOUNDATION
7. ARKIT ▸ Tracking ▸ Scene Understanding ▸ Light Estimation
8. SCENE UNDERSTANDING ▸ Plane detection ▸ Hit testing
9. ARKIT ▸ Tracking ▸ Scene Understanding ▸ Light Estimation
10. LIGHT ESTIMATION ▸ Estimate scene lighting information ▸ Render graphics that looks more realistic Video by Mark Dawson on Youtube
11. ARKIT ▸ Tracking ▸ Scene Understanding ▸ Light Estimation
12. SCENEKIT ▸ Rendering Engine ▸ 3D Content ▸ Provides basic AR view
13. GETTING STARTED ▸ Device Compatibility ▸ A9 processor or later ▸ iOS 11 and up ▸ Handle unsupported devices and iOS versions AR Optional AR Required
14. GETTING STARTED ▸ Device permissions
15. GETTING STARTED ▸ Privacy and data handling
16. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
17. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
18. AR CONFIGURATION
19. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
20. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
21. RUN OPTIONS
22. AR SESSION MANAGEMENT
23. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
24. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
25. SESSION ERROR HANDLING
26. ARKIT BASICS ▸ AR session configuration ▸ AR session management ▸ Session error handling
27. SCENEKIT FOR AR ▸ Provides ARSCNView ▸ Owns AR session object
28. SCENEKIT FOR AR ▸ Hit testing functionality
29. SCENEKIT FOR AR ⚠ Private Queue
30. BEST PRACTICES AND TIPS
31. USER GUIDANCE ▸ Guide the user ▸ Show feature points ▸ Display detected plane IKEA Place Portal
32. TRACKING ▸ ARWorldTrackingConfiguration ▸ ARAnchors fix position in real world ⚓ ▸ Don’t use feature points to place content ▸ ARAnchors adjust for drift
33. TRACKING QUALITY ▸ Ambient light ▸ Static environments ▸ Surface texture ▸ Sensor data quality
34. TRACKING QUALITY
35. TRACKING FEEDBACK
36. CAPTURING THE ARWORLDMAP ▸ Dense feature points ▸ Multiple points of view ▸ No motion - static environment ▸ Use WorldMappingStatus ▸ Don’t display UI until ready
37. MAPPING QUALITY
38. TESTING IN THE REAL WORLD ▸ Low lighting ▸ Smooth surfaces ▸ Moving device fast while mapping ▸ Motion in environment
39. PERFORMANCE CONSIDERATIONS ▸ Initialization takes some time ▸ Battery drain ▸ Limit the number of anchors ⚓ ▸ Delegate callbacks on background threads ▸ Mapping from a distance doesn’t work ▸ Occlusion - no depth sensing
40. THANK YOU! @NAMRATACODES