Share
Embed
Transcript
45 slides
-
CHITARANJAN SAHU ARGMENTED REALITY ▸ The illusion of virtual object
in a real world ▸ Place virtual content to real world ▸ Relies on creating a virtual space on a fixed position ▸ Combines motion sensors with video capture -
CHITARANJAN SAHU AGENDA ‣ ARkit Basics ‣ ARkit 2.0 ‣
Demo ‣ References -
CHITARANJAN SAHU ARKIT ‣ Mobile AR platform by Apple in
2017. ‣ High-level , Session based API . ‣ It requires A9 or newer processors to perform all the complex computations in real-time. Thus, you’ll need an iPhone SE, iPhone 6s, iPhone 6s Plus, 5th generation iPad, or a newer device running iOS 11. -
CHITARANJAN SAHU ARKIT LAYERS Tracking :World Tracking, Visual inertial odometer,
Orientation, Position, Scaling object relatively,No external setup required . Scene Understanding : Plane detection, Hit testing, light estimation Rendering : Easy integration , ARView, SceneKit , SpriteKit, Metal,Unity and unreal support for ARKit -
CHITARANJAN SAHU ARSessionConfiguration ‣ Configuration Classes ‣ Enable/Disable Features ‣
Availability if ARWorldTrackingSessionConfiguration.isSupported { configuration = ARWorldTrackingSessionConfiguration() } else { configuration = ARSessionConfiguration() } -
CHITARANJAN SAHU ARSession ‣ Manage AR processing // Run your
session session.run(configuration) // Pause your session session.pause() // Resume your session session.run(session.configuration) // Change your configuration session.run(otherConfiguration) -
CHITARANJAN SAHU ARSession ‣ Manage AR processing ‣ Reset tracking
// Reset tracking session.run(configuration, options: .resetTracking) -
CHITARANJAN SAHU ARSession ‣ Manage AR processing ‣ Reset tracking
‣ Session updates -
CHITARANJAN SAHU ARSession ‣ Manage AR processing ‣ Reset tracking
‣ Session updates // Access the latest frame func session(_: ARSession, didUpdate: ARFrame) // Handle session errors func session(_: ARSession, didFailWithError: Error) -
CHITARANJAN SAHU ARSession ‣ Manage AR processing ‣ Reset tracking
‣ Session updates ‣ Current frame -
CHITARANJAN SAHU ARFrame ‣ Captured image ‣ Tracking information ‣
Scene information -
CHITARANJAN SAHU ARAnchor ‣ Real-world position and orientation ‣ ARSession
add/remove ‣ ARFrame anchors -
CHITARANJAN SAHU World Tracking ‣ Position and orientation ‣ Physical
distances ‣ Relative to starting position ‣ 3D-feature points -
CHITARANJAN SAHU // Create a session let mySession = ARSession()
// Set ourselves as the session delegate mySession.delegate = self // Create a world tracking configuration let configuration = ARWorldTrackingSessionConfiguration() // Run the session mySession.run(configuration) -
CHITARANJAN SAHU ARKit 2.0 ‣ Saving and Loading Maps ‣
Environment Texturing -
CHITARANJAN SAHU ARKit 2.0 ‣ Saving and Loading Maps ‣
Environment Texturing ‣ Image Tracking -
CHITARANJAN SAHU ARKit 2.0 ‣ Saving and Loading Maps ‣
Environment Texturing ‣ Image Tracking ‣ Object Detection -
CHITARANJAN SAHU ARKit 2.0 ‣ Saving and Loading Maps ‣
Environment Texturing ‣ Image Tracking ‣ Object Detection ‣ Face Tracking Enhancements -
CHITARANJAN SAHU Saving and Loading Maps // Retrieve world map
from session object session.getCurrentWorldMap { worldMap, error in guard let worldMap = worldMap else { showAlert(error) return } } -
CHITARANJAN SAHU Saving and Loading Maps // Retrieve world map
from session object session.getCurrentWorldMap { worldMap, error in guard let worldMap = worldMap else { showAlert(error) return } } // Load world map and run the configuration let configuration = ARWorldTrackingConfiguration() configuration.initialWorldMap = worldMap session.run(configuration) -
CHITARANJAN SAHU Environment Texturing ‣ Improvisation in reflection, shadow, lighting
‣ Configuration.environmentaltexturing ‣ Gathers scene texture ‣ Cube map representation ‣ Dynamically update texture -
CHITARANJAN SAHU Image Detection and Tracking Detection ‣ Recognition of
known static 2D images ‣ Change position and orientation ‣ Integration with world tracking ‣ Validation Support by Xcode asset catalog -
CHITARANJAN SAHU Image Detection and Tracking Detection ‣ Recognition of
known static 2D images ‣ Change position and orientation ‣ Integration with world tracking ‣ Validation Support by Xcode asset catalog Tracking ‣ Multiple image tracking ‣ Images don’t need to be static ‣ Position and orientation for every frame ‣ ARImageTrackingConfiguration -
CHITARANJAN SAHU 3D Object detection ‣ Objects need to be
scanned first Using ARObjectScanningConfiguration ‣ Detection of a known static 3D object configuration.detectionObjects ‣ Feature points,Well-textured, rigid, non-reflective Example : museum app, -
CHITARANJAN SAHU Face tracking ‣ Improvements in face tracking mesh/ARFaceGeometry,
light probing ‣ Animoji in Arkit 1.5 ‣ 50+ facial features tracking ‣ New Gaze tracking ‣ Inputs using Gaze tracking ‣ TongueSupport