FaceTracking-ARKit-trySwift.pdf

Transcript

1. FaceTracking using ARKit Memojis Under the Hood
2. Berta Devant IOS Developer @Novoda @bertadevant
3. AR 101 ARKit Face Tracking The Future ™
4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering Image Tracking 3D object detection Persistence & Multi user
5. All the words Feature points AR Anchors AR Scene View AR Session AR Tracking Configuration ARSCNViewDelegate
6. Show code or go home
7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry
8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry 52 blendShape Movements leftEye rightEye lookAtPoint
9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh Vertices textureCoordinates triangleIndices
10. Show code or go home
11. Show code or go home
12. Show me!!!
13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device
14. Show code or go home
15. Show me!!!
16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction
17. Thanks https://github.com/novoda/ios-demos @bertadevant