Upgrade to Pro — share decks privately, control downloads, hide ads and more …

FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant Berta Devant
September 04, 2018
Programming
120
2

 FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant

Berta Devant

September 04, 2018

More Decks by Berta Devant

See All by Berta Devant
Creating the perfect abstract
Avatar for Berta Devant bertadevant
0
76
Explain, please: Help your users trust you!
Avatar for Berta Devant bertadevant
0
130

Other Decks in Programming

See All in Programming
Signal Forms: Beyond the Basics @ngBaguette 2026 in Paris
Avatar for Manfred Steyer manfredsteyer
PRO
0
230
tsserverとは何だったのか、これからどうなるのか
Avatar for Ryota Nakamura nowaki28
1
450
軽量Java基盤の設計 DIコンテナに頼らない、長期保守と1秒起動の実現 JJUG CCC 2026 Spring
Avatar for Masaaki Takahashi macha64
0
460
Old Dog, New Tricks: The Java 25 Reinvention - JNation
Avatar for A N M Bazlur Rahman bazlur_rahman
0
150
正しくソフトウェアを作る、前提を疑うための認知の視点 / doubt-premise
Avatar for MinoDriven minodriven
17
6k
Spec Driven Development | AI Summit Lisbon
Avatar for Daniel Sogl danielsogl
PRO
0
150
Datadog × OpenTelemetry 入門と実践のあいだ
Avatar for Max Kento kn_to_maxpno
1
150
今さら聞けないCancellationToken
Avatar for tkym htkym
0
220
開発体験を左右するライブラリの API 設計 - GraphQL スキーマ構築ライブラリから考える #tskaigi
Avatar for izumin5210 izumin5210
2
1.6k
AIエージェントの隔離技術の徹底比較
Avatar for kawayu kawayu
0
460
並列実装の現場、2ヶ月間実務でAIを使い倒したAIもPCも私も限界が近い
Avatar for ming ming_ayami
0
110
TAKTでAI駆動開発の品質を設計する
Avatar for かとじゅん j5ik2o
6
960

Featured

See All Featured
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
300
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
1
320
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
3
390
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
790
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.6k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Scaling GitHub
Avatar for Zach Holman holman
464
140k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.1k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
7
36k
BBQ
Avatar for Matthew Crist matthewcrist
89
10k

Transcript

  1. FaceTracking using ARKit Memojis Under the Hood

  2. Berta Devant IOS Developer @Novoda @bertadevant

  3. AR 101 ARKit Face Tracking The Future ™

  4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering

    Image Tracking 3D object detection Persistence & Multi user

  5. All the words Feature points AR Anchors AR Scene View

    AR Session AR Tracking Configuration ARSCNViewDelegate

  6. Show code or go home

  7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry

  8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry

    52 blendShape Movements leftEye rightEye lookAtPoint

  9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh

    Vertices textureCoordinates triangleIndices

  10. Show code or go home

  11. Show code or go home

  12. Show me!!!

  13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see

    on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device

  14. Show code or go home

  15. Show me!!!

  16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction

  17. Thanks https://github.com/novoda/ios-demos @bertadevant