Upgrade to Pro — share decks privately, control downloads, hide ads and more …

FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant Berta Devant
September 04, 2018
Programming
120
2

 FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant

Berta Devant

September 04, 2018

More Decks by Berta Devant

See All by Berta Devant
Creating the perfect abstract
Avatar for Berta Devant bertadevant
0
77
Explain, please: Help your users trust you!
Avatar for Berta Devant bertadevant
0
140

Other Decks in Programming

See All in Programming
Agentic UI
Avatar for Manfred Steyer manfredsteyer
PRO
0
220
自作OSでスライド発表する
Avatar for uyuki uyuki234
1
3.6k
なぜ関数型プログラミングで「型」と「証明」が語られるのか #fp_matsuri
Avatar for Takuma Kajikawa kajitack
0
310
Honoでのサプライチェーン侵害対策 〜 3つのライブラリに学ぶ
Avatar for Yusuke Wada yusukebe
7
1.7k
LaravelLive Japan の裏方のすべて — 第188回 PHP勉強会＠東京 (2026-06-24)
Avatar for Suguru Oki / スー suguruooki
2
150
コンテキストの使い捨てをやめる — ビジネスルール駆動開発と miko —
Avatar for ioki ioki
0
270
メソッドのジェネリクスでGoの夢は広がるか？ / Kyoto.go #65
Avatar for utagawa kiki utgwkk
3
1k
LLM本来の能力を解き放つサンドボックス技術とAI民主化への適用
Avatar for Yuku Kotani yukukotani
3
4.8k
才能？センス？知らん、 続けたもん勝ちだ。-- 結婚・出産・癌を越えてなお、私がプロダクトを創り続ける理由
Avatar for 16bit_idol 16bitidol
2
670
LLMによるContent Moderationの本番運用の裏側と品質担保への挑戦
Avatar for suikabar suikabar
3
820
AIキャラアプリkaiwaの低遅延音声通話基盤をどう作ったか - AWS Gravitonで支える低遅延・低コストAI Agent基盤
Avatar for 最上土川 mogamit
0
150
スマートグラスで並列バイブコーディング
Avatar for Hayami Shuhei hyshu
0
280

Featured

See All Featured
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
1
3.7k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1.4k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
24k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
210k
Discover your Explorer Soul
Avatar for Emna emna__ayadi
2
1.2k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2k
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
200
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.3k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
580
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.9k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
230

Transcript

  1. FaceTracking using ARKit Memojis Under the Hood

  2. Berta Devant IOS Developer @Novoda @bertadevant

  3. AR 101 ARKit Face Tracking The Future ™

  4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering

    Image Tracking 3D object detection Persistence & Multi user

  5. All the words Feature points AR Anchors AR Scene View

    AR Session AR Tracking Configuration ARSCNViewDelegate

  6. Show code or go home

  7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry

  8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry

    52 blendShape Movements leftEye rightEye lookAtPoint

  9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh

    Vertices textureCoordinates triangleIndices

  10. Show code or go home

  11. Show code or go home

  12. Show me!!!

  13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see

    on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device

  14. Show code or go home

  15. Show me!!!

  16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction

  17. Thanks https://github.com/novoda/ios-demos @bertadevant