Upgrade to Pro — share decks privately, control downloads, hide ads and more …

FaceTracking-ARKit-trySwift.pdf

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Berta Devant Berta Devant
September 04, 2018
Programming
120
2

 FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant

Berta Devant

September 04, 2018

More Decks by Berta Devant

See All by Berta Devant
Creating the perfect abstract
Avatar for Berta Devant bertadevant
0
77
Explain, please: Help your users trust you!
Avatar for Berta Devant bertadevant
0
140

Other Decks in Programming

See All in Programming
Haskell/Servantを通してWebミドルウェアを捉え直す
Avatar for pizzacat83 pizzacat83
0
350
トークンをケチるな、設計しろ：GitHub Copilotを賢く使うコンテキスト戦略
Avatar for Ochtum ochtum
0
280
音楽のための関数型プログラミング言語mimiumにおける多段階計算の活用
Avatar for Tomoya Matsuura tomoyanonymous
1
220
自作OSでスライド発表する
Avatar for uyuki uyuki234
1
3.6k
技術記事、 専門家としてのプログラマ、 言語化
Avatar for Koutarou Chikuba mizchi
14
7.3k
Agentic UI
Avatar for Manfred Steyer manfredsteyer
PRO
0
220
「なぜそう決めたのか」を残し続ける仕組み ― Notion AI カスタムエージェント × Slack連携による設計判断の自動記録 - NIKKEI Tech Talk #47
Avatar for ニフティ株式会社 niftycorp
PRO
0
250
スマートグラスで並列バイブコーディング
Avatar for Hayami Shuhei hyshu
0
280
才能？センス？知らん、 続けたもん勝ちだ。-- 結婚・出産・癌を越えてなお、私がプロダクトを創り続ける理由
Avatar for 16bit_idol 16bitidol
2
670
エンジニアと一緒にテストコードの設計と実装を改善した話
Avatar for mototakatsu mototakatsu
0
250
AIエージェントで 変わるAndroid開発環境
Avatar for takahirom takahirom
1
270
20260623_Loop Engineeringで自分の分身の問い合わせBotを作る
Avatar for ryugen04 ryugen04
0
110

Featured

See All Featured
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2k
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.5k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
230
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
200
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.5k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.9k
So, you think you're a good person
Avatar for Per Axbom axbom
PRO
2
2.1k
A Soul's Torment
Avatar for Nat Ma seathinner
6
3k
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
2
720
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
210k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
750

Transcript

  1. FaceTracking using ARKit Memojis Under the Hood

  2. Berta Devant IOS Developer @Novoda @bertadevant

  3. AR 101 ARKit Face Tracking The Future ™

  4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering

    Image Tracking 3D object detection Persistence & Multi user

  5. All the words Feature points AR Anchors AR Scene View

    AR Session AR Tracking Configuration ARSCNViewDelegate

  6. Show code or go home

  7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry

  8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry

    52 blendShape Movements leftEye rightEye lookAtPoint

  9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh

    Vertices textureCoordinates triangleIndices

  10. Show code or go home

  11. Show code or go home

  12. Show me!!!

  13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see

    on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device

  14. Show code or go home

  15. Show me!!!

  16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction

  17. Thanks https://github.com/novoda/ios-demos @bertadevant