Upgrade to Pro — share decks privately, control downloads, hide ads and more …

FaceTracking-ARKit-trySwift.pdf

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Berta Devant Berta Devant
September 04, 2018
Programming
2
110

 FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant

Berta Devant

September 04, 2018
Tweet

More Decks by Berta Devant

See All by Berta Devant
Creating the perfect abstract
Avatar for Berta Devant bertadevant
0
68
Explain, please: Help your users trust you!
Avatar for Berta Devant bertadevant
0
130

Other Decks in Programming

See All in Programming
Lambda のコードストレージ容量に気をつけましょう
Avatar for tatsuki-yamada tattwan718
0
120
そのAIレビュー、レビューしてますか？ / Are you reviewing those AI reviews?
Avatar for r-kagaya rkaga
6
4.6k
IFSによる形状設計／デモシーンの魅力 @ 慶應大学SFC
Avatar for がむ gam0022
1
300
Basic Architectures
Avatar for Denys Poltorak denyspoltorak
0
670
MUSUBIXとは
Avatar for Hisaho nahisaho
0
130
LLM Observabilityによる 対話型音声AIアプリケーションの安定運用
Avatar for Hiroyuki Moriya gekko0114
2
430
CSC307 Lecture 04
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
660
15年続くIoTサービスの SREエンジニアが挑む 分散トレーシング導入
Avatar for Melonps melonps
2
200
CSC307 Lecture 07
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
550
HTTPプロトコル正しく理解していますか？ 〜かわいい猫と共に学ぼう。ฅ^•ω•^ฅ ﾆｬ〜
Avatar for ♛Heitor Hirose hekuchan
2
690
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
6k
AI時代の認知負荷との向き合い方
Avatar for OptFit Corp. optfit
0
160

Featured

See All Featured
Designing for Performance
Avatar for Lara Hogan lara
610
70k
Design in an AI World
Avatar for tapps tapps
0
140
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
249
1.3M
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.4k
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
0
51
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
1
51
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
7.9k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
22k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
57
14k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
0
46k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k

Transcript

  1. FaceTracking using ARKit Memojis Under the Hood

  2. Berta Devant IOS Developer @Novoda @bertadevant

  3. AR 101 ARKit Face Tracking The Future ™

  4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering

    Image Tracking 3D object detection Persistence & Multi user

  5. All the words Feature points AR Anchors AR Scene View

    AR Session AR Tracking Configuration ARSCNViewDelegate

  6. Show code or go home

  7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry

  8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry

    52 blendShape Movements leftEye rightEye lookAtPoint

  9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh

    Vertices textureCoordinates triangleIndices

  10. Show code or go home

  11. Show code or go home

  12. Show me!!!

  13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see

    on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device

  14. Show code or go home

  15. Show me!!!

  16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction

  17. Thanks https://github.com/novoda/ios-demos @bertadevant