Upgrade to Pro — share decks privately, control downloads, hide ads and more …

FaceTracking-ARKit-trySwift.pdf

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Berta Devant Berta Devant
September 04, 2018
Programming
2
110

 FaceTracking-ARKit-trySwift.pdf

Avatar for Berta Devant

Berta Devant

September 04, 2018
Tweet

More Decks by Berta Devant

See All by Berta Devant
Creating the perfect abstract
Avatar for Berta Devant bertadevant
0
68
Explain, please: Help your users trust you!
Avatar for Berta Devant bertadevant
0
130

Other Decks in Programming

See All in Programming
humanlayerのブログから学ぶ、良いCLAUDE.mdの書き方
Avatar for Yuto tsukamoto1783
0
180
MDN Web Docs に日本語翻訳でコントリビュート
Avatar for uutan1108 ohmori_yusuke
0
640
Rust 製のコードエディタ “Zed” を使ってみた
Avatar for NearMeの技術発表資料です nearme_tech
PRO
0
150
責任感のあるCloudWatchアラームを設計しよう
Avatar for アキキー akihisaikeda
3
160
プロダクトオーナーから見たSOC2 _SOC2ゆるミートアップ#2
Avatar for Kenta Suzuki kekekenta
0
200
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
170
HTTPプロトコル正しく理解していますか？ 〜かわいい猫と共に学ぼう。ฅ^•ω•^ฅ ﾆｬ〜
Avatar for ♛Heitor Hirose hekuchan
2
680
CSC307 Lecture 06
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
680
Lambda のコードストレージ容量に気をつけましょう
Avatar for tatsuki-yamada tattwan718
0
110
そのAIレビュー、レビューしてますか？ / Are you reviewing those AI reviews?
Avatar for r-kagaya rkaga
6
4.5k
Fragmented Architectures
Avatar for Denys Poltorak denyspoltorak
0
150
AIエージェント、”どう作るか”で差は出るか？ / AI Agents: Does the "How" Make a Difference?
Avatar for r-kagaya rkaga
4
2k

Featured

See All Featured
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.1k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
New Earth Scene 8
Avatar for Sydney Stone popppiees
1
1.5k
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
210
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
Visualization
Avatar for Eitan Lees eitanlees
150
17k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
408
66k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.6k

Transcript

  1. FaceTracking using ARKit Memojis Under the Hood

  2. Berta Devant IOS Developer @Novoda @bertadevant

  3. AR 101 ARKit Face Tracking The Future ™

  4. AR WHAT?? World Tracking & Scene Understanding Face Tracking Rendering

    Image Tracking 3D object detection Persistence & Multi user

  5. All the words Feature points AR Anchors AR Scene View

    AR Session AR Tracking Configuration ARSCNViewDelegate

  6. Show code or go home

  7. ARFaceAnchors ARFaceGeometry ARSCNFaceGeometry

  8. ARFaceAnchor : ARAnchor Position and orientation relative to World Geometry

    52 blendShape Movements leftEye rightEye lookAtPoint

  9. ARFaceGeometry 3D description of the Face Init(blendShapes) Topology of mesh

    Vertices textureCoordinates triangleIndices

  10. Show code or go home

  11. Show code or go home

  12. Show me!!!

  13. ARSCNFaceGeometry: SCNGeometry SceneKit representation of face topology “What you see

    on the screen” Update(from: ARFaceGeometry) Updates movements and expressions only init?(device: MTLDevice) Need Device

  14. Show code or go home

  15. Show me!!!

  16. Face Alterations Face Identification Security Occlusion Geometry Accessibility User Interaction

  17. Thanks https://github.com/novoda/ios-demos @bertadevant