AR Face Detection

Transcript

1. AR FACE DETECTION @TACHIBANAKAORU 2017/10/25
2. AR FACE DETECTION ࣗݾ঺հ ▸ @TachibanaKaoru ▸ ϑϦʔϥϯε iOSΤϯδχΞ ▸ ϘϧμϦϯά͕޷͖Ͱɺ࠷ۙ͸ϦʔυΫϥΠϛ ϯά΋νϟϨϯδதɻ ▸ Blog : http://www.toyship.org/Kaoru
3. ARKIT
4. AR FACE DETECTIONTEXT ARKIT ▸ Augmented RealityΛ؆୯ʹ࣮૷͢ΔϑϨʔϜϫʔΫ ▸ iOS11͔Β঺հ͞Εͨ ▸ CPU͕A9Ҏ্ͷ୺຤Ͱར༻Մೳ
5. AR FACE DETECTION ARKITͷಛ௃ ▸ ࣮૷͕؆୯ ▸ σόΠεͷՃ଎౓৘ใΛར༻ ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ
6. AR FACE DETECTION ARKITͷಛ௃ ▸ ࣮૷͕؆୯ ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ ʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ ▸ ࣗ෼Ͱ࣮૷͢Δ৔߹ʹ΋ɺARSCNViewͳͲͷΦϒδΣΫ τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ ϧɻ
7. AR FACE DETECTION ARKITͷಛ௃ ▸ σόΠεͷՃ଎౓৘ใͱΧϝϥը૾Λಉ࣌ʹղ ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
8. AR FACE DETECTION ARKITͷಛ௃ ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ ▸ Unity΍Unreal Engineʹ΋ରԠ
9. AR FACE DETECTION ෆࢥٞͷࠃͷΞϦεAR
10. AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞੒͠ɺWorld Tracking༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
11. TEXT AR WORLD TRACKING WITH ARKIT ▸ ฏ໘ݕ஌͕onʹͳ͍ͬͯΔͱɺݕ஌ͨ͠৔߹ʹDelegateʹ௨஌͞ΕΔ
12. AR FACE DETECTION ARKIT FACE DETECTION ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
13. AR FACE DETECTION
14. AR FACE DETECTIONTEXT IPHONEX SENSORS
15. AR FACE DETECTIONTEXT
16. AR FACE DETECTIONTEXT ʢը૾͸ΠϝʔδͰ͢ʣ
17. AR FACE DETECTION AR FACE DETECTION ▸ True Depth CameraʹΑΓɺإͷਂ౓৘ใΛऔಘ͢Δ ▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛ൑ผՄೳ ▸ VisionϑϨʔϜϫʔΫͰ΋إύʔπͷೝࣝ͸Մೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ ͳ͍
18. AR FACE DETECTION
19. AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞੒͠ɺFace Detection༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
20. AR FACE DETECTION FACE DETECTION ▸ إ͕ೝࣝ͞Εͨ࣌ʹ͸Delegateʹ௨஌͞ΕΔ
21. AR FACE DETECTION FRONT OR REAR CAMERA ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ͸ iPhoneͷϦΞΧϝϥ͕࢖ΘΕ·͢ɻ ▸ ͜Ε͸ϑϩϯτΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
22. AR FACE DETECTION FRONT OR REAR CAMERA ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰ͸ɺ౰વTrue Depth Camera͕͋ΔϑϩϯτΧϝϥ ͷө૾͕࢖ΘΕ·͢ɻ ▸ ͜Ε͸ϦΞΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
23. AR FACE DETECTIONTEXT FRONT OR REAR CAMERA ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓΋ΘΕ·͢ ▸ World Tracking Configurationͷ৔߹ʹ͸ϦΞΧϝϥ ▸ Face Detection Configurationͷ৔߹ʹ͸ϑϩϯτΧϝϥ
24. AR FACE DETECTION FACE DETECTION SAMPLE CODE ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ΋ ఏڙ͞Ε͍ͯ·͢ɻ ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢ ͕……ɻ
25. AR FACE DETECTION DEPTH DATA IN ARFRAME
26. AR FACE DETECTION ·ͱΊ ▸ AR World Tracking/ AR Face Detection͸ͲͪΒ΋࣮૷͕ඇৗʹ؆୯ ▸ AR Face Detection͸࣮ػͰ͔͠ࢼͤͳ͍ ▸ iPhoneXཉ͍͠ʂ