AR FACE DETECTION@TACHIBANAKAORU2017/10/25
View Slide
AR FACE DETECTIONࣗݾհ▸ @TachibanaKaoru▸ ϑϦʔϥϯε iOSΤϯδχΞ▸ ϘϧμϦϯά͕͖Ͱɺ࠷ۙϦʔυΫϥΠϛϯάνϟϨϯδதɻ▸ Blog : http://www.toyship.org/Kaoru
ARKIT
AR FACE DETECTIONTEXTARKIT▸ Augmented RealityΛ؆୯ʹ࣮͢ΔϑϨʔϜϫʔΫ▸ iOS11͔Βհ͞Εͨ▸ CPU͕A9Ҏ্ͷͰར༻Մೳ
AR FACE DETECTIONARKITͷಛ▸ ࣮͕؆୯▸ σόΠεͷՃใΛར༻▸ ඳըΤϯδϯΛબͰ͖Δ
AR FACE DETECTIONARKITͷಛ▸ ࣮͕؆୯▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ▸ ࣗͰ࣮͢Δ߹ʹɺARSCNViewͳͲͷΦϒδΣΫτΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓϧɻ
AR FACE DETECTIONARKITͷಛ▸ σόΠεͷՃใͱΧϝϥը૾Λಉ࣌ʹղੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
AR FACE DETECTIONARKITͷಛ▸ ඳըΤϯδϯΛબͰ͖Δ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ▸ UnityUnreal EngineʹରԠ
AR FACE DETECTIONෆࢥٞͷࠃͷΞϦεAR
AR FACE DETECTIONTEXTAR WORLD TRACKING WITH ARKIT▸ ARSCNViewΛ࡞͠ɺWorld Tracking༻ͷConfiguretonΛઃఆ͢Δɻ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
TEXTAR WORLD TRACKING WITH ARKIT▸ ฏ໘ݕ͕onʹͳ͍ͬͯΔͱɺݕͨ͠߹ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTIONARKIT FACE DETECTION▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
AR FACE DETECTION
AR FACE DETECTIONTEXTIPHONEX SENSORS
AR FACE DETECTIONTEXT
AR FACE DETECTIONTEXTʢը૾ΠϝʔδͰ͢ʣ
AR FACE DETECTIONAR FACE DETECTION▸ True Depth CameraʹΑΓɺإͷਂใΛऔಘ͢Δ▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛผՄೳ▸ VisionϑϨʔϜϫʔΫͰإύʔπͷೝࣝՄೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গͳ͍
AR FACE DETECTIONTEXTAR WORLD TRACKING WITH ARKIT▸ ARSCNViewΛ࡞͠ɺFace Detection༻ͷConfiguretonΛઃఆ͢Δɻ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
AR FACE DETECTIONFACE DETECTION▸ إ͕ೝࣝ͞Εͨ࣌ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTIONFRONT OR REAR CAMERA▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰiPhoneͷϦΞΧϝϥ͕ΘΕ·͢ɻ▸ ͜ΕϑϩϯτΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ▸ Ͱ͖·ͤΜ
AR FACE DETECTIONFRONT OR REAR CAMERA▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰɺવTrue Depth Camera͕͋ΔϑϩϯτΧϝϥͷө૾͕ΘΕ·͢ɻ▸ ͜ΕϦΞΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ▸ Ͱ͖·ͤΜ
AR FACE DETECTIONTEXTFRONT OR REAR CAMERA▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓ΘΕ·͢▸ World Tracking Configurationͷ߹ʹϦΞΧϝϥ▸ Face Detection Configurationͷ߹ʹϑϩϯτΧϝϥ
AR FACE DETECTIONFACE DETECTION SAMPLE CODE▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυఏڙ͞Ε͍ͯ·͢ɻ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͕͢……ɻ
AR FACE DETECTIONDEPTH DATA IN ARFRAME
AR FACE DETECTION·ͱΊ▸ AR World Tracking/ AR Face DetectionͲͪΒ࣮͕ඇৗʹ؆୯▸ AR Face Detection࣮ػͰ͔͠ࢼͤͳ͍▸ iPhoneXཉ͍͠ʂ