AR FACE DETECTION
ࣗݾհ
▸ @TachibanaKaoru
▸ ϑϦʔϥϯε iOSΤϯδχΞ
▸ ϘϧμϦϯά͕͖Ͱɺ࠷ۙϦʔυΫϥΠϛ
ϯάνϟϨϯδதɻ
▸ Blog : http://www.toyship.org/Kaoru
Slide 3
Slide 3 text
ARKIT
Slide 4
Slide 4 text
AR FACE DETECTIONTEXT
ARKIT
▸ Augmented RealityΛ؆୯ʹ࣮͢ΔϑϨʔϜϫʔΫ
▸ iOS11͔Βհ͞Εͨ
▸ CPU͕A9Ҏ্ͷͰར༻Մೳ
Slide 5
Slide 5 text
AR FACE DETECTION
ARKITͷಛ
▸ ࣮͕؆୯
▸ σόΠεͷՃใΛར༻
▸ ඳըΤϯδϯΛબͰ͖Δ
Slide 6
Slide 6 text
AR FACE DETECTION
ARKITͷಛ
▸ ࣮͕؆୯
▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ
ʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ
͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ
▸ ࣗͰ࣮͢Δ߹ʹɺARSCNViewͳͲͷΦϒδΣΫ
τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ
ϧɻ
Slide 7
Slide 7 text
AR FACE DETECTION
ARKITͷಛ
▸ σόΠεͷՃใͱΧϝϥը૾Λಉ࣌ʹղ
ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
Slide 8
Slide 8 text
AR FACE DETECTION
ARKITͷಛ
▸ ඳըΤϯδϯΛબͰ͖Δ
▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ
▸ UnityUnreal EngineʹରԠ
Slide 9
Slide 9 text
AR FACE DETECTION
ෆࢥٞͷࠃͷΞϦεAR
Slide 10
Slide 10 text
AR FACE DETECTIONTEXT
AR WORLD TRACKING WITH ARKIT
▸ ARSCNViewΛ࡞͠ɺWorld Tracking༻ͷConfiguretonΛઃఆ͢Δɻ
▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
Slide 11
Slide 11 text
TEXT
AR WORLD TRACKING WITH ARKIT
▸ ฏ໘ݕ͕onʹͳ͍ͬͯΔͱɺݕͨ͠߹ʹDelegateʹ௨͞ΕΔ
Slide 12
Slide 12 text
AR FACE DETECTION
ARKIT FACE DETECTION
▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද
▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
Slide 13
Slide 13 text
AR FACE DETECTION
Slide 14
Slide 14 text
AR FACE DETECTIONTEXT
IPHONEX SENSORS
Slide 15
Slide 15 text
AR FACE DETECTIONTEXT
Slide 16
Slide 16 text
AR FACE DETECTIONTEXT
ʢը૾ΠϝʔδͰ͢ʣ
Slide 17
Slide 17 text
AR FACE DETECTION
AR FACE DETECTION
▸ True Depth CameraʹΑΓɺإͷਂใΛऔಘ͢Δ
▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛผՄೳ
▸ VisionϑϨʔϜϫʔΫͰإύʔπͷೝࣝՄೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ
ͳ͍
Slide 18
Slide 18 text
AR FACE DETECTION
Slide 19
Slide 19 text
AR FACE DETECTIONTEXT
AR WORLD TRACKING WITH ARKIT
▸ ARSCNViewΛ࡞͠ɺFace Detection༻ͷConfiguretonΛઃఆ͢Δɻ
▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
Slide 20
Slide 20 text
AR FACE DETECTION
FACE DETECTION
▸ إ͕ೝࣝ͞Εͨ࣌ʹDelegateʹ௨͞ΕΔ
Slide 21
Slide 21 text
AR FACE DETECTION
FRONT OR REAR CAMERA
▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ
iPhoneͷϦΞΧϝϥ͕ΘΕ·͢ɻ
▸ ͜ΕϑϩϯτΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ
▸ Ͱ͖·ͤΜ
Slide 22
Slide 22 text
AR FACE DETECTION
FRONT OR REAR CAMERA
▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰɺવTrue Depth Camera͕͋ΔϑϩϯτΧϝϥ
ͷө૾͕ΘΕ·͢ɻ
▸ ͜ΕϦΞΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ
▸ Ͱ͖·ͤΜ
Slide 23
Slide 23 text
AR FACE DETECTIONTEXT
FRONT OR REAR CAMERA
▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓ΘΕ·͢
▸ World Tracking Configurationͷ߹ʹϦΞΧϝϥ
▸ Face Detection Configurationͷ߹ʹϑϩϯτΧϝϥ
Slide 24
Slide 24 text
AR FACE DETECTION
FACE DETECTION SAMPLE CODE
▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ
ఏڙ͞Ε͍ͯ·͢ɻ
▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢
͕……ɻ
Slide 25
Slide 25 text
AR FACE DETECTION
DEPTH DATA IN ARFRAME
Slide 26
Slide 26 text
AR FACE DETECTION
·ͱΊ
▸ AR World Tracking/ AR Face DetectionͲͪΒ࣮͕ඇৗʹ؆୯
▸ AR Face Detection࣮ػͰ͔͠ࢼͤͳ͍
▸ iPhoneXཉ͍͠ʂ