AR Face Detection - Speaker Deck

AR Face Detection

by Tachibana Kaoru

Slide 1

Slide 1 text

AR FACE DETECTION @TACHIBANAKAORU 2017/10/25

Slide 2

Slide 2 text

AR FACE DETECTION ࣗݾ঺հ ▸ @TachibanaKaoru ▸ ϑϦʔϥϯε iOSΤϯδχΞ ▸ ϘϧμϦϯά͕޷͖Ͱɺ࠷ۙ͸ϦʔυΫϥΠϛ ϯά΋νϟϨϯδதɻ ▸ Blog : http://www.toyship.org/Kaoru

Slide 3

Slide 3 text

ARKIT

Slide 4

Slide 4 text

AR FACE DETECTIONTEXT ARKIT ▸ Augmented RealityΛ؆୯ʹ࣮૷͢ΔϑϨʔϜϫʔΫ ▸ iOS11͔Β঺հ͞Εͨ ▸ CPU͕A9Ҏ্ͷ୺຤Ͱར༻Մೳ

Slide 5

Slide 5 text

AR FACE DETECTION ARKITͷಛ௃ ▸ ࣮૷͕؆୯ ▸ σόΠεͷՃ଎౓৘ใΛར༻ ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ

Slide 6

Slide 6 text

AR FACE DETECTION ARKITͷಛ௃ ▸ ࣮૷͕؆୯ ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ ʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ ▸ ࣗ෼Ͱ࣮૷͢Δ৔߹ʹ΋ɺARSCNViewͳͲͷΦϒδΣΫ τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ ϧɻ

Slide 7

Slide 7 text

AR FACE DETECTION ARKITͷಛ௃ ▸ σόΠεͷՃ଎౓৘ใͱΧϝϥը૾Λಉ࣌ʹղ ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬

Slide 8

Slide 8 text

AR FACE DETECTION ARKITͷಛ௃ ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ ▸ Unity΍Unreal Engineʹ΋ରԠ

Slide 9

Slide 9 text

AR FACE DETECTION ෆࢥٞͷࠃͷΞϦεAR

Slide 10

Slide 10 text

AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞੒͠ɺWorld Tracking༻ͷConﬁguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ

Slide 11

Slide 11 text

TEXT AR WORLD TRACKING WITH ARKIT ▸ ฏ໘ݕ஌͕onʹͳ͍ͬͯΔͱɺݕ஌ͨ͠৔߹ʹDelegateʹ௨஌͞ΕΔ

Slide 12

Slide 12 text

AR FACE DETECTION ARKIT FACE DETECTION ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ

Slide 13

Slide 13 text

AR FACE DETECTION

Slide 14

Slide 14 text

AR FACE DETECTIONTEXT IPHONEX SENSORS

Slide 15

Slide 15 text

AR FACE DETECTIONTEXT

Slide 16

Slide 16 text

AR FACE DETECTIONTEXT ʢը૾͸ΠϝʔδͰ͢ʣ

Slide 17

Slide 17 text

AR FACE DETECTION AR FACE DETECTION ▸ True Depth CameraʹΑΓɺإͷਂ౓৘ใΛऔಘ͢Δ ▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛ൑ผՄೳ ▸ VisionϑϨʔϜϫʔΫͰ΋إύʔπͷೝࣝ͸Մೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ ͳ͍

Slide 18

Slide 18 text

AR FACE DETECTION

Slide 19

Slide 19 text

AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞੒͠ɺFace Detection༻ͷConﬁguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ

Slide 20

Slide 20 text

AR FACE DETECTION FACE DETECTION ▸ إ͕ೝࣝ͞Εͨ࣌ʹ͸Delegateʹ௨஌͞ΕΔ

Slide 21

Slide 21 text

AR FACE DETECTION FRONT OR REAR CAMERA ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ͸ iPhoneͷϦΞΧϝϥ͕࢖ΘΕ·͢ɻ ▸ ͜Ε͸ϑϩϯτΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ

Slide 22

Slide 22 text

AR FACE DETECTION FRONT OR REAR CAMERA ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰ͸ɺ౰વTrue Depth Camera͕͋ΔϑϩϯτΧϝϥ ͷө૾͕࢖ΘΕ·͢ɻ ▸ ͜Ε͸ϦΞΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ

Slide 23

Slide 23 text

AR FACE DETECTIONTEXT FRONT OR REAR CAMERA ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓΋ΘΕ·͢ ▸ World Tracking Configurationͷ৔߹ʹ͸ϦΞΧϝϥ ▸ Face Detection Configurationͷ৔߹ʹ͸ϑϩϯτΧϝϥ

Slide 24

Slide 24 text

AR FACE DETECTION FACE DETECTION SAMPLE CODE ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ΋ ఏڙ͞Ε͍ͯ·͢ɻ ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢ ͕……ɻ

Slide 25

Slide 25 text

AR FACE DETECTION DEPTH DATA IN ARFRAME

Slide 26

Slide 26 text

AR FACE DETECTION ·ͱΊ ▸ AR World Tracking/ AR Face Detection͸ͲͪΒ΋࣮૷͕ඇৗʹ؆୯ ▸ AR Face Detection͸࣮ػͰ͔͠ࢼͤͳ͍ ▸ iPhoneXཉ͍͠ʂ