AR Face Detection

Transcript

1. AR FACE DETECTION
   @TACHIBANAKAORU
   2017/10/25
   

   View Slide

2. AR FACE DETECTION
   ࣗݾ঺հ
   ▸ @TachibanaKaoru
   ▸ ϑϦʔϥϯε iOSΤϯδχΞ
   ▸ ϘϧμϦϯά͕޷͖Ͱɺ࠷ۙ͸ϦʔυΫϥΠϛ
   ϯά΋νϟϨϯδதɻ
   ▸ Blog : http://www.toyship.org/Kaoru
   

   View Slide

3. ARKIT
   

   View Slide

4. AR FACE DETECTIONTEXT
   ARKIT
   ▸ Augmented RealityΛ؆୯ʹ࣮૷͢ΔϑϨʔϜϫʔΫ
   ▸ iOS11͔Β঺հ͞Εͨ
   ▸ CPU͕A9Ҏ্ͷ୺຤Ͱར༻Մೳ
   

   View Slide

5. AR FACE DETECTION
   ARKITͷಛ௃
   ▸ ࣮૷͕؆୯
   ▸ σόΠεͷՃ଎౓৘ใΛར༻
   ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ
   

   View Slide

6. AR FACE DETECTION
   ARKITͷಛ௃
   ▸ ࣮૷͕؆୯
   ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ
   ʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ
   ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ
   ▸ ࣗ෼Ͱ࣮૷͢Δ৔߹ʹ΋ɺARSCNViewͳͲͷΦϒδΣΫ
   τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ
   ϧɻ
   

   View Slide

7. AR FACE DETECTION
   ARKITͷಛ௃
   ▸ σόΠεͷՃ଎౓৘ใͱΧϝϥը૾Λಉ࣌ʹղ
   ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
   

   View Slide

8. AR FACE DETECTION
   ARKITͷಛ௃
   ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ
   ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ
   ▸ Unity΍Unreal Engineʹ΋ରԠ
   

   View Slide

9. AR FACE DETECTION
   ෆࢥٞͷࠃͷΞϦεAR
   

   View Slide

10. AR FACE DETECTIONTEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ARSCNViewΛ࡞੒͠ɺWorld Tracking༻ͷConfiguretonΛઃఆ͢Δɻ
    ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
    

    View Slide

11. TEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ฏ໘ݕ஌͕onʹͳ͍ͬͯΔͱɺݕ஌ͨ͠৔߹ʹDelegateʹ௨஌͞ΕΔ
    

    View Slide

12. AR FACE DETECTION
    ARKIT FACE DETECTION
    ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද
    ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
    

    View Slide

13. AR FACE DETECTION
    

    View Slide

14. AR FACE DETECTIONTEXT
    IPHONEX SENSORS
    

    View Slide

15. AR FACE DETECTIONTEXT
    

    View Slide

16. AR FACE DETECTIONTEXT
    ʢը૾͸ΠϝʔδͰ͢ʣ
    

    View Slide

17. AR FACE DETECTION
    AR FACE DETECTION
    ▸ True Depth CameraʹΑΓɺإͷਂ౓৘ใΛऔಘ͢Δ
    ▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛ൑ผՄೳ
    ▸ VisionϑϨʔϜϫʔΫͰ΋إύʔπͷೝࣝ͸Մೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ
    ͳ͍
    

    View Slide

18. AR FACE DETECTION
    

    View Slide

19. AR FACE DETECTIONTEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ARSCNViewΛ࡞੒͠ɺFace Detection༻ͷConfiguretonΛઃఆ͢Δɻ
    ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
    

    View Slide

20. AR FACE DETECTION
    FACE DETECTION
    ▸ إ͕ೝࣝ͞Εͨ࣌ʹ͸Delegateʹ௨஌͞ΕΔ
    

    View Slide

21. AR FACE DETECTION
    FRONT OR REAR CAMERA
    ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ͸
    iPhoneͷϦΞΧϝϥ͕࢖ΘΕ·͢ɻ
    ▸ ͜Ε͸ϑϩϯτΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ
    ▸ Ͱ͖·ͤΜ
    

    View Slide

22. AR FACE DETECTION
    FRONT OR REAR CAMERA
    ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰ͸ɺ౰વTrue Depth Camera͕͋ΔϑϩϯτΧϝϥ
    ͷө૾͕࢖ΘΕ·͢ɻ
    ▸ ͜Ε͸ϦΞΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ
    ▸ Ͱ͖·ͤΜ
    

    View Slide

23. AR FACE DETECTIONTEXT
    FRONT OR REAR CAMERA
    ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓΋ΘΕ·͢
    ▸ World Tracking Configurationͷ৔߹ʹ͸ϦΞΧϝϥ
    ▸ Face Detection Configurationͷ৔߹ʹ͸ϑϩϯτΧϝϥ
    

    View Slide

24. AR FACE DETECTION
    FACE DETECTION SAMPLE CODE
    ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ΋
    ఏڙ͞Ε͍ͯ·͢ɻ
    ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢
    ͕……ɻ
    

    View Slide

25. AR FACE DETECTION
    DEPTH DATA IN ARFRAME
    

    View Slide

26. AR FACE DETECTION
    ·ͱΊ
    ▸ AR World Tracking/ AR Face Detection͸ͲͪΒ΋࣮૷͕ඇৗʹ؆୯
    ▸ AR Face Detection͸࣮ػͰ͔͠ࢼͤͳ͍
    ▸ iPhoneXཉ͍͠ʂ
    

    View Slide