Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AR Face Detection

Tachibana Kaoru
October 25, 2017
3.2k

AR Face Detection

Tachibana Kaoru

October 25, 2017
Tweet

Transcript

  1. AR FACE DETECTION
    @TACHIBANAKAORU
    2017/10/25

    View Slide

  2. AR FACE DETECTION
    ࣗݾ঺հ
    ▸ @TachibanaKaoru
    ▸ ϑϦʔϥϯε iOSΤϯδχΞ
    ▸ ϘϧμϦϯά͕޷͖Ͱɺ࠷ۙ͸ϦʔυΫϥΠϛ
    ϯά΋νϟϨϯδதɻ
    ▸ Blog : http://www.toyship.org/Kaoru

    View Slide

  3. ARKIT

    View Slide

  4. AR FACE DETECTIONTEXT
    ARKIT
    ▸ Augmented RealityΛ؆୯ʹ࣮૷͢ΔϑϨʔϜϫʔΫ
    ▸ iOS11͔Β঺հ͞Εͨ
    ▸ CPU͕A9Ҏ্ͷ୺຤Ͱར༻Մೳ

    View Slide

  5. AR FACE DETECTION
    ARKITͷಛ௃
    ▸ ࣮૷͕؆୯
    ▸ σόΠεͷՃ଎౓৘ใΛར༻
    ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ

    View Slide

  6. AR FACE DETECTION
    ARKITͷಛ௃
    ▸ ࣮૷͕؆୯
    ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ
    ʮAugmented Reality Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ
    ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ
    ▸ ࣗ෼Ͱ࣮૷͢Δ৔߹ʹ΋ɺARSCNViewͳͲͷΦϒδΣΫ
    τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ
    ϧɻ

    View Slide

  7. AR FACE DETECTION
    ARKITͷಛ௃
    ▸ σόΠεͷՃ଎౓৘ใͱΧϝϥը૾Λಉ࣌ʹղ
    ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬

    View Slide

  8. AR FACE DETECTION
    ARKITͷಛ௃
    ▸ ඳըΤϯδϯΛબ୒Ͱ͖Δ
    ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ
    ▸ Unity΍Unreal Engineʹ΋ରԠ

    View Slide

  9. AR FACE DETECTION
    ෆࢥٞͷࠃͷΞϦεAR

    View Slide

  10. AR FACE DETECTIONTEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ARSCNViewΛ࡞੒͠ɺWorld Tracking༻ͷConfiguretonΛઃఆ͢Δɻ
    ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ

    View Slide

  11. TEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ฏ໘ݕ஌͕onʹͳ͍ͬͯΔͱɺݕ஌ͨ͠৔߹ʹDelegateʹ௨஌͞ΕΔ

    View Slide

  12. AR FACE DETECTION
    ARKIT FACE DETECTION
    ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද
    ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ

    View Slide

  13. AR FACE DETECTION

    View Slide

  14. AR FACE DETECTIONTEXT
    IPHONEX SENSORS

    View Slide

  15. AR FACE DETECTIONTEXT

    View Slide

  16. AR FACE DETECTIONTEXT
    ʢը૾͸ΠϝʔδͰ͢ʣ

    View Slide

  17. AR FACE DETECTION
    AR FACE DETECTION
    ▸ True Depth CameraʹΑΓɺإͷਂ౓৘ใΛऔಘ͢Δ
    ▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛ൑ผՄೳ
    ▸ VisionϑϨʔϜϫʔΫͰ΋إύʔπͷೝࣝ͸Մೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ
    ͳ͍

    View Slide

  18. AR FACE DETECTION

    View Slide

  19. AR FACE DETECTIONTEXT
    AR WORLD TRACKING WITH ARKIT
    ▸ ARSCNViewΛ࡞੒͠ɺFace Detection༻ͷConfiguretonΛઃఆ͢Δɻ
    ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ

    View Slide

  20. AR FACE DETECTION
    FACE DETECTION
    ▸ إ͕ೝࣝ͞Εͨ࣌ʹ͸Delegateʹ௨஌͞ΕΔ

    View Slide

  21. AR FACE DETECTION
    FRONT OR REAR CAMERA
    ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ͸
    iPhoneͷϦΞΧϝϥ͕࢖ΘΕ·͢ɻ
    ▸ ͜Ε͸ϑϩϯτΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ
    ▸ Ͱ͖·ͤΜ

    View Slide

  22. AR FACE DETECTION
    FRONT OR REAR CAMERA
    ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰ͸ɺ౰વTrue Depth Camera͕͋ΔϑϩϯτΧϝϥ
    ͷө૾͕࢖ΘΕ·͢ɻ
    ▸ ͜Ε͸ϦΞΧϝϥʹม͑Δ͜ͱ͸Ͱ͖ΔͷͰ͠ΐ͏͔ʁ
    ▸ Ͱ͖·ͤΜ

    View Slide

  23. AR FACE DETECTIONTEXT
    FRONT OR REAR CAMERA
    ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓΋ΘΕ·͢
    ▸ World Tracking Configurationͷ৔߹ʹ͸ϦΞΧϝϥ
    ▸ Face Detection Configurationͷ৔߹ʹ͸ϑϩϯτΧϝϥ

    View Slide

  24. AR FACE DETECTION
    FACE DETECTION SAMPLE CODE
    ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ΋
    ఏڙ͞Ε͍ͯ·͢ɻ
    ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢
    ͕……ɻ

    View Slide

  25. AR FACE DETECTION
    DEPTH DATA IN ARFRAME

    View Slide

  26. AR FACE DETECTION
    ·ͱΊ
    ▸ AR World Tracking/ AR Face Detection͸ͲͪΒ΋࣮૷͕ඇৗʹ؆୯
    ▸ AR Face Detection͸࣮ػͰ͔͠ࢼͤͳ͍
    ▸ iPhoneXཉ͍͠ʂ

    View Slide