Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ARKit4.pdf

Tachibana Kaoru
July 10, 2020
1.9k

 ARKit4.pdf

Tachibana Kaoru

July 10, 2020
Tweet

Transcript

  1. ARKit4.0
    @TachibanaKaoru
    2020/7/10 #potatotips

    View Slide

  2. About Me
    @TachibanaKaoru
    Freelance iOS Engineer

    View Slide

  3. ARKit History

    View Slide

  4. ARKit History
    ARKit iOS ver release main feature
    1.0 11.0 2017/06 ۭؒݕ஌ɺฏ໘ʢਫฏ໘ʣݕ஌ɺإද৘ݕ஌
    1.5 11.3 2018/01 ฏ໘ʢਨ௚໘ݕ஌ʣɺը૾ݕ஌
    2.0 12.0 2018/06
    ը૾ݕ஌Ϟʔυ௥ՃɺARঢ়ଶอଘରԠɺ
    Object SacnରԠɺࢹઢɾઉݕ஌
    3.0 13.0 2019/06 BodyScanɺPeople Occupation
    3.5 13.4 2020/03 scene detection with LiDAR
    4.0 14.0 2020/06 GeoAnchor

    View Slide

  5. ARKit Information
    1.0 https://speakerdeck.com/toyship/ar-face-detection
    1.5 https://www.toyship.org/2018/01/26/115705
    2.0
    https://speakerdeck.com/toyship/arkit-2-dot-0
    https://www.toyship.org/2018/06/05/193435
    3.0 https://speakerdeck.com/toyship/arkit3
    3.5 https://www.toyship.org/2020/03/30/150924

    View Slide

  6. What's new with ARKit4
    Geo Anchor
    Scene Geometry with LiDAR
    Depth with LiDAR
    Face Tracking

    View Slide

  7. GeoAnchor

    View Slide

  8. ARGeoAnchorͱ͸
    ҐஔʢҢ౓/ܦ౓ʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜
    ͱ͕Ͱ͖Δ
    Apple͕Map৘ใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ
    ͷݐ෺ͷ3D৘ใͱɺΧϝϥը૾͔Β෼ੳͨ͠3D
    ৘ใͱɺ୺຤ͷGPS৘ใΛ૊Έ߹Θͤͨ࢓૊Έ
    ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ

    View Slide

  9. Why Geo Anchor?
    Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ
    Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ
    ʢ஌Βͳ͍ํ͸άά͍ͬͯͩ͘͞ʣ
    ʢ2009೥ɻࢥ͑͹ૣ͗͢·ͨ͠……ɻʣ
    ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮૷Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ

    View Slide

  10. Pros and Cons
    Pros
    GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ
    Χϝϥͷө૾Λ࢖ͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ
    Cons
    ݶΒΕͨ৔ॴͰ͔͠࢖͑ͳ͍ɻ
    ಓ࿏͔Βݟ͑ͳ͍৔ॴʢApple Mapʹ৘ใ͕ͳ͍৔ॴʣͰ͸࢖͑ͳ͍

    View Slide

  11. Where can we use this?
    ݱ࣌఺Ͱ͸Լهͷ৔ॴͰ͚ͩ࢖͑·͢
    αϯϑϥϯγείɺγΧΰɺϚΠΞϛ
    χϡʔϤʔΫɺϩαϯθϧε
    Նʹ΋͏গ͠௥Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌఺Ͱ͸ৄࡉ͸ෆ໌

    View Slide

  12. How To Use
    // GeoTracking͕࢖͑Δ͔Ͳ͏͔ௐ΂Δ
    ARGeoTrackingConfiguration.checkAvailability { (available, error) in
    if !available {
    // ʮ࢖͑·ͤΜʯදࣔΛ͢Δɻ
    }
    }
    // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ
    arView.session.run( ARGeoTrackingConfiguration() )

    View Slide

  13. without ARGeoAnchor...
    ARGeoAnchor ͷର৅۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ
    ͍ͨ͠৔߹͸ɺ
    ARConfiguration.WorldAlignment.gravityAndHeadi
    ng Λ࢖ͬͯΈ·͠ΐ͏ɻ
    x͕࣠౦੢ɺy͕࣠ॏྗํ޲ɺz͕࣠ೆ๺ʹݻఆ͞
    Εͨঢ়ଶͱͳΓ·͢ɻ

    View Slide

  14. Scene Geometry and Depth with
    LiDAR

    View Slide

  15. LiDAR
    Light Detection and Ranging
    ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ
    ࢄཚޫ͔ΒҐஔ΍ର৅෺ͷछྨΛଌఆ͢Δ
    ηϯαʔ
    only on latest iPad Pro

    View Slide

  16. How LiDAR works
    ηϯαʔ͔ΒޫΛরࣹ
    ൓ࣹޫΛऩू

    View Slide

  17. Scene detection with LiDAR
    LiDAR Ͱ෺ମ·Ͱͷڑ཭͓Αͼ෺ମͷछྨ͕Θ
    ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ
    ൑ఆՄೳͳ෺ମ͸ఱҪɺυΞɺচɺҜࢠɺςʔ
    ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ

    View Slide

  18. Depth and scene detection with LiDAR
    ͍··ͰͷARKit 3.5Ͱ΋෺ମ·Ͱͷڑ཭ͱछྨ͸औಘͰ͖ͨͷͰ͕͢ɺ
    ARKit4ͰAPI͕ଟগ࢖͍΍͘͢ͳΓ·ͨ͠ɻ

    View Slide

  19. App With LiDAR
    LiDARͷ Scene Detection Λ࢖ͬͯɺ෺ମ·Ͱͷڑ཭ͱछྨΛ͠Ό΂ͬͯ
    ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒ࢖ͬͯΈ͍ͯͩ͘͞ɻ
    https://apps.apple.com/jp/app/whatsoverthere/id1505077334
    ʮ3 m ઌʹ૭͕͋Γ·͢ʯͳͲͱ
    ͠Ό΂ͬͯڭ͑ͯ͘Ε·͢ɻ

    View Slide

  20. Face Detection
    ࠓ·Ͱ͸ TrueDepthΧϝϥ౥ࡌ୺຤ͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο
    αʔͰ࢖͑ΔΑ͏ʹͳΓ·ͨ͠ɻ

    View Slide

  21. Reality Converter
    ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ
    Πϧ΁ͷίϯόʔλʔ
    2020೥1݄ ϦϦʔε

    View Slide

  22. Reality Converter
    ࠓ·Ͱ΋ίϚϯυϥΠϯ ͷ usdz ม׵πʔϧ͸͋ͬͨͷ͚ͩͲɺखॱ͕
    ೉͘͠ɺΤϥʔ΋ଟ͔ͬͨɻ
    Reality Converter ͸ 3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ࢖͍΍͘͢ɺର
    ԠϑΥʔϚοτ΋ଟ͍ɻ

    View Slide

  23. Reality Composer
    USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ
    ʢڈ೥·Ͱ͸RealityϑΝΠϧ͔͠ग़ྗͰ͖·
    ͤΜͰͨ͠ɻʣ

    View Slide

  24. View Slide

  25. Reality Composer and Converter
    ͜Μͳํʹ͓͢͢ΊͰ͢
    ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ
    3DϞσϧΛࣗ෼Ͱ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ
    Unity ͔ͭ͑͹ָͳΜͩΖ͏͚Ͳɺͦ͜·Ͱ΍Δ͕࣌ؒͳ͍……ɻ

    View Slide

  26. ·ͱΊ
    Geo Marker͸ରԠ஍Ҭ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ
    ࠓ೥͸USDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱͯ΋ָʹͳΓ·ͨ͠ɻ
    ࣍ͷ iPhone ʹ͸ઈର LiDAR ͕౥ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
    ΋͍͍Ͱ͢ʂ

    View Slide