ARKit4.pdf

Transcript

1. ARKit4.0
   @TachibanaKaoru
   2020/7/10 #potatotips
   

   View Slide

2. About Me
   @TachibanaKaoru
   Freelance iOS Engineer
   

   View Slide

3. ARKit History
   

   View Slide

4. ARKit History
   ARKit iOS ver release main feature
   1.0 11.0 2017/06 ۭؒݕ஌ɺฏ໘ʢਫฏ໘ʣݕ஌ɺإද৘ݕ஌
   1.5 11.3 2018/01 ฏ໘ʢਨ௚໘ݕ஌ʣɺը૾ݕ஌
   2.0 12.0 2018/06
   ը૾ݕ஌Ϟʔυ௥ՃɺARঢ়ଶอଘରԠɺ
   Object SacnରԠɺࢹઢɾઉݕ஌
   3.0 13.0 2019/06 BodyScanɺPeople Occupation
   3.5 13.4 2020/03 scene detection with LiDAR
   4.0 14.0 2020/06 GeoAnchor
   

   View Slide

5. ARKit Information
   1.0 https://speakerdeck.com/toyship/ar-face-detection
   1.5 https://www.toyship.org/2018/01/26/115705
   2.0
   https://speakerdeck.com/toyship/arkit-2-dot-0
   https://www.toyship.org/2018/06/05/193435
   3.0 https://speakerdeck.com/toyship/arkit3
   3.5 https://www.toyship.org/2020/03/30/150924
   

   View Slide

6. What's new with ARKit4
   Geo Anchor
   Scene Geometry with LiDAR
   Depth with LiDAR
   Face Tracking
   

   View Slide

7. GeoAnchor
   

   View Slide

8. ARGeoAnchorͱ͸
   ҐஔʢҢ౓/ܦ౓ʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜
   ͱ͕Ͱ͖Δ
   Apple͕Map৘ใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ
   ͷݐ෺ͷ3D৘ใͱɺΧϝϥը૾͔Β෼ੳͨ͠3D
   ৘ใͱɺ୺຤ͷGPS৘ใΛ૊Έ߹Θͤͨ࢓૊Έ
   ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
   

   View Slide

9. Why Geo Anchor?
   Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ
   Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ
   ʢ஌Βͳ͍ํ͸άά͍ͬͯͩ͘͞ʣ
   ʢ2009೥ɻࢥ͑͹ૣ͗͢·ͨ͠……ɻʣ
   ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮૷Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
   

   View Slide

10. Pros and Cons
    Pros
    GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ
    Χϝϥͷө૾Λ࢖ͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ
    Cons
    ݶΒΕͨ৔ॴͰ͔͠࢖͑ͳ͍ɻ
    ಓ࿏͔Βݟ͑ͳ͍৔ॴʢApple Mapʹ৘ใ͕ͳ͍৔ॴʣͰ͸࢖͑ͳ͍
    

    View Slide

11. Where can we use this?
    ݱ࣌఺Ͱ͸Լهͷ৔ॴͰ͚ͩ࢖͑·͢
    αϯϑϥϯγείɺγΧΰɺϚΠΞϛ
    χϡʔϤʔΫɺϩαϯθϧε
    Նʹ΋͏গ͠௥Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌఺Ͱ͸ৄࡉ͸ෆ໌
    

    View Slide

12. How To Use
    // GeoTracking͕࢖͑Δ͔Ͳ͏͔ௐ΂Δ
    ARGeoTrackingConfiguration.checkAvailability { (available, error) in
    if !available {
    // ʮ࢖͑·ͤΜʯදࣔΛ͢Δɻ
    }
    }
    // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ
    arView.session.run( ARGeoTrackingConfiguration() )
    

    View Slide

13. without ARGeoAnchor...
    ARGeoAnchor ͷର৅۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ
    ͍ͨ͠৔߹͸ɺ
    ARConfiguration.WorldAlignment.gravityAndHeadi
    ng Λ࢖ͬͯΈ·͠ΐ͏ɻ
    x͕࣠౦੢ɺy͕࣠ॏྗํ޲ɺz͕࣠ೆ๺ʹݻఆ͞
    Εͨঢ়ଶͱͳΓ·͢ɻ
    

    View Slide

14. Scene Geometry and Depth with
    LiDAR
    

    View Slide

15. LiDAR
    Light Detection and Ranging
    ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ
    ࢄཚޫ͔ΒҐஔ΍ର৅෺ͷछྨΛଌఆ͢Δ
    ηϯαʔ
    only on latest iPad Pro
    

    View Slide

16. How LiDAR works
    ηϯαʔ͔ΒޫΛরࣹ
    ൓ࣹޫΛऩू
    

    View Slide

17. Scene detection with LiDAR
    LiDAR Ͱ෺ମ·Ͱͷڑ཭͓Αͼ෺ମͷछྨ͕Θ
    ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ
    ൑ఆՄೳͳ෺ମ͸ఱҪɺυΞɺচɺҜࢠɺςʔ
    ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
    

    View Slide

18. Depth and scene detection with LiDAR
    ͍··ͰͷARKit 3.5Ͱ΋෺ମ·Ͱͷڑ཭ͱछྨ͸औಘͰ͖ͨͷͰ͕͢ɺ
    ARKit4ͰAPI͕ଟগ࢖͍΍͘͢ͳΓ·ͨ͠ɻ
    

    View Slide

19. App With LiDAR
    LiDARͷ Scene Detection Λ࢖ͬͯɺ෺ମ·Ͱͷڑ཭ͱछྨΛ͠Ό΂ͬͯ
    ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒ࢖ͬͯΈ͍ͯͩ͘͞ɻ
    https://apps.apple.com/jp/app/whatsoverthere/id1505077334
    ʮ3 m ઌʹ૭͕͋Γ·͢ʯͳͲͱ
    ͠Ό΂ͬͯڭ͑ͯ͘Ε·͢ɻ
    

    View Slide

20. Face Detection
    ࠓ·Ͱ͸ TrueDepthΧϝϥ౥ࡌ୺຤ͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο
    αʔͰ࢖͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
    

    View Slide

21. Reality Converter
    ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ
    Πϧ΁ͷίϯόʔλʔ
    2020೥1݄ ϦϦʔε
    

    View Slide

22. Reality Converter
    ࠓ·Ͱ΋ίϚϯυϥΠϯ ͷ usdz ม׵πʔϧ͸͋ͬͨͷ͚ͩͲɺखॱ͕
    ೉͘͠ɺΤϥʔ΋ଟ͔ͬͨɻ
    Reality Converter ͸ 3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ࢖͍΍͘͢ɺର
    ԠϑΥʔϚοτ΋ଟ͍ɻ
    

    View Slide

23. Reality Composer
    USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ
    ʢڈ೥·Ͱ͸RealityϑΝΠϧ͔͠ग़ྗͰ͖·
    ͤΜͰͨ͠ɻʣ
    

    View Slide

24. View Slide

25. Reality Composer and Converter
    ͜Μͳํʹ͓͢͢ΊͰ͢
    ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ
    3DϞσϧΛࣗ෼Ͱ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ
    Unity ͔ͭ͑͹ָͳΜͩΖ͏͚Ͳɺͦ͜·Ͱ΍Δ͕࣌ؒͳ͍……ɻ
    

    View Slide

26. ·ͱΊ
    Geo Marker͸ରԠ஍Ҭ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ
    ࠓ೥͸USDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱͯ΋ָʹͳΓ·ͨ͠ɻ
    ࣍ͷ iPhone ʹ͸ઈର LiDAR ͕౥ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
    ΋͍͍Ͱ͢ʂ
    

    View Slide