ARKit4.pdf

Transcript

1. ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips

2. About Me @TachibanaKaoru Freelance iOS Engineer

3. ARKit History

4. ARKit History ARKit iOS ver release main feature 1.0 11.0

   2017/06 ۭؒݕ஌ɺฏ໘ʢਫฏ໘ʣݕ஌ɺإද৘ݕ஌ 1.5 11.3 2018/01 ฏ໘ʢਨ௚໘ݕ஌ʣɺը૾ݕ஌ 2.0 12.0 2018/06 ը૾ݕ஌Ϟʔυ௥ՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ஌ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor

5. ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0

   https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924

6. What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR

   Depth with LiDAR Face Tracking

7. GeoAnchor

8. ARGeoAnchorͱ͸ ҐஔʢҢ౓/ܦ౓ʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕Map৘ใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐ෺ͷ3D৘ใͱɺΧϝϥը૾͔Β෼ੳͨ͠3D ৘ใͱɺ୺຤ͷGPS৘ใΛ૊Έ߹Θͤͨ࢓૊Έ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ

9. Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢ஌Βͳ͍ํ͸άά͍ͬͯͩ͘͞ʣ ʢ2009೥ɻࢥ͑͹ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮૷Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ

10. Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾Λ࢖ͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨ৔ॴͰ͔͠࢖͑ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍৔ॴʢApple Mapʹ৘ใ͕ͳ͍৔ॴʣͰ͸࢖͑ͳ͍

11. Where can we use this? ݱ࣌఺Ͱ͸Լهͷ৔ॴͰ͚ͩ࢖͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ΋͏গ͠௥Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌఺Ͱ͸ৄࡉ͸ෆ໌

12. How To Use // GeoTracking͕࢖͑Δ͔Ͳ͏͔ௐ΂Δ ARGeoTrackingConfiguration.checkAvailability { (available, error) in

    if !available { // ʮ࢖͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )

13. without ARGeoAnchor... ARGeoAnchor ͷର৅۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠৔߹͸ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng Λ࢖ͬͯΈ·͠ΐ͏ɻ x͕࣠౦੢ɺy͕࣠ॏྗํ޲ɺz͕࣠ೆ๺ʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ

14. Scene Geometry and Depth with LiDAR

15. LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔ΍ର৅෺ͷछྨΛଌఆ͢Δ ηϯαʔ only on

    latest iPad Pro

16. How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ൓ࣹޫΛऩू

17. Scene detection with LiDAR LiDAR Ͱ෺ମ·Ͱͷڑ཭͓Αͼ෺ମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ൑ఆՄೳͳ෺ମ͸ఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ

18. Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱ΋෺ମ·Ͱͷڑ཭ͱछྨ͸औಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ࢖͍΍͘͢ͳΓ·ͨ͠ɻ

19. App With LiDAR LiDARͷ Scene Detection Λ࢖ͬͯɺ෺ମ·Ͱͷڑ཭ͱछྨΛ͠Ό΂ͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒ࢖ͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3

    m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Ό΂ͬͯڭ͑ͯ͘Ε·͢ɻ

20. Face Detection ࠓ·Ͱ͸ TrueDepthΧϝϥ౥ࡌ୺຤ͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ࢖͑ΔΑ͏ʹͳΓ·ͨ͠ɻ

21. Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧ΁ͷίϯόʔλʔ 2020೥1݄ ϦϦʔε

22. Reality Converter ࠓ·Ͱ΋ίϚϯυϥΠϯ ͷ usdz ม׵πʔϧ͸͋ͬͨͷ͚ͩͲɺखॱ͕ ೉͘͠ɺΤϥʔ΋ଟ͔ͬͨɻ Reality Converter ͸

    3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ࢖͍΍͘͢ɺର ԠϑΥʔϚοτ΋ଟ͍ɻ

23. Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ೥·Ͱ͸RealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ

24. None

25. Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗ෼Ͱ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ͔ͭ͑͹ָͳΜͩΖ͏͚Ͳɺͦ͜·Ͱ΍Δ͕࣌ؒͳ͍……ɻ

26. ·ͱΊ Geo Marker͸ରԠ஍Ҭ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓ೥͸USDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱͯ΋ָʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹ͸ઈର LiDAR ͕౥ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ

    ΋͍͍Ͱ͢ʂ