ARKit4.pdf

Transcript

1. ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
2. About Me @TachibanaKaoru Freelance iOS Engineer
3. ARKit History
4. ARKit History ARKit iOS ver release main feature 1.0 11.0 2017/06 ۭؒݕ஌ɺฏ໘ʢਫฏ໘ʣݕ஌ɺإද৘ݕ஌ 1.5 11.3 2018/01 ฏ໘ʢਨ௚໘ݕ஌ʣɺը૾ݕ஌ 2.0 12.0 2018/06 ը૾ݕ஌Ϟʔυ௥ՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ஌ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
5. ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0 https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
6. What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR Depth with LiDAR Face Tracking
7. GeoAnchor
8. ARGeoAnchorͱ͸ ҐஔʢҢ౓/ܦ౓ʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕Map৘ใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐ෺ͷ3D৘ใͱɺΧϝϥը૾͔Β෼ੳͨ͠3D ৘ใͱɺ୺຤ͷGPS৘ใΛ૊Έ߹Θͤͨ࢓૊Έ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
9. Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢ஌Βͳ͍ํ͸άά͍ͬͯͩ͘͞ʣ ʢ2009೥ɻࢥ͑͹ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮૷Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
10. Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾Λ࢖ͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨ৔ॴͰ͔͠࢖͑ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍৔ॴʢApple Mapʹ৘ใ͕ͳ͍৔ॴʣͰ͸࢖͑ͳ͍
11. Where can we use this? ݱ࣌఺Ͱ͸Լهͷ৔ॴͰ͚ͩ࢖͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ΋͏গ͠௥Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌఺Ͱ͸ৄࡉ͸ෆ໌
12. How To Use // GeoTracking͕࢖͑Δ͔Ͳ͏͔ௐ΂Δ ARGeoTrackingConfiguration.checkAvailability { (available, error) in if !available { // ʮ࢖͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
13. without ARGeoAnchor... ARGeoAnchor ͷର৅۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠৔߹͸ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng Λ࢖ͬͯΈ·͠ΐ͏ɻ x͕࣠౦੢ɺy͕࣠ॏྗํ޲ɺz͕࣠ೆ๺ʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
14. Scene Geometry and Depth with LiDAR
15. LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔ΍ର৅෺ͷछྨΛଌఆ͢Δ ηϯαʔ only on latest iPad Pro
16. How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ൓ࣹޫΛऩू
17. Scene detection with LiDAR LiDAR Ͱ෺ମ·Ͱͷڑ཭͓Αͼ෺ମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ൑ఆՄೳͳ෺ମ͸ఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
18. Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱ΋෺ମ·Ͱͷڑ཭ͱछྨ͸औಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ࢖͍΍͘͢ͳΓ·ͨ͠ɻ
19. App With LiDAR LiDARͷ Scene Detection Λ࢖ͬͯɺ෺ମ·Ͱͷڑ཭ͱछྨΛ͠Ό΂ͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒ࢖ͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3 m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Ό΂ͬͯڭ͑ͯ͘Ε·͢ɻ
20. Face Detection ࠓ·Ͱ͸ TrueDepthΧϝϥ౥ࡌ୺຤ͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ࢖͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
21. Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧ΁ͷίϯόʔλʔ 2020೥1݄ ϦϦʔε
22. Reality Converter ࠓ·Ͱ΋ίϚϯυϥΠϯ ͷ usdz ม׵πʔϧ͸͋ͬͨͷ͚ͩͲɺखॱ͕ ೉͘͠ɺΤϥʔ΋ଟ͔ͬͨɻ Reality Converter ͸ 3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ࢖͍΍͘͢ɺର ԠϑΥʔϚοτ΋ଟ͍ɻ
23. Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ೥·Ͱ͸RealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
25. Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗ෼Ͱ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ͔ͭ͑͹ָͳΜͩΖ͏͚Ͳɺͦ͜·Ͱ΍Δ͕࣌ؒͳ͍……ɻ
26. ·ͱΊ Geo Marker͸ରԠ஍Ҭ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓ೥͸USDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱͯ΋ָʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹ͸ઈର LiDAR ͕౥ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ ΋͍͍Ͱ͢ʂ