ARKit4.pdf - Speaker Deck

ARKit4.pdf

by Tachibana Kaoru

Slide 1

Slide 1 text

ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips

Slide 2

Slide 2 text

About Me @TachibanaKaoru Freelance iOS Engineer

Slide 3

Slide 3 text

ARKit History

Slide 4

Slide 4 text

ARKit History ARKit iOS ver release main feature 1.0 11.0 2017/06 ۭؒݕ஌ɺฏ໘ʢਫฏ໘ʣݕ஌ɺإද৘ݕ஌ 1.5 11.3 2018/01 ฏ໘ʢਨ௚໘ݕ஌ʣɺը૾ݕ஌ 2.0 12.0 2018/06 ը૾ݕ஌Ϟʔυ௥ՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ஌ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor

Slide 5

Slide 5 text

ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0 https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924

Slide 6

Slide 6 text

What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR Depth with LiDAR Face Tracking

Slide 7

Slide 7 text

GeoAnchor

Slide 8

Slide 8 text

ARGeoAnchorͱ͸ ҐஔʢҢ౓/ܦ౓ʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕Map৘ใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐ෺ͷ3D৘ใͱɺΧϝϥը૾͔Β෼ੳͨ͠3D ৘ใͱɺ୺຤ͷGPS৘ใΛ૊Έ߹Θͤͨ࢓૊Έ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ

Slide 9

Slide 9 text

Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢ஌Βͳ͍ํ͸άά͍ͬͯͩ͘͞ʣ ʢ2009೥ɻࢥ͑͹ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮૷Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ

Slide 10

Slide 10 text

Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾Λ࢖ͬͨҐஔಛఆΑΓߴ͍ਫ਼౓ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨ৔ॴͰ͔͠࢖͑ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍৔ॴʢApple Mapʹ৘ใ͕ͳ͍৔ॴʣͰ͸࢖͑ͳ͍

Slide 11

Slide 11 text

Where can we use this? ݱ࣌఺Ͱ͸Լهͷ৔ॴͰ͚ͩ࢖͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ΋͏গ͠௥Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌఺Ͱ͸ৄࡉ͸ෆ໌

Slide 12

Slide 12 text

How To Use // GeoTracking͕࢖͑Δ͔Ͳ͏͔ௐ΂Δ ARGeoTrackingConfiguration.checkAvailability { (available, error) in if !available { // ʮ࢖͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )

Slide 13

Slide 13 text

without ARGeoAnchor... ARGeoAnchor ͷର৅۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠৔߹͸ɺ ARConﬁguration.WorldAlignment.gravityAndHeadi ng Λ࢖ͬͯΈ·͠ΐ͏ɻ x͕࣠౦੢ɺy͕࣠ॏྗํ޲ɺz͕࣠ೆ๺ʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ

Slide 14

Slide 14 text

Scene Geometry and Depth with LiDAR

Slide 15

Slide 15 text

LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔ΍ର৅෺ͷछྨΛଌఆ͢Δ ηϯαʔ only on latest iPad Pro

Slide 16

Slide 16 text

How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ൓ࣹޫΛऩू

Slide 17

Slide 17 text

Scene detection with LiDAR LiDAR Ͱ෺ମ·Ͱͷڑ཭͓Αͼ෺ମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ൑ఆՄೳͳ෺ମ͸ఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ

Slide 18

Slide 18 text

Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱ΋෺ମ·Ͱͷڑ཭ͱछྨ͸औಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ࢖͍΍͘͢ͳΓ·ͨ͠ɻ

Slide 19

Slide 19 text

App With LiDAR LiDARͷ Scene Detection Λ࢖ͬͯɺ෺ମ·Ͱͷڑ཭ͱछྨΛ͠Ό΂ͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒ࢖ͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3 m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Ό΂ͬͯڭ͑ͯ͘Ε·͢ɻ

Slide 20

Slide 20 text

Face Detection ࠓ·Ͱ͸ TrueDepthΧϝϥ౥ࡌ୺຤ͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ࢖͑ΔΑ͏ʹͳΓ·ͨ͠ɻ

Slide 21

Slide 21 text

Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧ΁ͷίϯόʔλʔ 2020೥1݄ ϦϦʔε

Slide 22

Slide 22 text

Reality Converter ࠓ·Ͱ΋ίϚϯυϥΠϯ ͷ usdz ม׵πʔϧ͸͋ͬͨͷ͚ͩͲɺखॱ͕ ೉͘͠ɺΤϥʔ΋ଟ͔ͬͨɻ Reality Converter ͸ 3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ࢖͍΍͘͢ɺର ԠϑΥʔϚοτ΋ଟ͍ɻ

Slide 23

Slide 23 text

Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ೥·Ͱ͸RealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ

Slide 24

Slide 24 text

No content

Slide 25

Slide 25 text

Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗ෼Ͱ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ͔ͭ͑͹ָͳΜͩΖ͏͚Ͳɺͦ͜·Ͱ΍Δ͕࣌ؒͳ͍……ɻ

Slide 26

Slide 26 text

·ͱΊ Geo Marker͸ରԠ஍Ҭ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓ೥͸USDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱͯ΋ָʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹ͸ઈର LiDAR ͕౥ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ ΋͍͍Ͱ͢ʂ