Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
1
1.3k
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
Custom Group Activities
toyship
3
630
Synchronized iPhones, Again!
toyship
2
920
Custom Gesture Recognizer on iOS
toyship
3
840
HEVC Video with Alpha Channel
toyship
1
640
RealityKit & Reality Composer
toyship
3
290
ARKit3
toyship
5
6.2k
UIViewPropertyAnimator and Easing
toyship
2
620
Synchronized iPhones!
toyship
3
3.4k
How to Manage Edge Gestures
toyship
1
1.3k
Featured
See All Featured
Designing with Data
zakiwarfel
91
3.9k
VelocityConf: Rendering Performance Case Studies
addyosmani
316
22k
Mobile First: as difficult as doing things right
swwweet
212
7.5k
A better future with KSS
kneath
225
15k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
268
11k
Why Our Code Smells
bkeepers
PRO
324
54k
Designing Experiences People Love
moore
130
22k
Music & Morning Musume
bryan
35
4.1k
Making the Leap to Tech Lead
cromwellryan
113
6.9k
What the flash - Photography Introduction
edds
61
9.9k
Docker and Python
trallard
27
1.5k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
7
1k
Transcript
ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
About Me @TachibanaKaoru Freelance iOS Engineer
ARKit History
ARKit History ARKit iOS ver release main feature 1.0 11.0
2017/06 ۭؒݕɺฏ໘ʢਫฏ໘ʣݕɺإදݕ 1.5 11.3 2018/01 ฏ໘ʢਨ໘ݕʣɺը૾ݕ 2.0 12.0 2018/06 ը૾ݕϞʔυՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0
https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR
Depth with LiDAR Face Tracking
GeoAnchor
ARGeoAnchorͱ ҐஔʢҢ/ܦʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕MapใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐͷ3DใͱɺΧϝϥը૾͔Βੳͨ͠3D ใͱɺͷGPSใΛΈ߹ΘͤͨΈ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢΒͳ͍ํάά͍ͬͯͩ͘͞ʣ ʢ2009ɻࢥ͑ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾ΛͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨॴͰ͔͑͠ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍ॴʢApple Mapʹใ͕ͳ͍ॴʣͰ͑ͳ͍
Where can we use this? ݱ࣌ͰԼهͷॴͰ͚ͩ͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ͏গ͠Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌Ͱৄࡉෆ໌
How To Use // GeoTracking͕͑Δ͔Ͳ͏͔ௐΔ ARGeoTrackingConfiguration.checkAvailability { (available, error) in
if !available { // ʮ͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
without ARGeoAnchor... ARGeoAnchor ͷର۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠߹ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng ΛͬͯΈ·͠ΐ͏ɻ x͕࣠౦ɺy͕࣠ॏྗํɺz͕࣠ೆʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
Scene Geometry and Depth with LiDAR
LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔରͷछྨΛଌఆ͢Δ ηϯαʔ only on
latest iPad Pro
How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ࣹޫΛऩू
Scene detection with LiDAR LiDAR Ͱମ·Ͱͷڑ͓Αͼମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ఆՄೳͳମఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱମ·ͰͷڑͱछྨऔಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ͍͘͢ͳΓ·ͨ͠ɻ
App With LiDAR LiDARͷ Scene Detection Λͬͯɺମ·ͰͷڑͱछྨΛ͠Όͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3
m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Όͬͯڭ͑ͯ͘Ε·͢ɻ
Face Detection ࠓ·Ͱ TrueDepthΧϝϥࡌͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧͷίϯόʔλʔ 20201݄ ϦϦʔε
Reality Converter ࠓ·ͰίϚϯυϥΠϯ ͷ usdz มπʔϧ͋ͬͨͷ͚ͩͲɺखॱ͕ ͘͠ɺΤϥʔଟ͔ͬͨɻ Reality Converter
3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ͍͘͢ɺର ԠϑΥʔϚοτଟ͍ɻ
Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ·ͰRealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
None
Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗͰ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ָ͔ͭ͑ͳΜͩΖ͏͚Ͳɺͦ͜·ͰΔ͕࣌ؒͳ͍……ɻ
·ͱΊ Geo MarkerରԠҬ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓUSDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱָͯʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹઈର LiDAR ͕ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
͍͍Ͱ͢ʂ