Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ARKit4.pdf
Search
Tachibana Kaoru
July 10, 2020
1
2.2k
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
340
Custom Group Activities
toyship
3
1.4k
Synchronized iPhones, Again!
toyship
2
1.5k
Custom Gesture Recognizer on iOS
toyship
3
1.4k
HEVC Video with Alpha Channel
toyship
1
1.2k
RealityKit & Reality Composer
toyship
3
610
ARKit3
toyship
4
7.3k
UIViewPropertyAnimator and Easing
toyship
2
1.1k
Synchronized iPhones!
toyship
3
4.8k
Featured
See All Featured
The Pragmatic Product Professional
lauravandoore
36
6.9k
Code Reviewing Like a Champion
maltzj
525
40k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
23
1.4k
Imperfection Machines: The Place of Print at Facebook
scottboms
268
13k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
112
20k
Producing Creativity
orderedlist
PRO
347
40k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
46
7.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
840
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
252
21k
Designing for Performance
lara
610
69k
GraphQLの誤解/rethinking-graphql
sonatard
72
11k
Transcript
ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
About Me @TachibanaKaoru Freelance iOS Engineer
ARKit History
ARKit History ARKit iOS ver release main feature 1.0 11.0
2017/06 ۭؒݕɺฏ໘ʢਫฏ໘ʣݕɺإදݕ 1.5 11.3 2018/01 ฏ໘ʢਨ໘ݕʣɺը૾ݕ 2.0 12.0 2018/06 ը૾ݕϞʔυՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0
https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR
Depth with LiDAR Face Tracking
GeoAnchor
ARGeoAnchorͱ ҐஔʢҢ/ܦʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕MapใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐͷ3DใͱɺΧϝϥը૾͔Βੳͨ͠3D ใͱɺͷGPSใΛΈ߹ΘͤͨΈ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢΒͳ͍ํάά͍ͬͯͩ͘͞ʣ ʢ2009ɻࢥ͑ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾ΛͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨॴͰ͔͑͠ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍ॴʢApple Mapʹใ͕ͳ͍ॴʣͰ͑ͳ͍
Where can we use this? ݱ࣌ͰԼهͷॴͰ͚ͩ͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ͏গ͠Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌Ͱৄࡉෆ໌
How To Use // GeoTracking͕͑Δ͔Ͳ͏͔ௐΔ ARGeoTrackingConfiguration.checkAvailability { (available, error) in
if !available { // ʮ͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
without ARGeoAnchor... ARGeoAnchor ͷର۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠߹ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng ΛͬͯΈ·͠ΐ͏ɻ x͕࣠౦ɺy͕࣠ॏྗํɺz͕࣠ೆʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
Scene Geometry and Depth with LiDAR
LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔରͷछྨΛଌఆ͢Δ ηϯαʔ only on
latest iPad Pro
How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ࣹޫΛऩू
Scene detection with LiDAR LiDAR Ͱମ·Ͱͷڑ͓Αͼମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ఆՄೳͳମఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱମ·ͰͷڑͱछྨऔಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ͍͘͢ͳΓ·ͨ͠ɻ
App With LiDAR LiDARͷ Scene Detection Λͬͯɺମ·ͰͷڑͱछྨΛ͠Όͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3
m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Όͬͯڭ͑ͯ͘Ε·͢ɻ
Face Detection ࠓ·Ͱ TrueDepthΧϝϥࡌͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧͷίϯόʔλʔ 20201݄ ϦϦʔε
Reality Converter ࠓ·ͰίϚϯυϥΠϯ ͷ usdz มπʔϧ͋ͬͨͷ͚ͩͲɺखॱ͕ ͘͠ɺΤϥʔଟ͔ͬͨɻ Reality Converter
3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ͍͘͢ɺର ԠϑΥʔϚοτଟ͍ɻ
Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ·ͰRealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
None
Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗͰ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ָ͔ͭ͑ͳΜͩΖ͏͚Ͳɺͦ͜·ͰΔ͕࣌ؒͳ͍……ɻ
·ͱΊ Geo MarkerରԠҬ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓUSDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱָͯʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹઈର LiDAR ͕ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
͍͍Ͱ͢ʂ