Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ARKit4.pdf
Search
Tachibana Kaoru
July 10, 2020
1
2k
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
250
Custom Group Activities
toyship
3
1.2k
Synchronized iPhones, Again!
toyship
2
1.3k
Custom Gesture Recognizer on iOS
toyship
3
1.1k
HEVC Video with Alpha Channel
toyship
1
990
RealityKit & Reality Composer
toyship
3
410
ARKit3
toyship
5
6.8k
UIViewPropertyAnimator and Easing
toyship
2
820
Synchronized iPhones!
toyship
3
4.2k
Featured
See All Featured
GraphQLとの向き合い方2022年版
quramy
32
12k
How STYLIGHT went responsive
nonsquared
92
4.8k
Designing for Performance
lara
601
67k
Reflections from 52 weeks, 52 projects
jeffersonlam
345
19k
WebSockets: Embracing the real-time Web
robhawkes
59
7k
Robots, Beer and Maslow
schacon
PRO
155
7.9k
The Invisible Customer
myddelton
114
12k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
155
14k
How to train your dragon (web standard)
notwaldorf
73
5.2k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
40
4.4k
The Cost Of JavaScript in 2023
addyosmani
16
3.8k
Designing on Purpose - Digital PM Summit 2013
jponch
110
6.5k
Transcript
ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
About Me @TachibanaKaoru Freelance iOS Engineer
ARKit History
ARKit History ARKit iOS ver release main feature 1.0 11.0
2017/06 ۭؒݕɺฏ໘ʢਫฏ໘ʣݕɺإදݕ 1.5 11.3 2018/01 ฏ໘ʢਨ໘ݕʣɺը૾ݕ 2.0 12.0 2018/06 ը૾ݕϞʔυՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0
https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR
Depth with LiDAR Face Tracking
GeoAnchor
ARGeoAnchorͱ ҐஔʢҢ/ܦʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕MapใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐͷ3DใͱɺΧϝϥը૾͔Βੳͨ͠3D ใͱɺͷGPSใΛΈ߹ΘͤͨΈ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢΒͳ͍ํάά͍ͬͯͩ͘͞ʣ ʢ2009ɻࢥ͑ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾ΛͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨॴͰ͔͑͠ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍ॴʢApple Mapʹใ͕ͳ͍ॴʣͰ͑ͳ͍
Where can we use this? ݱ࣌ͰԼهͷॴͰ͚ͩ͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ͏গ͠Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌Ͱৄࡉෆ໌
How To Use // GeoTracking͕͑Δ͔Ͳ͏͔ௐΔ ARGeoTrackingConfiguration.checkAvailability { (available, error) in
if !available { // ʮ͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
without ARGeoAnchor... ARGeoAnchor ͷର۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠߹ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng ΛͬͯΈ·͠ΐ͏ɻ x͕࣠౦ɺy͕࣠ॏྗํɺz͕࣠ೆʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
Scene Geometry and Depth with LiDAR
LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔରͷछྨΛଌఆ͢Δ ηϯαʔ only on
latest iPad Pro
How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ࣹޫΛऩू
Scene detection with LiDAR LiDAR Ͱମ·Ͱͷڑ͓Αͼମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ఆՄೳͳମఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱମ·ͰͷڑͱछྨऔಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ͍͘͢ͳΓ·ͨ͠ɻ
App With LiDAR LiDARͷ Scene Detection Λͬͯɺମ·ͰͷڑͱछྨΛ͠Όͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3
m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Όͬͯڭ͑ͯ͘Ε·͢ɻ
Face Detection ࠓ·Ͱ TrueDepthΧϝϥࡌͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧͷίϯόʔλʔ 20201݄ ϦϦʔε
Reality Converter ࠓ·ͰίϚϯυϥΠϯ ͷ usdz มπʔϧ͋ͬͨͷ͚ͩͲɺखॱ͕ ͘͠ɺΤϥʔଟ͔ͬͨɻ Reality Converter
3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ͍͘͢ɺର ԠϑΥʔϚοτଟ͍ɻ
Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ·ͰRealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
None
Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗͰ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ָ͔ͭ͑ͳΜͩΖ͏͚Ͳɺͦ͜·ͰΔ͕࣌ؒͳ͍……ɻ
·ͱΊ Geo MarkerରԠҬ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓUSDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱָͯʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹઈର LiDAR ͕ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
͍͍Ͱ͢ʂ