Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ARKit4.pdf
Search
Tachibana Kaoru
July 10, 2020
1
2.2k
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
330
Custom Group Activities
toyship
3
1.4k
Synchronized iPhones, Again!
toyship
2
1.5k
Custom Gesture Recognizer on iOS
toyship
3
1.3k
HEVC Video with Alpha Channel
toyship
1
1.2k
RealityKit & Reality Composer
toyship
3
590
ARKit3
toyship
4
7.3k
UIViewPropertyAnimator and Easing
toyship
2
1.1k
Synchronized iPhones!
toyship
3
4.7k
Featured
See All Featured
Statistics for Hackers
jakevdp
799
220k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.2k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
VelocityConf: Rendering Performance Case Studies
addyosmani
331
24k
Art, The Web, and Tiny UX
lynnandtonic
299
21k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
252
21k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
The Cult of Friendly URLs
andyhume
79
6.5k
The Power of CSS Pseudo Elements
geoffreycrofte
77
5.8k
Done Done
chrislema
184
16k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
How to train your dragon (web standard)
notwaldorf
94
6.1k
Transcript
ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
About Me @TachibanaKaoru Freelance iOS Engineer
ARKit History
ARKit History ARKit iOS ver release main feature 1.0 11.0
2017/06 ۭؒݕɺฏ໘ʢਫฏ໘ʣݕɺإදݕ 1.5 11.3 2018/01 ฏ໘ʢਨ໘ݕʣɺը૾ݕ 2.0 12.0 2018/06 ը૾ݕϞʔυՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0
https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR
Depth with LiDAR Face Tracking
GeoAnchor
ARGeoAnchorͱ ҐஔʢҢ/ܦʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕MapใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐͷ3DใͱɺΧϝϥը૾͔Βੳͨ͠3D ใͱɺͷGPSใΛΈ߹ΘͤͨΈ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢΒͳ͍ํάά͍ͬͯͩ͘͞ʣ ʢ2009ɻࢥ͑ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾ΛͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨॴͰ͔͑͠ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍ॴʢApple Mapʹใ͕ͳ͍ॴʣͰ͑ͳ͍
Where can we use this? ݱ࣌ͰԼهͷॴͰ͚ͩ͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ͏গ͠Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌Ͱৄࡉෆ໌
How To Use // GeoTracking͕͑Δ͔Ͳ͏͔ௐΔ ARGeoTrackingConfiguration.checkAvailability { (available, error) in
if !available { // ʮ͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
without ARGeoAnchor... ARGeoAnchor ͷର۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠߹ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng ΛͬͯΈ·͠ΐ͏ɻ x͕࣠౦ɺy͕࣠ॏྗํɺz͕࣠ೆʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
Scene Geometry and Depth with LiDAR
LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔରͷछྨΛଌఆ͢Δ ηϯαʔ only on
latest iPad Pro
How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ࣹޫΛऩू
Scene detection with LiDAR LiDAR Ͱମ·Ͱͷڑ͓Αͼମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ఆՄೳͳମఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱମ·ͰͷڑͱछྨऔಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ͍͘͢ͳΓ·ͨ͠ɻ
App With LiDAR LiDARͷ Scene Detection Λͬͯɺମ·ͰͷڑͱछྨΛ͠Όͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3
m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Όͬͯڭ͑ͯ͘Ε·͢ɻ
Face Detection ࠓ·Ͱ TrueDepthΧϝϥࡌͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧͷίϯόʔλʔ 20201݄ ϦϦʔε
Reality Converter ࠓ·ͰίϚϯυϥΠϯ ͷ usdz มπʔϧ͋ͬͨͷ͚ͩͲɺखॱ͕ ͘͠ɺΤϥʔଟ͔ͬͨɻ Reality Converter
3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ͍͘͢ɺର ԠϑΥʔϚοτଟ͍ɻ
Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ·ͰRealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
None
Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗͰ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ָ͔ͭ͑ͳΜͩΖ͏͚Ͳɺͦ͜·ͰΔ͕࣌ؒͳ͍……ɻ
·ͱΊ Geo MarkerରԠҬ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓUSDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱָͯʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹઈର LiDAR ͕ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
͍͍Ͱ͢ʂ