ARKIT

Transcript

1. ARKIT By M.N. 2017-11-10
2. What is ARKIT ARKIT is artificial reality api that uses gyroscope and accelerometers to measure distance of change between distinct images or objects with camera.
3. How vision works SLAM (Simultaneous Localization and Mapping) 1.identifies features within that image. 2.It then takes another picture, and again identifies the features. 3.It then compares the first image to the second, and does a number of calculations to determine the change in the relationships between features.
4. Known problems and limitations - Can’t track things with little detail - Can’t automatically detect walls for hit detection - Shiny objects cause incorrect measurements - Mapped areas are squares. Not Triangles or advanced shapes
5. Google Tango (transition to camera only AR Core) Special phone with 2nd camera Uses IR to obtain “flight of points”
6. Google Tango continued Modeling rooms
7. Microsoft Hololens - Two Kinect-like depth cameras on it (facing forward-left and forward-right), - Continually scan the environment of the user. - These cameras create three-dimensional geometric representations of objects in the environment. - IMU (internal measurement unit) accelerometers and gyroscopes
8. ARKit compatible devices The devices that use A9, A10 and A11 chips running IOS11 • iPhone 6s and 6s Plus • iPhone 7 and 7 Plus • iPhone SE • iPad Pro (9.7, 10.5 or 12.9) – both first-gen and 2nd-gen • iPad (2017) • iPhone 8 and 8 Plus • iPhone X
9. Iphone AR glasses (Mira Prism) https://www.mirareality.com/ Price:$90 予約 OK
10. AR Kit + SceneKit
11. 6DOF ArKit Class AROrientationTrackingConfiguration Subclass ARWorldTrackingConfiguration (apple recommends to call this class) for six degrees of freedom
14. ARSCNViewDelegate didUpdate didRemove
15. func worldPositionFromScreenPosition ... ... // Two possible tests: (horizontal only) sceneView.hitTest(position ...) sceneView.hitTestWithFeatures….. … self.updatePlane(anchor: planeAnchor)
16. Items static let availableObjects: [VirtualObject] = [ Candle(), Cup(), Vase(), Lamp(), Chair() ]
18. func moveVirtualObjectToPosition …. guard let object = virtualObject, let cameraTransform = session.currentFrame?.camera.transform else { return } recentVirtualObjectDistances.removeAll() let cameraWorldPos = SCNVector3.positionFromTransform(cameraTransform) var cameraToPosition = pos - cameraWorldPos // Limit the distance of the object from the camera to a maximum of 10 meters. cameraToPosition.setMaximumLength(10) object.position = cameraWorldPos + cameraToPosition if object.parent == nil { sceneView.scene.rootNode.addChildNode(object) } }