Mobile_AR_with_ARCore.pdf

Transcript

1. Mobile AR with ARCore Moble AR with ARCore - @ErikHellman,

   Øredev 2018

2. https://9to5mac.com/2018/05/16/comment-stop-using-ar-as-a-gimmick/

3. Transformative AR Moble AR with ARCore - @ErikHellman, Øredev 2018

4. Moble AR with ARCore - @ErikHellman, Øredev 2018

5. Moble AR with ARCore - @ErikHellman, Øredev 2018

6. MERGE Cube https://mergevr.com/cube

7. Microsoft HoloLens https://www.engadget.com/2017/11/01/microsoft-hololens-hard-hat-european-expansion/

8. Magic Leap Moble AR with ARCore - @ErikHellman, Øredev 2018

9. Transformative AR Moble AR with ARCore - @ErikHellman, Øredev 2018

10. ARCore from Google https://developers.google.com/ar

11. Motion Tracking https://developers.google.com/ar/discover/concepts

12. Environmental understanding https://developers.google.com/ar/discover/concepts

13. Light estimation https://developers.google.com/ar/discover/concepts

14. User interaction Oriented Points Anchors and Trackables Augmented Images Cloud

    Anchors Moble AR with ARCore - @ErikHellman, Øredev 2018

15. Anchors Moble AR with ARCore - @ErikHellman, Øredev 2018

16. Getting started with ARCore (Android) Moble AR with ARCore -

    @ErikHellman, Øredev 2018

17. override fun onResume() { super.onResume() val arCoreApk = ArCoreApk.getInstance() if

    (!arCoreApk.checkAvailability(this).isSupported()) { // Not supported - notify user! return } if (arCoreApk.requestInstall(this, true) == ArCoreApk.InstallStatus.INSTALL_REQUESTED)) { // Installation needed - activity will pause return } // Everything is ok to go! } Moble AR with ARCore - @ErikHellman, Øredev 2018

18. Sceneform (Android) Moble AR with ARCore - @ErikHellman, Øredev 2018

19. Sceneform → High-level scenegraph API → Realistic Physical Based Rendering

    using Filament → Android Studio plugin Moble AR with ARCore - @ErikHellman, Øredev 2018

20. Filament https://github.com/google/filament

21. Sceneform dependencies { // Provides ARCore Session and related resources.

    implementation 'com.google.ar:core:1.5.0' // Provides ArFragment, and other UX resources. implementation 'com.google.ar.sceneform.ux:sceneform-ux:1.5.1' // Alternatively, use ArSceneView without the UX dependency. implementation 'com.google.ar.sceneform:core:1.5.1' } Moble AR with ARCore - @ErikHellman, Øredev 2018

22. Sceneform <fragment android:id="@+id/ar_fragment" android:name="com.google.ar.sceneform.ux.ArFragment" android:layout_width="match_parent" android:layout_height="match_parent" /> Moble AR with

    ARCore - @ErikHellman, Øredev 2018

23. Sceneform val arFragment = fragmentManager .findFragmentById(R.id.ux_fragment) as ArFragment? arFragment?.setOnTapArPlaneListener {

    hitResult, plane, motionEvent -> // Create new anchor and node val anchor = hitResult.createAnchor() val anchorNode = AnchorNode(anchor) // Add to the scene anchorNode.setParent(arFragment.arSceneView.scene) // TODO Add content to the new anchor... } Moble AR with ARCore - @ErikHellman, Øredev 2018

24. Scneeform - Display models arFragment?.setOnTapArPlaneListener { hitResult, plane, motionEvent ->

    ModelRenderable.builder() .setSource(this, Uri.parse("earth.sfb")) .build() .thenAccept { val anchor = hitResult.createAnchor() val anchorNode = AnchorNode(anchor) val transformableNode = TransformableNode(arFragment.transformationSystem) .apply { setParent(anchorNode) renderable = it } anchorNode.addChild(transformableNode) anchorNode.setParent(arFragment.arSceneView.scene) } } Moble AR with ARCore - @ErikHellman, Øredev 2018

25. Sceneform - Display Android views Moble AR with ARCore -

    @ErikHellman, Øredev 2018

26. Sceneform - Display Android views arFragment?.setOnTapArPlaneListener { hitResult, plane, motionEvent

    -> ViewRenderable.builder() .setView(this, R.layout.simple_form) .build() .thenAccept { card -> val anchor = hitResult.createAnchor() val anchorNode = AnchorNode(anchor) TransformableNode(arFragment.transformationSystem).apply { setParent(anchorNode) renderable = card select() } anchorNode.setParent(arFragment.arSceneView.scene) card.view.findViewById<Button>(R.id.okBtn).setOnClickListener { arFragment.arSceneView.scene.removeChild(anchorNode) anchor.detach() } } Moble AR with ARCore - @ErikHellman, Øredev 2018

27. Augmented Images Moble AR with ARCore - @ErikHellman, Øredev 2018

28. Configure Augmented Images // ARCore session sestup val session =

    Session(this) val config = Config(session) // Open image database val inputStream = context.assets.open("my_images_db.imgdb") val imageDatabase = AugmentedImageDatabase.deserialize(inputStream); // Enable image tracking config.setAugmentedImageDatabase(imageDatabase); session.configure(config); Moble AR with ARCore - @ErikHellman, Øredev 2018

29. Track images // in onDrawFrame() val frame = session.update() val

    updatedAugmentedImages = frame.getUpdatedTrackables(AugmentedImage::class.java) updatedAugmentedImages.forEach { when (it.trackingState) { TrackingState.PAUSE -> // Detected, but not yet tracked TrackingState.TRACKING -> // Tracking! Create an anchor TrackingState.STOPPED -> // Remove anchor } } Moble AR with ARCore - @ErikHellman, Øredev 2018

30. Cloud Anchors Moble AR with ARCore - @ErikHellman, Øredev 2018

31. Cloud Anchors <meta-data android:name="com.google.android.ar.API_KEY" android:value="<YOUR_API_KEY>" /> Moble AR with ARCore

    - @ErikHellman, Øredev 2018

32. Moble AR with ARCore - @ErikHellman, Øredev 2018