Introduction to 3D/AR with Sceneview on Android

Slide 1

Slide 1 text

Introduction to 3D/AR with Sceneview on Android 03/18/2024 by Jérôme Cha

Slide 2

Slide 2 text

Self-Introduction 2

Slide 3

Slide 3 text

CHA Jerome - ジェローム・チャ - French - Android Engineer at Saﬁe - Worked at Chatwork and Enigmo (BUYMA) - Hobbies : Workout (ex-JBBF Bodybuilder) / Making my own robot - Twitter @yujiro45 3

Slide 4

Slide 4 text

Agenda 1 4 2 3 Sceneview on Android Implementation - Display 3D Model Implementation - Gestures & animations Pros/Cons 4

Slide 5

Slide 5 text

Sceneview on Android 5

Slide 6

Slide 6 text

What is Sceneview on Android？ - Realtime rendering engine made by Google - Create easily 2D and 3D rendering - Introduced in 2017/9 by Google - Framework for AR development on Android devices ARCore Filament ● https://sceneview.github.io/ ● View that uses Google’s ARCore and Filament to display 3D / AR contents 6

Slide 7

Slide 7 text

What is Sceneview on Android？ ● Created by Thomas Gorisse and his team ○ French ○ Working at Yembo in San Diego, California ● Available on Android (Kotlin), Flutter and React Native ● Available on Jetpack Compose and XML Views ● Sceneform’s “Kotlin-version” ○ https://github.com/SceneView/sceneform-android ○ Sceneform is not maintained anymore 7

Slide 8

Slide 8 text

Implementation - Display a 3D model 8

Slide 9

Slide 9 text

Display a 3D model 9 https://sketchfab.com/3d-models/android-7c30eda007684abbb78ea4b99d22fc2c Let’s try to display Bugdroid!

Slide 10

Slide 10 text

Display a 3D model - Google Filament - Google Filament - ARCore ARSceneview Sceneview 10 ● 2 views

Slide 11

Slide 11 text

Display a 3D model 11 ARSceneview Sceneview

Slide 12

Slide 12 text

12 Yes, you can If you choose to add Sceneview only, obviously you cannot Can I use Sceneview if I add ARSceneview only in my project?

Slide 13

Slide 13 text

Display a 3D model 13 ARSceneview Sceneview

Slide 14

Slide 14 text

Display a 3D model 14 WHAT IS THIS?!

Slide 15

Slide 15 text

15 Display a 3D model

Slide 16

Slide 16 text

16 Implementation - Display 3D model

Slide 17

Slide 17 text

17 Sceneview ARSceneview Display a 3D model

Slide 18

Slide 18 text

Implementation - Gestures & animations 18

Slide 19

Slide 19 text

Gestures & animations 19 Let’s go from this, with a double tap

Slide 20

Slide 20 text

20 Gestures & animations

Slide 21

Slide 21 text

21 Gestures & animations

Slide 22

Slide 22 text

22 Sceneview ARSceneview Gestures & animations

Slide 23

Slide 23 text

Pros / Cons 23

Slide 24

Slide 24 text

Pros - Very easy to use - Good performances on most Android Phone - Jetpack Compose & XML Views supports 24

Slide 25

Slide 25 text

Pros 25

Slide 26

Slide 26 text

Cons - Lack of tutorial or sample code - Hard to customize - People don’t reply on Github - Support only .glb and .hdr ﬁles - Makes phone getting hot after long use - Not very stable 26

Slide 27

Slide 27 text

Cons 27 2.0.2 2.0.3 Gesture broken in 2.0.2

Slide 28

Slide 28 text

Cons 28 2.0.2 2.0.3 3D Rendering broken in 2.0.3, but worked before Still broken in the latest version

Slide 29

Slide 29 text

Thank you 29