Google Assistant for Android Developers

Slide 1

Slide 1 text

@elainedbatista Google Assistant for Android Developers Elaine Dias Batista

Slide 2

Slide 2 text

@elainedbatista @elainedbatista @elainedbatista Elaine Dias Batista

Slide 3

Slide 3 text

@elainedbatista @elainedbatista Outline 1. Assistant vs. Android a. Devices b. UI c. Development d. Distribution 2. Mixing both a. App Actions b. Google Maps / Chrome c. Android app from Assistant d. Action from Android app 3. Integrating "Google Assistant"-like features into Android apps 4. Final thoughts 3

Slide 4

Slide 4 text

@elainedbatista @elainedbatista Assistant vs. Android 1. Devices 2. UI 3. Development 4. Distribution 4

Slide 5

Slide 5 text

@elainedbatista @elainedbatista Assistant vs. Android 1. Devices 2. UI 3. Development 4. Distribution 5

Slide 6

Slide 6 text

@elainedbatista 1. Devices

Slide 7

Slide 7 text

@elainedbatista 1. Devices

Slide 8

Slide 8 text

@elainedbatista 1. Devices - Conclusion ➔ Android is an Operating System capable of running the Google Assistant ◆ and you can launch it fairly easily on it ➔ The Google Assistant is a piece of software that works on a bunch of OSs ◆ Android / iOS ◆ Chrome OS, KaiOS ◆ … and others

Slide 9

Slide 9 text

@elainedbatista @elainedbatista Assistant vs. Android 1. Devices 2. UI 3. Development 4. Distribution 9

Slide 10

Slide 10 text

@elainedbatista 1. UI on a phone - Launching an app

Slide 11

Slide 11 text

@elainedbatista

Slide 12

Slide 12 text

@elainedbatista 1. VUI / UI on Smart Displays

Slide 13

Slide 13 text

@elainedbatista @elainedbatista Assistant vs. Android 1. Devices 2. UI 3. Development 4. Distribution 13

Slide 14

Slide 14 text

@elainedbatista 3. Development Actions on Google - Node.js / Java (Kotlin) ofﬁcial libraries - Conversation API (REST calls) - Dialogﬂow - Google Assistant SDK Android SDK - Java / Kotlin - JS, Flutter, Xamarin...

Slide 15

Slide 15 text

@elainedbatista 3. Development ➔ You can have a Google Assistant Action without having an Android app

Slide 16

Slide 16 text

@elainedbatista @elainedbatista Assistant vs. Android 1. Devices 2. UI 3. Development 4. Distribution 16

Slide 17

Slide 17 text

@elainedbatista 4. Distribution

Slide 18

Slide 18 text

@elainedbatista 4. Distribution

Slide 19

Slide 19 text

@elainedbatista @elainedbatista Mixing the two platforms 1. App Actions 2. The Google Maps / Chrome cases 3. Calling an Android app from the Assistant 4. Calling an Action from and Android app 19

Slide 20

Slide 20 text

@elainedbatista @elainedbatista Mixing the two platforms 1. App Actions 2. The Google Maps / Chrome cases 3. Calling an Android app from the Assistant 4. Calling an Action from and Android app 20

Slide 21

Slide 21 text

@elainedbatista App Actions 21

Slide 22

Slide 22 text

@elainedbatista App Actions - Launcher 22

Slide 23

Slide 23 text

@elainedbatista App Actions - Play Store ➔ Installed apps ◆ Deep-link into it ➔ Not installed apps ◆ Open details page ◆ Deep-link after installation 23

Slide 24

Slide 24 text

@elainedbatista App Actions ➔ Users don't want to simply "open" an app, they want to get something done ➔ App Actions are a new way of re-engaging with your users in the right context at the right moment ➔ Based on Actions on Google's Built-in Intents 24

Slide 25

Slide 25 text

@elainedbatista App Actions - Shameless plug 25

Slide 26

Slide 26 text

@elainedbatista @elainedbatista Mixing the two platforms 1. App Actions 2. The Google Maps / Chrome cases 3. Calling an Android app from the Assistant 4. Calling an Action from and Android app 26

Slide 27

Slide 27 text

@elainedbatista Google Maps "Assistant" integration 27 ➔ "OK Google, show restaurants nearby"

Slide 28

Slide 28 text

@elainedbatista @elainedbatista Mixing the two platforms 1. App Actions 2. The Google Maps / Chrome cases 3. Calling an Android app from the Assistant 4. Calling an Action from and Android app 28

Slide 29

Slide 29 text

@elainedbatista From Assistant to Android App 29

Slide 30

Slide 30 text

@elainedbatista @elainedbatista Mixing the two platforms 1. App Actions 2. The Google Maps / Chrome cases 3. Calling an Android app from the Assistant 4. Calling an Action from and Android app 30

Slide 31

Slide 31 text

@elainedbatista From Android App to Assistant 31

Slide 32

Slide 32 text

@elainedbatista @elainedbatista Integrating "Google Assistant"-like features into Android apps 32

Slide 33

Slide 33 text

@elainedbatista @elainedbatista Integrating "Google Assistant"-like features into Android mobile apps 33

Slide 34

Slide 34 text

@elainedbatista Integrating conversational features ➔ Recipes app ➔ Taxi driver app ➔ AR app 34

Slide 35

Slide 35 text

@elainedbatista Integrating conversational features 1. Hot-word/wake word detection (optional but preferred) 2. NLP/NLU SDK for mobile 35

Slide 36

Slide 36 text

@elainedbatista Integrating conversational features 1. Hot-word detection ◆ Android API - AlwaysOnHotwordDetector ◆ Voice actions / Voice interaction API ◆ Porcupine / Snowboy / Snips / PocketSphinx 2. NLP/NLU SDK for mobile ◆ From Google: Dialogﬂow, ML Kit, TensorFlow, Cloud APIs ◆ Amazon Lex ◆ RASA NLU, Snips, PyTorch and much more... 36

Slide 37

Slide 37 text

@elainedbatista Shameless plug n. 2 37

Slide 38

Slide 38 text

@elainedbatista @elainedbatista Final thoughts 38

Slide 39

Slide 39 text

@elainedbatista Final thoughts ➔ Don't try to simply port all the features from your current app into the Assistant ◆ Think about the appropriate use cases - start with 1 or 2 ◆ They have to make sense as a conversation ➔ Integrating features into an existing mobile app is a great way to get your users accustomed to this new technology 39

Slide 40

Slide 40 text

@elainedbatista Final thoughts ➔ If you already have an app: ◆ Develop 1 or 2 features for the Assistant (if they make sense) and see how it goes - it's a new channel that your users are on ➔ If you don't have an app yet: ◆ Try both approaches (app, action) - you can even make a "voice ﬁrst" mobile app experience 40

Slide 41

Slide 41 text

@elainedbatista Final thoughts ➔ Google Assistant is still new ➔ Think outside the box 41