Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Google Assistant for Android Developers

elainedb
February 22, 2019

Google Assistant for Android Developers

Google Slides (with animations): https://docs.google.com/presentation/d/1XwcTr_btkZJdXO1B_1L6z1xIfURzI58MixTTGDJyOa0

The fact that "apps" for the Google Assistant and for Android are both available on Android smartphones can be the cause of some confusion. Do I have to go to the Play Store to download and install an "app" for the Google Assistant? Can I launch a Google Assistant experience from an Android app? How to integrate advanced voice recognition (NLP or other) on existing apps? What experience should I offer on my app? In this talk I will answer these questions, do a comparison of the ecosystems and how they can work together.

elainedb

February 22, 2019
Tweet

More Decks by elainedb

Other Decks in Technology

Transcript

  1. @elainedbatista
    Google Assistant for Android Developers
    Elaine Dias Batista

    View full-size slide

  2. @elainedbatista
    @elainedbatista
    @elainedbatista
    Elaine Dias Batista

    View full-size slide

  3. @elainedbatista
    @elainedbatista
    Outline
    1. Assistant vs. Android
    a. Devices
    b. UI
    c. Development
    d. Distribution
    2. Mixing both
    a. App Actions
    b. Google Maps / Chrome
    c. Android app from Assistant
    d. Action from Android app
    3. Integrating "Google Assistant"-like
    features into Android apps
    4. Final thoughts
    3

    View full-size slide

  4. @elainedbatista
    @elainedbatista
    Assistant vs. Android
    1. Devices
    2. UI
    3. Development
    4. Distribution
    4

    View full-size slide

  5. @elainedbatista
    @elainedbatista
    Assistant vs. Android
    1. Devices
    2. UI
    3. Development
    4. Distribution
    5

    View full-size slide

  6. @elainedbatista
    1. Devices

    View full-size slide

  7. @elainedbatista
    1. Devices

    View full-size slide

  8. @elainedbatista
    1. Devices - Conclusion
    ➔ Android is an Operating System capable of running the
    Google Assistant
    ◆ and you can launch it fairly easily on it
    ➔ The Google Assistant is a piece of software that works
    on a bunch of OSs
    ◆ Android / iOS
    ◆ Chrome OS, KaiOS
    ◆ … and others

    View full-size slide

  9. @elainedbatista
    @elainedbatista
    Assistant vs. Android
    1. Devices
    2. UI
    3. Development
    4. Distribution
    9

    View full-size slide

  10. @elainedbatista
    1. UI on a phone - Launching an app

    View full-size slide

  11. @elainedbatista

    View full-size slide

  12. @elainedbatista
    1. VUI / UI on Smart Displays

    View full-size slide

  13. @elainedbatista
    @elainedbatista
    Assistant vs. Android
    1. Devices
    2. UI
    3. Development
    4. Distribution
    13

    View full-size slide

  14. @elainedbatista
    3. Development
    Actions on Google
    - Node.js / Java (Kotlin)
    official libraries
    - Conversation API
    (REST calls)
    - Dialogflow
    - Google Assistant SDK
    Android SDK
    - Java / Kotlin
    - JS, Flutter, Xamarin...

    View full-size slide

  15. @elainedbatista
    3. Development
    ➔ You can have a Google Assistant Action without
    having an Android app

    View full-size slide

  16. @elainedbatista
    @elainedbatista
    Assistant vs. Android
    1. Devices
    2. UI
    3. Development
    4. Distribution
    16

    View full-size slide

  17. @elainedbatista
    4. Distribution

    View full-size slide

  18. @elainedbatista
    4. Distribution

    View full-size slide

  19. @elainedbatista
    @elainedbatista
    Mixing the two platforms
    1. App Actions
    2. The Google Maps / Chrome cases
    3. Calling an Android app from the Assistant
    4. Calling an Action from and Android app
    19

    View full-size slide

  20. @elainedbatista
    @elainedbatista
    Mixing the two platforms
    1. App Actions
    2. The Google Maps / Chrome cases
    3. Calling an Android app from the Assistant
    4. Calling an Action from and Android app
    20

    View full-size slide

  21. @elainedbatista
    App Actions
    21

    View full-size slide

  22. @elainedbatista
    App Actions - Launcher
    22

    View full-size slide

  23. @elainedbatista
    App Actions - Play Store
    ➔ Installed apps
    ◆ Deep-link into it
    ➔ Not installed apps
    ◆ Open details page
    ◆ Deep-link after installation
    23

    View full-size slide

  24. @elainedbatista
    App Actions
    ➔ Users don't want to simply "open" an app, they want to
    get something done
    ➔ App Actions are a new way of re-engaging with your
    users in the right context at the right moment
    ➔ Based on Actions on Google's Built-in Intents
    24

    View full-size slide

  25. @elainedbatista
    App Actions - Shameless plug
    25

    View full-size slide

  26. @elainedbatista
    @elainedbatista
    Mixing the two platforms
    1. App Actions
    2. The Google Maps / Chrome cases
    3. Calling an Android app from the Assistant
    4. Calling an Action from and Android app
    26

    View full-size slide

  27. @elainedbatista
    Google Maps "Assistant" integration
    27
    ➔ "OK Google, show
    restaurants nearby"

    View full-size slide

  28. @elainedbatista
    @elainedbatista
    Mixing the two platforms
    1. App Actions
    2. The Google Maps / Chrome cases
    3. Calling an Android app from the Assistant
    4. Calling an Action from and Android app
    28

    View full-size slide

  29. @elainedbatista
    From Assistant to Android App
    29

    View full-size slide

  30. @elainedbatista
    @elainedbatista
    Mixing the two platforms
    1. App Actions
    2. The Google Maps / Chrome cases
    3. Calling an Android app from the Assistant
    4. Calling an Action from and Android app
    30

    View full-size slide

  31. @elainedbatista
    From Android App to Assistant
    31

    View full-size slide

  32. @elainedbatista
    @elainedbatista
    Integrating "Google Assistant"-like
    features into Android apps
    32

    View full-size slide

  33. @elainedbatista
    @elainedbatista
    Integrating "Google Assistant"-like
    features into Android mobile apps
    33

    View full-size slide

  34. @elainedbatista
    Integrating conversational features
    ➔ Recipes app
    ➔ Taxi driver app
    ➔ AR app
    34

    View full-size slide

  35. @elainedbatista
    Integrating conversational features
    1. Hot-word/wake word detection (optional but preferred)
    2. NLP/NLU SDK for mobile
    35

    View full-size slide

  36. @elainedbatista
    Integrating conversational features
    1. Hot-word detection
    ◆ Android API - AlwaysOnHotwordDetector
    ◆ Voice actions / Voice interaction API
    ◆ Porcupine / Snowboy / Snips / PocketSphinx
    2. NLP/NLU SDK for mobile
    ◆ From Google: Dialogflow, ML Kit, TensorFlow, Cloud APIs
    ◆ Amazon Lex
    ◆ RASA NLU, Snips, PyTorch and much more...
    36

    View full-size slide

  37. @elainedbatista
    Shameless plug n. 2
    37

    View full-size slide

  38. @elainedbatista
    @elainedbatista
    Final thoughts
    38

    View full-size slide

  39. @elainedbatista
    Final thoughts
    ➔ Don't try to simply port all the features from your
    current app into the Assistant
    ◆ Think about the appropriate use cases - start with 1 or 2
    ◆ They have to make sense as a conversation
    ➔ Integrating features into an existing mobile app is a
    great way to get your users accustomed to this new
    technology
    39

    View full-size slide

  40. @elainedbatista
    Final thoughts
    ➔ If you already have an app:
    ◆ Develop 1 or 2 features for the Assistant (if they make
    sense) and see how it goes - it's a new channel that your
    users are on
    ➔ If you don't have an app yet:
    ◆ Try both approaches (app, action) - you can even make a
    "voice first" mobile app experience
    40

    View full-size slide

  41. @elainedbatista
    Final thoughts
    ➔ Google Assistant is still new
    ➔ Think outside the box
    41

    View full-size slide

  42. @elainedbatista
    @elainedbatista
    Google I/O 2019
    What to Expect
    42

    View full-size slide

  43. @elainedbatista 43
    Google I/O 2019

    View full-size slide

  44. @elainedbatista
    @elainedbatista
    Thanks!
    44
    @elainedbatista

    View full-size slide