Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Intro to Google Assistant and Actions on Google

Intro to Google Assistant and Actions on Google

Talk made at Android Makers 2017.

elainedb

April 11, 2017
Tweet

More Decks by elainedb

Other Decks in Technology

Transcript

  1. INTRO TO GOOGLE ASSISTANT &
    ACTIONS ON GOOGLE
    Elaine Dias Batista
    @elainedbatista
    Wajdi Ben Rabah
    @WajdiBenRabah

    View Slide

  2. Who are we?
    Elaine Wajdi

    View Slide

  3. Outline
    ➔ Intro to A.I. Assistants
    ➔ A new kind of UI: VUI
    ➔ Google Home and Google Assistant
    ➔ Actions on Google
    ➔ Final thoughts

    View Slide

  4. Intro to A.I. Assistants

    View Slide

  5. A.I. Assistants/Platform shift
    Mobile
    New idea
    Frenzy
    Scaling
    Maturity
    PCs
    ?
    Maturity
    You
    are
    here
    Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world

    View Slide

  6. A.I. Assistants/Platform shift
    "From mobile first to AI-first"
    Sundar Pichai
    October 4th, 2016

    View Slide

  7. Sources
    User Input
    A.I. Assistants/What is it anyway?!
    A.I.
    Assistant
    Text
    Sensors
    Actions
    Answer
    Question

    View Slide

  8. A.I. Assistants/Some examples
    Apple's
    Siri
    2011
    Microsoft's
    Cortana
    2014
    Amazon's
    Alexa
    2014
    Google's
    Assistant
    2016
    Samsung's
    Bixby
    2017

    View Slide

  9. A new kind of UI: VUI

    View Slide

  10. VUI/Human to human vs. Human to computer
    Spoken
    Language
    100,000 years
    Chat bots &
    AI Assistants
    <7 years
    Dictation
    software
    20 years
    Smartphones
    25 years
    Internet
    30 years
    Word
    processor
    40 years
    Speech
    recognition
    50 years
    Computers
    70 years
    TTS
    80 years
    Typing
    150 years
    Print
    575 years
    Writing
    5,000 years
    Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA

    View Slide

  11. VUI/Some design principles
    Create a
    persona
    Context No errors
    Character
    Pace
    Tone
    Energy level
    Where is the user?
    What are
    they doing?
    Which device?
    "Sorry, try Command 1"

    View Slide

  12. VUI/User journeys
    "Command 1"
    User
    Assistant
    "Got it"
    "Command 2"
    "Got it, here's
    what you want"
    Canonical "Happy path"
    "Command -1"
    "Try Command 1
    instead"
    "Command 1"
    "Got it, here's
    what you want"
    1st time experience
    "Got it, here's
    what you want"
    Tapered experience

    View Slide

  13. VUI/Actions Checklist
    g.co/dev/ActionsChecklist

    View Slide

  14. Google Home and
    Google Assistant

    View Slide

  15. G. Home & G. Assistant/Intro
    How about having your personal assistant wherever you’re?
    How about a new VUI?, just ask for things to be done for you.
    An evolutive AI made by Google ready to help!

    View Slide

  16. G. Home & G. Assistant/Google Home Specs

    View Slide

  17. G. Home & G. Assistant/What can I do with it?!
    ➔ Play a YouTube video on a chromecast enabled device
    ➔ Play music (Play Music, Spotify)
    ➔ Monitor the Nest Thermostat
    ➔ Ask for events on your calendar
    ➔ Block the next hour on your calendar (with IFTTT)
    ➔ Get a summary for your day
    ➔ Play voice games
    ➔ Personality questions

    View Slide

  18. G. Home & G. Assistant/Device compatibility

    View Slide

  19. G. Home & G. Assistant/Fragmentation
    Pixel Home Wear Allo
    Play music
    Set reminders
    Add item to shopping list
    Get the news
    Send messages
    Device controls
    Search with Google
    Order an Uber
    Set timers, set alarms, get the weather, find answers, translations, ...

    View Slide

  20. Actions on Google

    View Slide

  21. Actions on Google

    View Slide

  22. Actions on Google/Actions SDK

    View Slide

  23. Actions on Google/API.AI

    View Slide

  24. Actions on Google/API.AI

    View Slide

  25. Actions on Google/Developer tools summary
    Actions on
    Google
    Actions
    SDK
    API.AI
    NodeJS library that helps you use the
    Conversation API
    You have to do all the heavy work in order to
    extract parameters from the user's request
    Actions on Google integration
    BUT also: Android, iOS SDKs
    and other integrations
    NLU built-in

    View Slide

  26. Actions on Google/Assistant @Google I/O 2017
    https://events.google.com/io/schedule

    View Slide

  27. Final thoughts

    View Slide

  28. Final thoughts
    ➔ Next platform? Big developer/brand opportunity
    ◆ Platform fragmentation?
    ➔ Not all UI is better through a VUI
    ➔ Less but more friction
    ➔ Accessibility

    View Slide

  29. Workshop
    Actions on Google
    Workshop
    @14h25

    View Slide

  30. Questions?
    @elainedbatista @WajdiBenRabah

    View Slide

  31. Resources
    ➔ Intro to A.I. Assistants
    ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
    ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20
    ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne
    ➔ A new kind of UI: VUI
    ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA
    ◆ http://g.co/dev/ActionsChecklist
    ◆ http://g.co/dev/ActionsDesign
    ➔ Google Home and Google Assistant
    ◆ https://blog.google/products/assistant/personal-google-just-you/
    ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/
    ◆ https://twitter.com/RonAmadeo/status/843852120562552832
    ➔ Actions on Google
    ◆ https://developers.google.com/actions/
    ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk
    ➔ Final thoughts
    ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai

    View Slide