Intro to Google Assistant and Actions on Google

Talk made at Android Makers 2017.

Transcript

1. INTRO TO GOOGLE ASSISTANT &
   ACTIONS ON GOOGLE
   Elaine Dias Batista
   @elainedbatista
   Wajdi Ben Rabah
   @WajdiBenRabah
   

   View Slide

2. Who are we?
   Elaine Wajdi
   

   View Slide

3. Outline
   ➔ Intro to A.I. Assistants
   ➔ A new kind of UI: VUI
   ➔ Google Home and Google Assistant
   ➔ Actions on Google
   ➔ Final thoughts
   

   View Slide

4. Intro to A.I. Assistants
   

   View Slide

5. A.I. Assistants/Platform shift
   Mobile
   New idea
   Frenzy
   Scaling
   Maturity
   PCs
   ?
   Maturity
   You
   are
   here
   Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
   

   View Slide

6. A.I. Assistants/Platform shift
   "From mobile first to AI-first"
   Sundar Pichai
   October 4th, 2016
   

   View Slide

7. Sources
   User Input
   A.I. Assistants/What is it anyway?!
   A.I.
   Assistant
   Text
   Sensors
   Actions
   Answer
   Question
   

   View Slide

8. A.I. Assistants/Some examples
   Apple's
   Siri
   2011
   Microsoft's
   Cortana
   2014
   Amazon's
   Alexa
   2014
   Google's
   Assistant
   2016
   Samsung's
   Bixby
   2017
   

   View Slide

9. A new kind of UI: VUI
   

   View Slide

10. VUI/Human to human vs. Human to computer
    Spoken
    Language
    100,000 years
    Chat bots &
    AI Assistants
    <7 years
    Dictation
    software
    20 years
    Smartphones
    25 years
    Internet
    30 years
    Word
    processor
    40 years
    Speech
    recognition
    50 years
    Computers
    70 years
    TTS
    80 years
    Typing
    150 years
    Print
    575 years
    Writing
    5,000 years
    Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA
    

    View Slide

11. VUI/Some design principles
    Create a
    persona
    Context No errors
    Character
    Pace
    Tone
    Energy level
    Where is the user?
    What are
    they doing?
    Which device?
    "Sorry, try Command 1"
    

    View Slide

12. VUI/User journeys
    "Command 1"
    User
    Assistant
    "Got it"
    "Command 2"
    "Got it, here's
    what you want"
    Canonical "Happy path"
    "Command -1"
    "Try Command 1
    instead"
    "Command 1"
    "Got it, here's
    what you want"
    1st time experience
    "Got it, here's
    what you want"
    Tapered experience
    

    View Slide

13. VUI/Actions Checklist
    g.co/dev/ActionsChecklist
    

    View Slide

14. Google Home and
    Google Assistant
    

    View Slide

15. G. Home & G. Assistant/Intro
    How about having your personal assistant wherever you’re?
    How about a new VUI?, just ask for things to be done for you.
    An evolutive AI made by Google ready to help!
    

    View Slide

16. G. Home & G. Assistant/Google Home Specs
    

    View Slide

17. G. Home & G. Assistant/What can I do with it?!
    ➔ Play a YouTube video on a chromecast enabled device
    ➔ Play music (Play Music, Spotify)
    ➔ Monitor the Nest Thermostat
    ➔ Ask for events on your calendar
    ➔ Block the next hour on your calendar (with IFTTT)
    ➔ Get a summary for your day
    ➔ Play voice games
    ➔ Personality questions
    

    View Slide

18. G. Home & G. Assistant/Device compatibility
    

    View Slide

19. G. Home & G. Assistant/Fragmentation
    Pixel Home Wear Allo
    Play music
    Set reminders
    Add item to shopping list
    Get the news
    Send messages
    Device controls
    Search with Google
    Order an Uber
    Set timers, set alarms, get the weather, find answers, translations, ...
    

    View Slide

20. Actions on Google
    

    View Slide

21. Actions on Google
    

    View Slide

22. Actions on Google/Actions SDK
    

    View Slide

23. Actions on Google/API.AI
    

    View Slide

24. Actions on Google/API.AI
    

    View Slide

25. Actions on Google/Developer tools summary
    Actions on
    Google
    Actions
    SDK
    API.AI
    NodeJS library that helps you use the
    Conversation API
    You have to do all the heavy work in order to
    extract parameters from the user's request
    Actions on Google integration
    BUT also: Android, iOS SDKs
    and other integrations
    NLU built-in
    

    View Slide

26. Actions on Google/Assistant @Google I/O 2017
    https://events.google.com/io/schedule
    

    View Slide

27. Final thoughts
    

    View Slide

28. Final thoughts
    ➔ Next platform? Big developer/brand opportunity
    ◆ Platform fragmentation?
    ➔ Not all UI is better through a VUI
    ➔ Less but more friction
    ➔ Accessibility
    

    View Slide

29. Workshop
    Actions on Google
    Workshop
    @14h25
    

    View Slide

30. Questions?
    @elainedbatista @WajdiBenRabah
    

    View Slide

31. Resources
    ➔ Intro to A.I. Assistants
    ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
    ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20
    ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne
    ➔ A new kind of UI: VUI
    ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA
    ◆ http://g.co/dev/ActionsChecklist
    ◆ http://g.co/dev/ActionsDesign
    ➔ Google Home and Google Assistant
    ◆ https://blog.google/products/assistant/personal-google-just-you/
    ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/
    ◆ https://twitter.com/RonAmadeo/status/843852120562552832
    ➔ Actions on Google
    ◆ https://developers.google.com/actions/
    ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk
    ➔ Final thoughts
    ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai
    

    View Slide