Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Intro to Google Assistant and Actions on Google

April 11, 2017

Intro to Google Assistant and Actions on Google

Talk made at Android Makers 2017.


April 11, 2017

More Decks by elainedb

Other Decks in Technology



    Batista @elainedbatista Wajdi Ben Rabah @WajdiBenRabah
  2. Outline ➔ Intro to A.I. Assistants ➔ A new kind

    of UI: VUI ➔ Google Home and Google Assistant ➔ Actions on Google ➔ Final thoughts
  3. A.I. Assistants/Platform shift Mobile New idea Frenzy Scaling Maturity PCs

    ? Maturity You are here Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
  4. A.I. Assistants/Some examples Apple's Siri 2011 Microsoft's Cortana 2014 Amazon's

    Alexa 2014 Google's Assistant 2016 Samsung's Bixby 2017
  5. VUI/Human to human vs. Human to computer Spoken Language 100,000

    years Chat bots & AI Assistants <7 years Dictation software 20 years Smartphones 25 years Internet 30 years Word processor 40 years Speech recognition 50 years Computers 70 years TTS 80 years Typing 150 years Print 575 years Writing 5,000 years Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA
  6. VUI/Some design principles Create a persona Context No errors Character

    Pace Tone Energy level Where is the user? What are they doing? Which device? "Sorry, try Command 1"
  7. VUI/User journeys "Command 1" User Assistant "Got it" "Command 2"

    "Got it, here's what you want" Canonical "Happy path" "Command -1" "Try Command 1 instead" "Command 1" "Got it, here's what you want" 1st time experience "Got it, here's what you want" Tapered experience
  8. G. Home & G. Assistant/Intro How about having your personal

    assistant wherever you’re? How about a new VUI?, just ask for things to be done for you. An evolutive AI made by Google ready to help!
  9. G. Home & G. Assistant/What can I do with it?!

    ➔ Play a YouTube video on a chromecast enabled device ➔ Play music (Play Music, Spotify) ➔ Monitor the Nest Thermostat ➔ Ask for events on your calendar ➔ Block the next hour on your calendar (with IFTTT) ➔ Get a summary for your day ➔ Play voice games ➔ Personality questions
  10. G. Home & G. Assistant/Fragmentation Pixel Home Wear Allo Play

    music Set reminders Add item to shopping list Get the news Send messages Device controls Search with Google Order an Uber Set timers, set alarms, get the weather, find answers, translations, ...
  11. Actions on Google/Developer tools summary Actions on Google Actions SDK

    API.AI NodeJS library that helps you use the Conversation API You have to do all the heavy work in order to extract parameters from the user's request Actions on Google integration BUT also: Android, iOS SDKs and other integrations NLU built-in
  12. Final thoughts ➔ Next platform? Big developer/brand opportunity ◆ Platform

    fragmentation? ➔ Not all UI is better through a VUI ➔ Less but more friction ➔ Accessibility
  13. Resources ➔ Intro to A.I. Assistants ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20

    ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne ➔ A new kind of UI: VUI ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA ◆ http://g.co/dev/ActionsChecklist ◆ http://g.co/dev/ActionsDesign ➔ Google Home and Google Assistant ◆ https://blog.google/products/assistant/personal-google-just-you/ ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/ ◆ https://twitter.com/RonAmadeo/status/843852120562552832 ➔ Actions on Google ◆ https://developers.google.com/actions/ ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk ➔ Final thoughts ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai