Intro to Google Assistant and Actions on Google

Cb3c988ada1925dbb88a2b1f11c60f3f?s=47 elainedb
April 11, 2017

Intro to Google Assistant and Actions on Google

Talk made at Android Makers 2017.

Cb3c988ada1925dbb88a2b1f11c60f3f?s=128

elainedb

April 11, 2017
Tweet

Transcript

  1. INTRO TO GOOGLE ASSISTANT & ACTIONS ON GOOGLE Elaine Dias

    Batista @elainedbatista Wajdi Ben Rabah @WajdiBenRabah
  2. Who are we? Elaine Wajdi

  3. Outline ➔ Intro to A.I. Assistants ➔ A new kind

    of UI: VUI ➔ Google Home and Google Assistant ➔ Actions on Google ➔ Final thoughts
  4. Intro to A.I. Assistants

  5. A.I. Assistants/Platform shift Mobile New idea Frenzy Scaling Maturity PCs

    ? Maturity You are here Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
  6. A.I. Assistants/Platform shift "From mobile first to AI-first" Sundar Pichai

    October 4th, 2016
  7. Sources User Input A.I. Assistants/What is it anyway?! A.I. Assistant

    Text Sensors Actions Answer Question
  8. A.I. Assistants/Some examples Apple's Siri 2011 Microsoft's Cortana 2014 Amazon's

    Alexa 2014 Google's Assistant 2016 Samsung's Bixby 2017
  9. A new kind of UI: VUI

  10. VUI/Human to human vs. Human to computer Spoken Language 100,000

    years Chat bots & AI Assistants <7 years Dictation software 20 years Smartphones 25 years Internet 30 years Word processor 40 years Speech recognition 50 years Computers 70 years TTS 80 years Typing 150 years Print 575 years Writing 5,000 years Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA
  11. VUI/Some design principles Create a persona Context No errors Character

    Pace Tone Energy level Where is the user? What are they doing? Which device? "Sorry, try Command 1"
  12. VUI/User journeys "Command 1" User Assistant "Got it" "Command 2"

    "Got it, here's what you want" Canonical "Happy path" "Command -1" "Try Command 1 instead" "Command 1" "Got it, here's what you want" 1st time experience "Got it, here's what you want" Tapered experience
  13. VUI/Actions Checklist g.co/dev/ActionsChecklist

  14. Google Home and Google Assistant

  15. G. Home & G. Assistant/Intro How about having your personal

    assistant wherever you’re? How about a new VUI?, just ask for things to be done for you. An evolutive AI made by Google ready to help!
  16. G. Home & G. Assistant/Google Home Specs

  17. G. Home & G. Assistant/What can I do with it?!

    ➔ Play a YouTube video on a chromecast enabled device ➔ Play music (Play Music, Spotify) ➔ Monitor the Nest Thermostat ➔ Ask for events on your calendar ➔ Block the next hour on your calendar (with IFTTT) ➔ Get a summary for your day ➔ Play voice games ➔ Personality questions
  18. G. Home & G. Assistant/Device compatibility

  19. G. Home & G. Assistant/Fragmentation Pixel Home Wear Allo Play

    music Set reminders Add item to shopping list Get the news Send messages Device controls Search with Google Order an Uber Set timers, set alarms, get the weather, find answers, translations, ...
  20. Actions on Google

  21. Actions on Google

  22. Actions on Google/Actions SDK

  23. Actions on Google/API.AI

  24. Actions on Google/API.AI

  25. Actions on Google/Developer tools summary Actions on Google Actions SDK

    API.AI NodeJS library that helps you use the Conversation API You have to do all the heavy work in order to extract parameters from the user's request Actions on Google integration BUT also: Android, iOS SDKs and other integrations NLU built-in
  26. Actions on Google/Assistant @Google I/O 2017 https://events.google.com/io/schedule

  27. Final thoughts

  28. Final thoughts ➔ Next platform? Big developer/brand opportunity ◆ Platform

    fragmentation? ➔ Not all UI is better through a VUI ➔ Less but more friction ➔ Accessibility
  29. Workshop Actions on Google Workshop @14h25

  30. Questions? @elainedbatista @WajdiBenRabah

  31. Resources ➔ Intro to A.I. Assistants ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20

    ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne ➔ A new kind of UI: VUI ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA ◆ http://g.co/dev/ActionsChecklist ◆ http://g.co/dev/ActionsDesign ➔ Google Home and Google Assistant ◆ https://blog.google/products/assistant/personal-google-just-you/ ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/ ◆ https://twitter.com/RonAmadeo/status/843852120562552832 ➔ Actions on Google ◆ https://developers.google.com/actions/ ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk ➔ Final thoughts ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai