INTRO TO GOOGLE ASSISTANT & ACTIONS ON GOOGLE Elaine Dias Batista @elainedbatista Wajdi Ben Rabah @WajdiBenRabah

Who are we? Elaine Wajdi

Outline ➔ Intro to A.I. Assistants ➔ A new kind of UI: VUI ➔ Google Home and Google Assistant ➔ Actions on Google ➔ Final thoughts

Intro to A.I. Assistants

A.I. Assistants/Platform shift Mobile New idea Frenzy Scaling Maturity PCs ? Maturity You are here Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world

A.I. Assistants/Platform shift "From mobile first to AI-first" Sundar Pichai October 4th, 2016

Sources User Input A.I. Assistants/What is it anyway?! A.I. Assistant Text Sensors Actions Answer Question

A.I. Assistants/Some examples Apple's Siri 2011 Microsoft's Cortana 2014 Amazon's Alexa 2014 Google's Assistant 2016 Samsung's Bixby 2017

A new kind of UI: VUI

VUI/Human to human vs. Human to computer Spoken Language 100,000 years Chat bots & AI Assistants <7 years Dictation software 20 years Smartphones 25 years Internet 30 years Word processor 40 years Speech recognition 50 years Computers 70 years TTS 80 years Typing 150 years Print 575 years Writing 5,000 years Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA

VUI/Some design principles Create a persona Context No errors Character Pace Tone Energy level Where is the user? What are they doing? Which device? "Sorry, try Command 1"

VUI/User journeys "Command 1" User Assistant "Got it" "Command 2" "Got it, here's what you want" Canonical "Happy path" "Command -1" "Try Command 1 instead" "Command 1" "Got it, here's what you want" 1st time experience "Got it, here's what you want" Tapered experience

VUI/Actions Checklist g.co/dev/ActionsChecklist

Google Home and Google Assistant

G. Home & G. Assistant/Intro How about having your personal assistant wherever you’re? How about a new VUI?, just ask for things to be done for you. An evolutive AI made by Google ready to help!

G. Home & G. Assistant/Google Home Specs

G. Home & G. Assistant/What can I do with it?! ➔ Play a YouTube video on a chromecast enabled device ➔ Play music (Play Music, Spotify) ➔ Monitor the Nest Thermostat ➔ Ask for events on your calendar ➔ Block the next hour on your calendar (with IFTTT) ➔ Get a summary for your day ➔ Play voice games ➔ Personality questions

G. Home & G. Assistant/Device compatibility

G. Home & G. Assistant/Fragmentation Pixel Home Wear Allo Play music Set reminders Add item to shopping list Get the news Send messages Device controls Search with Google Order an Uber Set timers, set alarms, get the weather, find answers, translations, ...

Actions on Google

Actions on Google

Actions on Google/Actions SDK

Actions on Google/API.AI

Actions on Google/API.AI

Actions on Google/Developer tools summary Actions on Google Actions SDK API.AI NodeJS library that helps you use the Conversation API You have to do all the heavy work in order to extract parameters from the user's request Actions on Google integration BUT also: Android, iOS SDKs and other integrations NLU built-in

Actions on Google/Assistant @Google I/O 2017 https://events.google.com/io/schedule

Final thoughts

Final thoughts ➔ Next platform? Big developer/brand opportunity ◆ Platform fragmentation? ➔ Not all UI is better through a VUI ➔ Less but more friction ➔ Accessibility

Workshop Actions on Google Workshop @14h25

Questions? @elainedbatista @WajdiBenRabah

Resources ➔ Intro to A.I. Assistants ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20 ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne ➔ A new kind of UI: VUI ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA ◆ http://g.co/dev/ActionsChecklist ◆ http://g.co/dev/ActionsDesign ➔ Google Home and Google Assistant ◆ https://blog.google/products/assistant/personal-google-just-you/ ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/ ◆ https://twitter.com/RonAmadeo/status/843852120562552832 ➔ Actions on Google ◆ https://developers.google.com/actions/ ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk ➔ Final thoughts ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai