Intro to Google Assistant and Actions on Google

Talk made at Android Makers 2017.

Transcript

1. INTRO TO GOOGLE ASSISTANT & ACTIONS ON GOOGLE Elaine Dias Batista @elainedbatista Wajdi Ben Rabah @WajdiBenRabah
2. Who are we? Elaine Wajdi
3. Outline ➔ Intro to A.I. Assistants ➔ A new kind of UI: VUI ➔ Google Home and Google Assistant ➔ Actions on Google ➔ Final thoughts
4. Intro to A.I. Assistants
5. A.I. Assistants/Platform shift Mobile New idea Frenzy Scaling Maturity PCs ? Maturity You are here Inspired from: http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world
6. A.I. Assistants/Platform shift "From mobile first to AI-first" Sundar Pichai October 4th, 2016
7. Sources User Input A.I. Assistants/What is it anyway?! A.I. Assistant Text Sensors Actions Answer Question
8. A.I. Assistants/Some examples Apple's Siri 2011 Microsoft's Cortana 2014 Amazon's Alexa 2014 Google's Assistant 2016 Samsung's Bixby 2017
9. A new kind of UI: VUI
10. VUI/Human to human vs. Human to computer Spoken Language 100,000 years Chat bots & AI Assistants <7 years Dictation software 20 years Smartphones 25 years Internet 30 years Word processor 40 years Speech recognition 50 years Computers 70 years TTS 80 years Typing 150 years Print 575 years Writing 5,000 years Inspired from: https://www.youtube.com/watch?v=MSUPVbbhIGA
11. VUI/Some design principles Create a persona Context No errors Character Pace Tone Energy level Where is the user? What are they doing? Which device? "Sorry, try Command 1"
12. VUI/User journeys "Command 1" User Assistant "Got it" "Command 2" "Got it, here's what you want" Canonical "Happy path" "Command -1" "Try Command 1 instead" "Command 1" "Got it, here's what you want" 1st time experience "Got it, here's what you want" Tapered experience
13. VUI/Actions Checklist g.co/dev/ActionsChecklist
14. Google Home and Google Assistant
15. G. Home & G. Assistant/Intro How about having your personal assistant wherever you’re? How about a new VUI?, just ask for things to be done for you. An evolutive AI made by Google ready to help!
16. G. Home & G. Assistant/Google Home Specs
17. G. Home & G. Assistant/What can I do with it?! ➔ Play a YouTube video on a chromecast enabled device ➔ Play music (Play Music, Spotify) ➔ Monitor the Nest Thermostat ➔ Ask for events on your calendar ➔ Block the next hour on your calendar (with IFTTT) ➔ Get a summary for your day ➔ Play voice games ➔ Personality questions
18. G. Home & G. Assistant/Device compatibility
19. G. Home & G. Assistant/Fragmentation Pixel Home Wear Allo Play music Set reminders Add item to shopping list Get the news Send messages Device controls Search with Google Order an Uber Set timers, set alarms, get the weather, find answers, translations, ...
20. Actions on Google
21. Actions on Google
22. Actions on Google/Actions SDK
23. Actions on Google/API.AI
24. Actions on Google/API.AI
25. Actions on Google/Developer tools summary Actions on Google Actions SDK API.AI NodeJS library that helps you use the Conversation API You have to do all the heavy work in order to extract parameters from the user's request Actions on Google integration BUT also: Android, iOS SDKs and other integrations NLU built-in
26. Actions on Google/Assistant @Google I/O 2017 https://events.google.com/io/schedule
27. Final thoughts
28. Final thoughts ➔ Next platform? Big developer/brand opportunity ◆ Platform fragmentation? ➔ Not all UI is better through a VUI ➔ Less but more friction ➔ Accessibility
29. Workshop Actions on Google Workshop @14h25
30. Questions? @elainedbatista @WajdiBenRabah
31. Resources ➔ Intro to A.I. Assistants ◆ http://ben-evans.com/benedictevans/2016/12/8/mobile-is-eating-the-world ◆ http://ben-evans.com/benedictevans/2017/1/30/mobile-20 ◆ https://developer.microsoft.com/en-us/windows/iot/docs/whatsne ➔ A new kind of UI: VUI ◆ https://www.youtube.com/watch?v=MSUPVbbhIGA ◆ http://g.co/dev/ActionsChecklist ◆ http://g.co/dev/ActionsDesign ➔ Google Home and Google Assistant ◆ https://blog.google/products/assistant/personal-google-just-you/ ◆ http://www.androidpolice.com/2017/02/13/google-assistant-four-months-later/ ◆ https://twitter.com/RonAmadeo/status/843852120562552832 ➔ Actions on Google ◆ https://developers.google.com/actions/ ◆ https://www.youtube.com/watch?v=7e0RGIul8Kk ➔ Final thoughts ◆ http://ben-evans.com/benedictevans/2017/2/22/voice-and-the-uncanny-valley-of-ai