Actions Speak Louder Than Words

Actions on Google Talk given to GDG Cloud London on 10/11/2017

Transcript

1. Actions speak louder than words: Building Conversational Experiences with Actions on Google +StevenGray
 @frogo Google Developer Expert - Assistant
4. Google Home/Mobile device — The surface to interact with the Assistant. The Google Assistant — A conversation between you and Google that helps you get things done in your world. Actions on Google — How developers can extend the assistant (via Assistant apps)
5. How does it work? Design Develop Discover
6. Assistant app { conversation api request } { conversation api response } user input app response
7. Demo
8. Ok Google, talk to London Transport Status How’s the Met Line? Sure, here’s LTS Welcome to … It’s fine … Speech to Text NLP Knowledge Graph ML Ranking User Profile Text to Speech Speech to Text Text to Speech ... Invoke LTS action Parse query and generate response
9. “ Intent Matching — Match and categorise user utterances to an intent. Entity Extraction — Identify key words and phrases spoken by the user. @
13. Ok Google, talk to London Transport Status How’s the Met Line? Sure, here’s LTS Hey there … It’s fine … Speech to Text NLP Knowledge Graph ML Ranking User Profile Speech to Text Text to Speech ... ... ... Trigger WELCOME event ... NLP: Intent Matching Entity Extraction
15. Support different surface capabilities https://developers.google.com/actions/assistant/surface-capabilities AUDIO_OUTPUT SCREEN_OUTPUT
16. VUI != GUI
18. Designing for VUI 1. Create a Persona 2. Think outside the Box … Literally 3. In conversations there are no “errors”
20. Reach users... “I don’t understand you”
21. Designing for VUI real life user conditions {
22. Reach users…
23. In Dialogue Discovery: Explicit Triggering Ok Google, ask London Transport Status for number of buses Trigger Phrase App Name Developer Specified Action
 Preposition Action Phrase Developer Specified Working Examples: Let’s speak to Domino’s Ask Dr. Doggy if dogs can eat chocolate Ok Google, let’s talk to London Transport Status Trigger Phrase App Name Developer Specified
24. Hey Google, I want to play a game. Hey Google, tell me a joke. In Dialogue Discovery: Implicit Triggering Hey Google, I want to work out. Hey Google, what’s the surf report
25. Discovery in the Google Assistant Directory
26. Link to your Assistant App From anywhere

27. Where do I start?
28. g.co/dev/ActionsDesign
29. codelabs.developers.google.com
30. bit.ly/aog-tips More: goo.gl/PMdr7N
31. Actions on Google Developer Community https://g.co/actionsdev Actions on Google Developers https://developers.google.com/actions Actions on Google Twitter https://twitter.com/actionsongoogle
32. Thank you! #actionsspeaklouderthanwords steve@stevenjamesgray.com www.stevenjamesgray.com @frogo