Actions Speak Louder Than Words

0ae09092606666ea375bdd12052fd77a?s=47 Steven Gray
November 10, 2017

Actions Speak Louder Than Words

Actions on Google Talk given to GDG Cloud London on 10/11/2017

0ae09092606666ea375bdd12052fd77a?s=128

Steven Gray

November 10, 2017
Tweet

Transcript

  1. Actions speak louder than words: Building Conversational Experiences with Actions

    on Google +StevenGray
 @frogo Google Developer Expert - Assistant
  2. None
  3. None
  4. Google Home/Mobile device — The surface to interact with the

    Assistant. The Google Assistant — A conversation between you and Google that helps you get things done in your world. Actions on Google — How developers can extend the assistant (via Assistant apps)
  5. How does it work? Design Develop Discover

  6. Assistant app { conversation api request } { conversation api

    response } user input app response
  7. Demo

  8. Ok Google, talk to London Transport Status How’s the Met

    Line? Sure, here’s LTS Welcome to … It’s fine … Speech to Text NLP Knowledge Graph ML Ranking User Profile Text to Speech Speech to Text Text to Speech ... Invoke LTS action Parse query and generate response
  9. “ Intent Matching — Match and categorise user utterances to

    an intent. Entity Extraction — Identify key words and phrases spoken by the user. @
  10. None
  11. None
  12. None
  13. Ok Google, talk to London Transport Status How’s the Met

    Line? Sure, here’s LTS Hey there … It’s fine … Speech to Text NLP Knowledge Graph ML Ranking User Profile Speech to Text Text to Speech ... ... ... Trigger WELCOME event ... NLP: Intent Matching Entity Extraction
  14. None
  15. Support different surface capabilities https://developers.google.com/actions/assistant/surface-capabilities AUDIO_OUTPUT SCREEN_OUTPUT

  16. VUI != GUI

  17. None
  18. Designing for VUI 1. Create a Persona 2. Think outside

    the Box … Literally 3. In conversations there are no “errors”
  19. None
  20. Reach users... “I don’t understand you”

  21. Designing for VUI real life user conditions {

  22. Reach users…

  23. In Dialogue Discovery: Explicit Triggering Ok Google, ask London Transport

    Status for number of buses Trigger Phrase App Name Developer Specified Action
 Preposition Action Phrase Developer Specified Working Examples: Let’s speak to Domino’s Ask Dr. Doggy if dogs can eat chocolate Ok Google, let’s talk to London Transport Status Trigger Phrase App Name Developer Specified
  24. Hey Google, I want to play a game. Hey Google,

    tell me a joke. In Dialogue Discovery: Implicit Triggering Hey Google, I want to work out. Hey Google, what’s the surf report
  25. Discovery in the Google Assistant Directory

  26. Link to your Assistant App From anywhere


  27. Where do I start?

  28. g.co/dev/ActionsDesign

  29. codelabs.developers.google.com

  30. bit.ly/aog-tips More: goo.gl/PMdr7N

  31. Actions on Google Developer Community https://g.co/actionsdev Actions on Google Developers

    https://developers.google.com/actions Actions on Google Twitter https://twitter.com/actionsongoogle
  32. Thank you! #actionsspeaklouderthanwords steve@stevenjamesgray.com www.stevenjamesgray.com @frogo