$30 off During Our Annual Pro Sale. View Details »

Actions Speak Louder Than Words

Steven Gray
November 10, 2017

Actions Speak Louder Than Words

Actions on Google Talk given to GDG Cloud London on 10/11/2017

Steven Gray

November 10, 2017
Tweet

More Decks by Steven Gray

Other Decks in Technology

Transcript

  1. Actions speak louder than words:
    Building Conversational Experiences with
    Actions on Google
    +StevenGray

    @frogo
    Google Developer Expert - Assistant

    View Slide

  2. View Slide

  3. View Slide

  4. Google Home/Mobile device — The surface to interact with
    the Assistant.
    The Google Assistant — A conversation between you and
    Google that helps you get things done in your world.
    Actions on Google — How developers can extend the
    assistant (via Assistant apps)

    View Slide

  5. How does it work?
    Design Develop Discover

    View Slide

  6. Assistant
    app
    { conversation
    api request }
    { conversation
    api response }
    user
    input
    app
    response

    View Slide

  7. Demo

    View Slide

  8. Ok Google, talk to
    London Transport
    Status
    How’s the Met
    Line?
    Sure, here’s
    LTS
    Welcome to …
    It’s fine …
    Speech to Text
    NLP
    Knowledge Graph
    ML Ranking
    User Profile
    Text to Speech
    Speech to Text
    Text to Speech
    ...
    Invoke LTS action
    Parse query and
    generate
    response

    View Slide

  9. “ Intent Matching — Match and categorise user utterances to
    an intent.
    Entity Extraction — Identify key words and phrases spoken by
    the user.
    @

    View Slide

  10. View Slide

  11. View Slide

  12. View Slide

  13. Ok Google, talk to
    London Transport
    Status
    How’s the Met
    Line?
    Sure, here’s
    LTS
    Hey there …
    It’s fine …
    Speech to Text
    NLP
    Knowledge Graph
    ML Ranking
    User Profile
    Speech to Text
    Text to Speech
    ...
    ...
    ...
    Trigger
    WELCOME event
    ...
    NLP:
    Intent Matching
    Entity Extraction

    View Slide

  14. View Slide

  15. Support different surface capabilities
    https://developers.google.com/actions/assistant/surface-capabilities
    AUDIO_OUTPUT SCREEN_OUTPUT

    View Slide

  16. VUI != GUI

    View Slide

  17. View Slide

  18. Designing for VUI
    1. Create a Persona
    2. Think outside the Box … Literally
    3. In conversations there are no “errors”

    View Slide

  19. View Slide

  20. Reach users...
    “I don’t understand you”

    View Slide

  21. Designing for VUI
    real life
    user
    conditions
    {

    View Slide

  22. Reach users…

    View Slide

  23. In Dialogue Discovery:
    Explicit Triggering
    Ok Google, ask London Transport Status for number of buses
    Trigger Phrase App Name
    Developer Specified
    Action

    Preposition
    Action Phrase
    Developer Specified
    Working Examples: Let’s speak to Domino’s
    Ask Dr. Doggy if dogs can eat chocolate
    Ok Google, let’s talk to London Transport Status
    Trigger Phrase App Name
    Developer Specified

    View Slide

  24. Hey Google, I want to play a game.
    Hey Google, tell me a joke.
    In Dialogue Discovery:
    Implicit Triggering
    Hey Google, I want to work out. Hey Google, what’s the surf report

    View Slide

  25. Discovery in the
    Google Assistant
    Directory

    View Slide

  26. Link to your
    Assistant App
    From anywhere


    View Slide

  27. Where do I start?

    View Slide

  28. g.co/dev/ActionsDesign

    View Slide

  29. codelabs.developers.google.com

    View Slide

  30. bit.ly/aog-tips
    More: goo.gl/PMdr7N

    View Slide

  31. Actions on Google Developer Community
    https://g.co/actionsdev
    Actions on Google Developers
    https://developers.google.com/actions
    Actions on Google Twitter
    https://twitter.com/actionsongoogle

    View Slide

  32. Thank you!
    #actionsspeaklouderthanwords
    [email protected]
    www.stevenjamesgray.com
    @frogo

    View Slide