Actions Speak Louder Than Words

Actions on Google Talk given to GDG Cloud London on 10/11/2017

Transcript

1. Actions speak louder than words:
   Building Conversational Experiences with
   Actions on Google
   +StevenGray

   @frogo
   Google Developer Expert - Assistant
   

   View Slide

2. View Slide

3. View Slide

4. Google Home/Mobile device — The surface to interact with
   the Assistant.
   The Google Assistant — A conversation between you and
   Google that helps you get things done in your world.
   Actions on Google — How developers can extend the
   assistant (via Assistant apps)
   

   View Slide

5. How does it work?
   Design Develop Discover
   

   View Slide

6. Assistant
   app
   { conversation
   api request }
   { conversation
   api response }
   user
   input
   app
   response
   

   View Slide

7. Demo
   

   View Slide

8. Ok Google, talk to
   London Transport
   Status
   How’s the Met
   Line?
   Sure, here’s
   LTS
   Welcome to …
   It’s fine …
   Speech to Text
   NLP
   Knowledge Graph
   ML Ranking
   User Profile
   Text to Speech
   Speech to Text
   Text to Speech
   ...
   Invoke LTS action
   Parse query and
   generate
   response
   

   View Slide

9. “ Intent Matching — Match and categorise user utterances to
   an intent.
   Entity Extraction — Identify key words and phrases spoken by
   the user.
   @
   

   View Slide

10. View Slide

11. View Slide

12. View Slide

13. Ok Google, talk to
    London Transport
    Status
    How’s the Met
    Line?
    Sure, here’s
    LTS
    Hey there …
    It’s fine …
    Speech to Text
    NLP
    Knowledge Graph
    ML Ranking
    User Profile
    Speech to Text
    Text to Speech
    ...
    ...
    ...
    Trigger
    WELCOME event
    ...
    NLP:
    Intent Matching
    Entity Extraction
    

    View Slide

14. View Slide

15. Support different surface capabilities
    https://developers.google.com/actions/assistant/surface-capabilities
    AUDIO_OUTPUT SCREEN_OUTPUT
    

    View Slide

16. VUI != GUI
    

    View Slide

17. View Slide

18. Designing for VUI
    1. Create a Persona
    2. Think outside the Box … Literally
    3. In conversations there are no “errors”
    

    View Slide

19. View Slide

20. Reach users...
    “I don’t understand you”
    

    View Slide

21. Designing for VUI
    real life
    user
    conditions
    {
    

    View Slide

22. Reach users…
    

    View Slide

23. In Dialogue Discovery:
    Explicit Triggering
    Ok Google, ask London Transport Status for number of buses
    Trigger Phrase App Name
    Developer Specified
    Action

    Preposition
    Action Phrase
    Developer Specified
    Working Examples: Let’s speak to Domino’s
    Ask Dr. Doggy if dogs can eat chocolate
    Ok Google, let’s talk to London Transport Status
    Trigger Phrase App Name
    Developer Specified
    

    View Slide

24. Hey Google, I want to play a game.
    Hey Google, tell me a joke.
    In Dialogue Discovery:
    Implicit Triggering
    Hey Google, I want to work out. Hey Google, what’s the surf report
    

    View Slide

25. Discovery in the
    Google Assistant
    Directory
    

    View Slide

26. Link to your
    Assistant App
    From anywhere

    

    View Slide

27. Where do I start?
    

    View Slide

28. g.co/dev/ActionsDesign
    

    View Slide

29. codelabs.developers.google.com
    

    View Slide

30. bit.ly/aog-tips
    More: goo.gl/PMdr7N
    

    View Slide

31. Actions on Google Developer Community
    https://g.co/actionsdev
    Actions on Google Developers
    https://developers.google.com/actions
    Actions on Google Twitter
    https://twitter.com/actionsongoogle
    

    View Slide

32. Thank you!
    #actionsspeaklouderthanwords
    steve@stevenjamesgray.com
    www.stevenjamesgray.com
    @frogo
    

    View Slide