Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The voice assistant you’ve always wanted...with Actions on Google!

The voice assistant you’ve always wanted...with Actions on Google!

Nicola Corti

October 26, 2017
Tweet

More Decks by Nicola Corti

Other Decks in Technology

Transcript

  1. The voice assistant you’ve
    always wanted...
    ...with Actions on Google!
    Nicola Corti
    @cortinico
    Android @Yelp

    View Slide

  2. Intro slide
    Nicola Corti
    @cortinico
    [email protected]

    View Slide

  3. Intro slide

    View Slide

  4. View Slide

  5. ● Presented at Google IO 16
    ● Use Natural Language Processing
    ● Mobile -> AI
    Google Assistant

    View Slide

  6. Ask it anything

    View Slide

  7. Available everywhere
    ● Get information from the Context
    ● Sync response across devices
    ● Ask other device to act

    View Slide

  8. #madebygoogle

    View Slide

  9. Works with your favourite apps

    View Slide

  10. Actions on
    Google
    Overview

    View Slide

  11. What is Actions on Google?
    ● SDK for developing custom
    assistants
    ● Fully integrated inside the
    Google Assistant
    ● Just define your triggers
    “Ok Google,
    talk to…”

    View Slide

  12. Actions on Google Flow
    Ok Google,
    Talk to my calculator
    Sure! Here is my
    calculator
    What are you in the
    mood for?
    Speech-to-text
    Ok Google,
    Talk to my
    personal chef
    Sure! Here is
    my personal
    chef
    What are you
    in the mood
    for?
    It’s cold
    outside, so...
    Which kind of
    proteine you
    want to use?
    Text-to-Speech
    NLP
    Knoledge graph
    MLearning
    User profile
    Speech-to-text
    Text-to-speech
    Invoke My
    Personal Chef
    action
    Parse query and
    generate
    response
    HTTP Call
    DB Query

    View Slide

  13. Our stack

    View Slide

  14. Fully customizable
    Amazon Alexa
    Telegram Bots
    Messenger Bots
    Slack Bots
    Skype Bots
    Cortana
    DialogFlow
    Actions SDK
    Converse.ai
    Firebase Cloud Functions
    Heroku
    App Engine
    Any HTTPS webhook

    View Slide

  15. Deploy everywhere
    ● Custom Assistants are available everywhere!
    ● You need to pass a review process.
    ● No need to install any package!
    ● Strict name policy.

    View Slide

  16. Design
    Guidelines

    View Slide

  17. Conversation Basics
    1. Pick the right use cases
    2. Create a persona
    3. Write dialogs
    4. Test it out
    5. Build and iterate

    View Slide

  18. Be coperative...like your user!
    Yes,
    Yeah,
    Correct,
    That’s right!
    No, not Geneva, I said Jamaica
    No, not the 13th, the 30th, three zero
    You got the time right, but the date is wrong

    View Slide

  19. Be coperative...like your user!

    View Slide

  20. Be coperative...like your user!
    “UX is like telling a joke — if you have to explain it, you're doing it wrong”

    View Slide

  21. Unlock the power of spoken language

    View Slide

  22. Unlock the power of spoken language

    View Slide

  23. Unlock the power of spoken language

    View Slide

  24. Unlock the power of spoken language

    View Slide

  25. View Slide

  26. Building your
    Assistant

    View Slide

  27. Support surface capabilities
    AUDIO_OUTPUT SCREEN_OUTPUT

    View Slide

  28. Guide the user

    View Slide

  29. Triggering
    Ok Google, talk to My Personal Chef
    Ok Google, ask My Personal Chef for a soup recipe
    Ok Google, I want to cook

    View Slide

  30. And more…!
    ● Request for Permission (say for location)
    ● Perform Transactions
    ● OAuth2 or Google Sign-in

    View Slide

  31. Hands on!

    View Slide

  32. Community Program
    ● Building your assistant
    ● Make it approoved
    ● 200$ bonus + Free AoG Tshirt
    ● Follow-up with Milestones

    View Slide

  33. Codelabs/Samples
    ● Codelab: Your first “Assistant” app
    ● Codelab: Build an App for Assistant with Firebase and Dialogflow
    ● Dialog flow Pre-built agents

    View Slide

  34. Thanks!
    Nicola Corti
    @cortinico
    [email protected]

    View Slide