Save 37% off PRO during our Black Friday Sale! »

The voice assistant you’ve always wanted...with Actions on Google!

The voice assistant you’ve always wanted...with Actions on Google!


Nicola Corti

October 26, 2017


  1. The voice assistant you’ve always wanted... ...with Actions on Google!

    Nicola Corti @cortinico Android @Yelp
  2. Intro slide Nicola Corti @cortinico

  3. Intro slide

  4. None
  5. • Presented at Google IO 16 • Use Natural Language

    Processing • Mobile -> AI Google Assistant
  6. Ask it anything

  7. Available everywhere • Get information from the Context • Sync

    response across devices • Ask other device to act
  8. #madebygoogle

  9. Works with your favourite apps

  10. Actions on Google Overview

  11. What is Actions on Google? • SDK for developing custom

    assistants • Fully integrated inside the Google Assistant • Just define your triggers “Ok Google, talk to…”
  12. Actions on Google Flow Ok Google, Talk to my calculator

    Sure! Here is my calculator What are you in the mood for? Speech-to-text Ok Google, Talk to my personal chef Sure! Here is my personal chef What are you in the mood for? It’s cold outside, so... Which kind of proteine you want to use? Text-to-Speech NLP Knoledge graph MLearning User profile Speech-to-text Text-to-speech Invoke My Personal Chef action Parse query and generate response HTTP Call DB Query
  13. Our stack

  14. Fully customizable Amazon Alexa Telegram Bots Messenger Bots Slack Bots

    Skype Bots Cortana DialogFlow Actions SDK Firebase Cloud Functions Heroku App Engine Any HTTPS webhook
  15. Deploy everywhere • Custom Assistants are available everywhere! • You

    need to pass a review process. • No need to install any package! • Strict name policy.
  16. Design Guidelines

  17. Conversation Basics 1. Pick the right use cases 2. Create

    a persona 3. Write dialogs 4. Test it out 5. Build and iterate
  18. Be your user! Yes, Yeah, Correct, That’s right! No,

    not Geneva, I said Jamaica No, not the 13th, the 30th, three zero You got the time right, but the date is wrong
  19. Be your user!

  20. Be your user! “UX is like telling a joke

    — if you have to explain it, you're doing it wrong”
  21. Unlock the power of spoken language

  22. Unlock the power of spoken language

  23. Unlock the power of spoken language

  24. Unlock the power of spoken language

  25. None
  26. Building your Assistant

  27. Support surface capabilities AUDIO_OUTPUT SCREEN_OUTPUT

  28. Guide the user

  29. Triggering Ok Google, talk to My Personal Chef Ok Google,

    ask My Personal Chef for a soup recipe Ok Google, I want to cook
  30. And more…! • Request for Permission (say for location) •

    Perform Transactions • OAuth2 or Google Sign-in
  31. Hands on!

  32. Community Program • Building your assistant • Make it approoved

    • 200$ bonus + Free AoG Tshirt • Follow-up with Milestones
  33. Codelabs/Samples • Codelab: Your first “Assistant” app • Codelab: Build

    an App for Assistant with Firebase and Dialogflow • Dialog flow Pre-built agents
  34. Thanks! Nicola Corti @cortinico