The voice assistant you’ve always wanted...with Actions on Google!

Transcript

1. The voice assistant you’ve always wanted... ...with Actions on Google! Nicola Corti @cortinico Android @Yelp
2. Intro slide Nicola Corti @cortinico corti.nico@gmail.com
3. Intro slide
5. • Presented at Google IO 16 • Use Natural Language Processing • Mobile -> AI Google Assistant
6. Ask it anything
7. Available everywhere • Get information from the Context • Sync response across devices • Ask other device to act
8. #madebygoogle
9. Works with your favourite apps
10. Actions on Google Overview
11. What is Actions on Google? • SDK for developing custom assistants • Fully integrated inside the Google Assistant • Just define your triggers “Ok Google, talk to…”
12. Actions on Google Flow Ok Google, Talk to my calculator Sure! Here is my calculator What are you in the mood for? Speech-to-text Ok Google, Talk to my personal chef Sure! Here is my personal chef What are you in the mood for? It’s cold outside, so... Which kind of proteine you want to use? Text-to-Speech NLP Knoledge graph MLearning User profile Speech-to-text Text-to-speech Invoke My Personal Chef action Parse query and generate response HTTP Call DB Query
13. Our stack
14. Fully customizable Amazon Alexa Telegram Bots Messenger Bots Slack Bots Skype Bots Cortana DialogFlow Actions SDK Converse.ai Firebase Cloud Functions Heroku App Engine Any HTTPS webhook
15. Deploy everywhere • Custom Assistants are available everywhere! • You need to pass a review process. • No need to install any package! • Strict name policy.
16. Design Guidelines
17. Conversation Basics 1. Pick the right use cases 2. Create a persona 3. Write dialogs 4. Test it out 5. Build and iterate
18. Be coperative...like your user! Yes, Yeah, Correct, That’s right! No, not Geneva, I said Jamaica No, not the 13th, the 30th, three zero You got the time right, but the date is wrong
19. Be coperative...like your user!
20. Be coperative...like your user! “UX is like telling a joke — if you have to explain it, you're doing it wrong”
21. Unlock the power of spoken language
22. Unlock the power of spoken language
23. Unlock the power of spoken language
24. Unlock the power of spoken language
26. Building your Assistant
27. Support surface capabilities AUDIO_OUTPUT SCREEN_OUTPUT
28. Guide the user
29. Triggering Ok Google, talk to My Personal Chef Ok Google, ask My Personal Chef for a soup recipe Ok Google, I want to cook
30. And more…! • Request for Permission (say for location) • Perform Transactions • OAuth2 or Google Sign-in
31. Hands on!
32. Community Program • Building your assistant • Make it approoved • 200$ bonus + Free AoG Tshirt • Follow-up with Milestones
33. Codelabs/Samples • Codelab: Your first “Assistant” app • Codelab: Build an App for Assistant with Firebase and Dialogflow • Dialog flow Pre-built agents
34. Thanks! Nicola Corti @cortinico corti.nico@gmail.com