The voice assistant you’ve always wanted...with Actions on Google!

Transcript

1. The voice assistant you’ve
   always wanted...
   ...with Actions on Google!
   Nicola Corti
   @cortinico
   Android @Yelp
   

   View Slide

2. Intro slide
   Nicola Corti
   @cortinico
   corti.nico@gmail.com
   

   View Slide

3. Intro slide
   

   View Slide

4. View Slide

5. ● Presented at Google IO 16
   ● Use Natural Language Processing
   ● Mobile -> AI
   Google Assistant
   

   View Slide

6. Ask it anything
   

   View Slide

7. Available everywhere
   ● Get information from the Context
   ● Sync response across devices
   ● Ask other device to act
   

   View Slide

8. #madebygoogle
   

   View Slide

9. Works with your favourite apps
   

   View Slide

10. Actions on
    Google
    Overview
    

    View Slide

11. What is Actions on Google?
    ● SDK for developing custom
    assistants
    ● Fully integrated inside the
    Google Assistant
    ● Just define your triggers
    “Ok Google,
    talk to…”
    

    View Slide

12. Actions on Google Flow
    Ok Google,
    Talk to my calculator
    Sure! Here is my
    calculator
    What are you in the
    mood for?
    Speech-to-text
    Ok Google,
    Talk to my
    personal chef
    Sure! Here is
    my personal
    chef
    What are you
    in the mood
    for?
    It’s cold
    outside, so...
    Which kind of
    proteine you
    want to use?
    Text-to-Speech
    NLP
    Knoledge graph
    MLearning
    User profile
    Speech-to-text
    Text-to-speech
    Invoke My
    Personal Chef
    action
    Parse query and
    generate
    response
    HTTP Call
    DB Query
    

    View Slide

13. Our stack
    

    View Slide

14. Fully customizable
    Amazon Alexa
    Telegram Bots
    Messenger Bots
    Slack Bots
    Skype Bots
    Cortana
    DialogFlow
    Actions SDK
    Converse.ai
    Firebase Cloud Functions
    Heroku
    App Engine
    Any HTTPS webhook
    

    View Slide

15. Deploy everywhere
    ● Custom Assistants are available everywhere!
    ● You need to pass a review process.
    ● No need to install any package!
    ● Strict name policy.
    

    View Slide

16. Design
    Guidelines
    

    View Slide

17. Conversation Basics
    1. Pick the right use cases
    2. Create a persona
    3. Write dialogs
    4. Test it out
    5. Build and iterate
    

    View Slide

18. Be coperative...like your user!
    Yes,
    Yeah,
    Correct,
    That’s right!
    No, not Geneva, I said Jamaica
    No, not the 13th, the 30th, three zero
    You got the time right, but the date is wrong
    

    View Slide

19. Be coperative...like your user!
    

    View Slide

20. Be coperative...like your user!
    “UX is like telling a joke — if you have to explain it, you're doing it wrong”
    

    View Slide

21. Unlock the power of spoken language
    

    View Slide

22. Unlock the power of spoken language
    

    View Slide

23. Unlock the power of spoken language
    

    View Slide

24. Unlock the power of spoken language
    

    View Slide

25. View Slide

26. Building your
    Assistant
    

    View Slide

27. Support surface capabilities
    AUDIO_OUTPUT SCREEN_OUTPUT
    

    View Slide

28. Guide the user
    

    View Slide

29. Triggering
    Ok Google, talk to My Personal Chef
    Ok Google, ask My Personal Chef for a soup recipe
    Ok Google, I want to cook
    

    View Slide

30. And more…!
    ● Request for Permission (say for location)
    ● Perform Transactions
    ● OAuth2 or Google Sign-in
    

    View Slide

31. Hands on!
    

    View Slide

32. Community Program
    ● Building your assistant
    ● Make it approoved
    ● 200$ bonus + Free AoG Tshirt
    ● Follow-up with Milestones
    

    View Slide

33. Codelabs/Samples
    ● Codelab: Your first “Assistant” app
    ● Codelab: Build an App for Assistant with Firebase and Dialogflow
    ● Dialog flow Pre-built agents
    

    View Slide

34. Thanks!
    Nicola Corti
    @cortinico
    corti.nico@gmail.com
    

    View Slide