$30 off During Our Annual Pro Sale. View Details »

Actions on Google workshop

Actions on Google workshop

Workshop slides for Actions on Google workshop done at Android Makers 2017. Source available here: https://github.com/Sfeir/actions-on-google

elainedb

April 11, 2017
Tweet

More Decks by elainedb

Other Decks in Programming

Transcript

  1. ACTIONS ON GOOGLE
    WORKSHOP
    Elaine Dias Batista
    @elainedbatista
    Wajdi Ben Rabah
    @WajdiBenRabah

    View Slide

  2. Who are we?
    Elaine Wajdi

    View Slide

  3. Outline
    ➔ Google Assistant
    ➔ VUI
    ➔ How to develop for the Google Assistant platform
    ◆ Your first custom action!
    ◆ Going further

    View Slide

  4. Google Assistant

    View Slide

  5. Google Assistant
    Your own personal assistant.
    Ask it to do things on
    - Google Home
    - Android Wear devices
    - Android Phones
    - Android TV
    - Android Auto

    View Slide

  6. VUI: Voice User Interface

    View Slide

  7. VUI/Actions Checklist
    g.co/dev/ActionsChecklist

    View Slide

  8. How to develop for the
    Google Assistant platform

    View Slide

  9. Actions on Google/Developer tools summary
    Actions on
    Google
    Actions
    SDK
    API.AI
    NodeJS library that helps you use the
    Conversation API
    You have to do all the heavy work in order to
    extract parameters from the user's request
    Actions on Google integration
    BUT also: Android, iOS SDKs
    and other integrations
    NLU built-in

    View Slide

  10. Actions on Google/Developer tools summary
    Actions on
    Google
    Actions
    SDK
    API.AI
    NodeJS library that helps you use the
    Conversation API
    You have to do all the heavy work in order to
    extract parameters from the user's request
    Actions on Google integration
    BUT also: Android, iOS SDKs
    and other integrations
    NLU built-in

    View Slide

  11. Actions on Google/API.AI

    View Slide

  12. Developer tools/API.AI
    A cross-platform tool for building advanced
    conversational interfaces.

    View Slide

  13. Your first custom action!

    View Slide

  14. Your 1st Action
    1. Step-by-step
    2. Using a prebuilt agent
    3. Fulfillments
    a. Simple
    b. Firebase connection
    4. Actions on Google integration
    a. Testing your action on a Google Home device
    b. Deployment to all users

    View Slide

  15. Android integration

    View Slide

  16. API.AI/Android Integration
    https://github.com/api-ai/apiai-android-client

    View Slide

  17. Going further

    View Slide

  18. Going further
    - IFTTT / Tasker
    - Actions SDK with TensorFlow
    - Porting text-based games to Actions on Google:
    https://medium.com/@leonnicholls/interactive-fiction-actions-part-1-ca022b4d088d
    https://developers.googleblog.com/2017/03/game-developers-rejoicenew-tools-for.html
    - API integrations
    - Asking for permissions
    - User's location
    - User's name

    View Slide

  19. Resources

    View Slide

  20. Resources
    https://www.youtube.com/watch?v=7e0RGIul8Kk - Extending the Google Assistant with Actions on Google (Google Cloud Next '17)
    https://www.youtube.com/watch?v=9SUAuy9OJg4 Actions on Google: Building Assistant Actions using API.AI (Google developers youtube channel)
    https://developers.google.com/actions/ Actions on Google : getting started

    View Slide