Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creating Conversations for Google Home

Lee Boonstra
September 18, 2017

Creating Conversations for Google Home

Creating Conversations for Google Home - Api.ai / Conversation Engine - Machine Learning.

Lee Boonstra

September 18, 2017
Tweet

More Decks by Lee Boonstra

Other Decks in Technology

Transcript

  1. Creating
    Conversations For
    Chatbots and Voice
    Activated speakers
    By Lee Boonstra
    Customer Engineer, Google

    View Slide

  2. Agenda
    ● About chatbots and conversation agents
    ● What’s Google Home
    ● Powered by Machine Learning
    ● How to create custom conversation agents

    View Slide

  3. of web browsing
    sessions will be
    done without a
    screen.
    of all searches
    will be voice.
    of customer
    interactions will
    be managed
    without a human.
    By 2020...
    Gartner
    ComScore
    Gartner
    30% 50% >85%

    View Slide

  4. This is possible
    through
    webservices
    and APIs...
    {
    “id”: “4f932d9-5678902”,
    “timestamp”: “2017-05-26”,
    “lang”: “en”,
    “result”: {
    “source”: “agent”,
    “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”,
    “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” }
    }

    View Slide

  5. How do you go
    from code to
    conversation?

    View Slide

  6. Chatbots & Voice Activated Speakers

    View Slide

  7. ...but chatbots exist since the 90’s?
    COMPUTER SAYS NO
    1994: First chatbot 2016: AI First

    View Slide

  8. Google Home

    View Slide

  9. Google Home — Voice-activated
    speaker powered
    Google Assistant — A conversation
    between you and Google that helps you
    get more done in your world

    View Slide

  10. A conversation between you and Google
    that helps you get more done in your world

    View Slide

  11. View Slide

  12. Get help, anytime, anywhere
    ● Manage tasks
    ● Plan the day
    ● Get answers
    ● Make memories
    ● Control your home
    ● Enjoy Entertainment

    View Slide

  13. Ok Google, let me talk to BookAMeetingRoom
    Welcome, how can I help you?
    I want to book a meeting room
    for 3 persons.
    Sure! Here’s BookAMeetingRoom
    Sure, for when?
    Tomorrow, from 2pm to 3pm.
    Example of a Custom Use Case

    View Slide

  14. Powered by
    Machine Learning

    View Slide

  15. “We will move from mobile first to
    an AI first world. We see huge
    opportunities to dramatically
    improve how people work.”
    Sundar Pichai
    CEO, Google

    View Slide

  16. or
    How did you learn your first language?
    or

    View Slide

  17. View Slide

  18. It’s easier to make computer learn than to build
    smarter computers
    Machine Learning
    Process of making
    computers learn
    Artificial Intelligence
    Process of building
    smarter computers

    View Slide

  19. View Slide

  20. 20
    Storage Compute

    View Slide

  21. 21
    Google Cloud brings battle hardened tech from Google products

    View Slide

  22. Machine Learning in Google Cloud
    Pre-Trained Models
    Train your own Conversation Agents

    View Slide

  23. Creating
    Custom Conversation
    Agents

    View Slide

  24. An engine for building advanced conversations
    http://www.api.ai
    14 languages
    32 platform SDKs
    and integrations
    200K+ developers

    View Slide

  25. Conversation Engine
    Enterprise version with SLA and Google Cloud integration.

    View Slide

  26. A Conversation Flow In Production
    Your APIs
    and services

    View Slide

  27. Invoke “My Banking Agent” action
    [user start typing]
    Intent Recognition
    Context Awareness
    Training
    Multi-language
    support
    CRM
    Other systems
    & APIs
    Directory
    Natural Language API
    Container Engine
    Cloud Functions
    Compute Engine
    AppEngine
    “Welcome, how can I help you?”
    “I like to transfer 50 euro to
    my wife’s bank account.”
    “Sure, I’ve transfered 50 euro to your
    wife’s bank account.”
    “Do you want to hear your new balance?”

    View Slide

  28. Invoke “My Banking Agent” action
    “Welcome, how can I help you?”
    “Sure, I’ve transfered 50 euro to your
    wife’s bank account.”
    “Do you want to hear your new balance?”
    “I like to transfer 50 euro to
    my wife’s bank account.”
    Intent Recognition
    Context Awareness
    Training
    Multi-language
    support
    CRM
    Other systems
    & APIs
    Directory
    Natural Language API
    Container Engine
    Cloud Functions
    Compute Engine
    AppEngine
    “Ok Google, talk to My
    Banking Agent”
    “Sure, here’s My
    Banking Agent”

    View Slide

  29. WebIntents
    An intent
    represents a
    mapping between
    what a user says
    and what action
    should be taken
    by your software.

    View Slide

  30. Entities
    Entities are
    objects your
    app or device
    takes action
    on.

    View Slide

  31. Training
    ● Train your intents

    View Slide

  32. Webhooks (Fulfillment)
    Webhook integration allows you to pass information from a matched intent into a web service and
    get a result from it.
    You can pass in entities as a parameter, to post to a webservice.

    View Slide

  33. “Transfer 50 euro to
    my wife’s bank
    account?”
    50 euro
    Example of a webhook
    WebService.transferMoney(‘50eur’,‘NL99ABNA0123456789’)
    Sure. I’ve transfered 50 euro to your
    wife her bank account.
    my
    wife’s

    View Slide

  34. Integrations
    ● On your website
    ● In your (native) app
    ● Skype, Facebook, Twitter….
    ● Siri
    ● Alexa
    ● Cortana

    View Slide

  35. Bot Analytics
    ● Amount Used Intents
    ● Amount Used Queries
    ● Time of response

    View Slide

  36. Advanced Solutions

    View Slide

  37. 37

    View Slide

  38. Review & Approval
    Web-based portal
    ● Triggering Information
    ● Merchandising and information
    Approvals
    ● Automatic and manual policy checks
    ● Turn around in about 1 week

    View Slide

  39. Who is using api.ai today?

    View Slide

  40. ING Belgium
    ING presented their usecase at Google Next Amsterdam:
    https://youtu.be/ycONHpmxQL8?t=26m9s

    View Slide

  41. It’s hot & happening!

    View Slide

  42. Demo: A TV Guide
    Do it yourself: https://goo.gl/fdCh3I
    Ok Google, let me talk to the TV Guide
    Welcome, I’m the Dutch TV
    Guide. You can ask me the
    following: What’s on a channel?
    What’s on RTL 4?
    Sure! Here’s The TV Guide
    Enter Earcon
    On RTL 4:
    At 7am: Nieuws
    At 7:30am: Nieuws
    ...
    Exit Earcon
    . . .

    View Slide

  43. 43
    g.co/dev/ActionsDesign

    View Slide

  44. Resources
    ● Google Dev Docs -
    https://developers.google.com/actions/develop/conversation
    ● Examples - https://github.com/actions-on-google
    ● API.AI - https://console.api.ai
    ● Simulator - https://developers.google.com/actions/tools/web-simulator
    ● Hands-on Materials - https://goo.gl/fdCh3I

    View Slide

  45. Thank you

    View Slide