Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creating Conversations For Chatbots and Voice Activated speakers

Creating Conversations For Chatbots and Voice Activated speakers

Lee Boonstra

June 01, 2018
Tweet

More Decks by Lee Boonstra

Other Decks in Technology

Transcript

  1. Proprietary + Confidential
    Lee Boonstra

    View Slide

  2. 2
    Google Cloud

    View Slide

  3. 3
    Google’s Mission
    Seven cloud products with
    ONE BILLION
    users each

    View Slide

  4. 4
    Google Cloud, like Lego...

    View Slide

  5. 5
    60+ products & services for building your custom solution.

    View Slide

  6. 6
    Google Cloud Platform

    View Slide

  7. 7
    You are the data
    controller
    We are a
    data
    processor

    View Slide

  8. 8

    View Slide

  9. 9
    Making compliance easier

    View Slide

  10. 10
    Machine Learning
    & Chatbots

    View Slide

  11. Confidential & Proprietary
    Chatbots & Voice Activated Speakers

    View Slide

  12. 12
    Chatbots exists since the 90’s…
    So why are they popular now?
    1994: First Chatbot 2016: Focus on AI First

    View Slide

  13. 13
    70% of
    requests are
    in natural
    language
    Is it gonna rain tomorrow?
    Tomorrow it will be sunny
    In Amsterdam!

    View Slide

  14. 14
    Machine Learning
    How did you learn your first
    language?
    or

    View Slide

  15. 15
    It’s easier to make computers
    learn than to build smarter computers
    Machine Learning
    Process of making
    computers learn
    Artificial Intelligence
    Process of building
    smarter computers

    View Slide

  16. 16
    Storage Compute

    View Slide

  17. 17
    Google Cloud brings battle hardened tech from Google products

    View Slide

  18. Confidential & Proprietary
    Google Home

    View Slide

  19. Confidential & Proprietary
    Google Home — Voice-activated
    speaker powered
    Google Assistant — A conversation
    between you and Google that helps you
    get more done in your world

    View Slide

  20. Confidential & Proprietary
    A conversation between you and Google
    that helps you get more done in your world

    View Slide

  21. Confidential & Proprietary
    Google Home

    View Slide

  22. Confidential & Proprietary
    Get help, anytime, anywhere






    View Slide

  23. Confidential & Proprietary
    Example of a
    Custom Use
    Case
    Ok Google, let me talk to BookAMeetingRoom
    Welcome, how can I help you?
    I want to book a meeting room
    for 3 persons.
    Sure! Here’s BookAMeetingRoom
    Sure, for when?
    Tomorrow, from 2pm to 3pm.

    View Slide

  24. 24
    Dialogflow
    Enterprise

    View Slide

  25. 25
    ● End-to-end development suite for building
    conversational UI.
    ● Previously known as API.AI
    ● Sept 2016, acquired by Google
    ● Powered by Machine Learning
    Dialogflow

    View Slide

  26. 26
    Why Dialogflow
    ● Powered by Machine Learning (NLP)
    ● Scalable: separate your conversation text from
    code
    ● Build faster with the Web UI
    ● Advanced fulfillment options and multi channel
    integrations
    ● Analytics
    ● Speech / Voice Integration
    ● Multi-lingual bot support (20+ languages)
    ● Part of Google Cloud (60+ cloud services)
    Intent
    Recognition
    (NLP)
    ...
    Web Console
    Powerful
    SDK
    Supervised
    Training
    Cross-platfor
    m

    View Slide

  27. 27
    Dialogflow Enterprise

    View Slide

  28. 28
    3 demo’s for the following user profiles:
    CONTENT WRITER
    ● Dialogflow Web UI (intents, entities,
    training, analytics, integration)
    ENGINEER
    ● Fulfillment (webhooks)
    ● Front-end
    END USER
    ● Multi Channel (Web, Google Assistant)
    Dialogflow Demo

    View Slide

  29. 29
    ● Entities vs. System Entities
    ● Intents
    ● Training
    ● Analytics
    ● Webhooks
    ● Integration
    ○ Example: For Web
    ■ Welcome Message
    ■ Rich Cards
    ○ Example: For Google Assistant
    Dialogflow Demo

    View Slide

  30. 30
    Multi Channel
    Build once. Integrate everywhere.
    Dialogflow
    Enterprise
    Content Writer, creates
    Conversational UI in
    Dialogflow
    User communicates
    With Agent.
    Deploy to websites & apps
    Deploy to chat channels and social media
    Deploy to voice activated speakers and assistants
    Deploy for phone and SMS services
    Dialogflow replies to
    a user session

    View Slide

  31. 31
    Dialogflow build process
    Setup GCP Account
    Design your Conversation
    in Dialogflow Enterprise
    Deploy for
    multi-channel
    Integrate with internal
    systems & APIs
    SDK, GCP
    integrations
    Test your agent
    Agent Training
    Agent Analytics
    Tweak your
    conversation in
    Dialogflow Enterprise
    Optional:
    Engineer Optional:
    Engineer
    Business
    / IT
    Content
    Writer
    Content
    Writer
    Content
    W
    riter

    View Slide

  32. 32
    Technical Designs
    Human bot take over
    User types in chat UI
    Chatbot or User replies
    Operator Dashboard
    Kubernetes Engine
    Container Registry
    Customer Client
    Kubernetes Engine
    Back-end
    Kubernetes Engine
    Back-end
    Kubernetes Engine
    NLP
    API
    ML call for
    sentiment
    detection
    Pass user
    utterance to
    chatbot
    Return text response to user
    User asks
    to talk with human
    Negative sentiment
    let a human take over the conversation
    Operator types in chat UI
    User replies
    Containers images can be
    stored in the Container Registry
    Dialogflow
    Enterprise

    View Slide

  33. Confidential + Proprietary
    Advanced Chatflow with machine learning bot analytics
    User types to custom UI
    or channel
    Chatbot replies
    Dialogflow
    Enterprise
    Customer Client
    JS Angular 5 web front-end
    Kubernetes Engine
    Chat Server
    Dialogflow SDK / socket.io
    Kubernetes Engine
    Back-end CRM
    Python / Django
    Kubernetes Engine
    Container
    Registry
    Containers images can be
    stored in the Container Registry
    Messaging Publisher
    Pub/Sub
    Webhook
    Router
    Cloud Function
    Webhook
    Container
    Builder
    Building Dev
    Pipelines

    View Slide

  34. Confidential + Proprietary
    Advanced Chatflow with machine learning and bot analytics
    User types to custom UI
    or channel
    Chatbot replies
    Dialogflow
    Enterprise
    Customer Client
    JS Angular 5 web front-end
    Kubernetes Engine
    Chat Server
    Dialogflow SDK / socket.io
    Kubernetes Engine
    Back-end CRM
    Python / Django
    Kubernetes Engine
    Subscription
    Cloud Function
    Sensitivity
    Filter
    DLP API
    Sentiment
    Detector
    NLP API
    Data
    Warehouse
    BigQuery
    Messaging Publisher
    Pub/Sub
    Webhook
    Router
    Cloud Function
    Webhook

    View Slide

  35. 35
    Cloud Functions
    Completely serverless & fully managed service
    ⇒ don’t worry about the ops!
    Automatic scaling and super-fast
    ⇒ grows with the success of your project
    ⇒ cost-effective
    Open and familiar
    ⇒ JavaScript / Node.js

    View Slide

  36. Confidential & Proprietary
    Bot Analytics

    View Slide

  37. Confidential & Proprietary
    Review & Approval
    Web-based portal
    ● Triggering Information
    ● Merchandising and information
    Approvals
    ● Automatic and manual policy checks
    ● Turn around in about 1 week

    View Slide

  38. Confidential & Proprietary
    Who is using Dialogflow today?

    View Slide

  39. Confidential & Proprietary
    Demo: A TV Guide
    Do it yourself:
    https://goo.gl/pH86aT
    Ok Google, let me talk to the TV Guide
    Welcome, I’m the Dutch TV
    Guide. You can ask me the
    following: What’s on a channel?
    What’s on RTL 4?
    Sure! Here’s The TV Guide
    Enter Earcon
    On RTL 4:
    At 7am: Nieuws
    At 7:30am: Nieuws
    ...
    Exit Earcon
    . . .

    View Slide

  40. 40
    g.co/dev/ActionsDesign

    View Slide

  41. Confidential & Proprietary
    Resources
    ● Google Dev Docs -
    https://developers.google.com/actions/develop/conversation
    ● Examples - https://github.com/actions-on-google
    ● Dialogflow - https://console.dialogflow.com
    ● Simulator - https://developers.google.com/actions/tools/web-simulator
    ● Hands-on Workshop Materials - https://goo.gl/pH86aT

    View Slide

  42. Confidential & Proprietary
    Thank you

    View Slide