Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Digital Wednesday

Lee Boonstra
November 29, 2018

Digital Wednesday

Lee Boonstra

November 29, 2018

More Decks by Lee Boonstra

Other Decks in Technology


  1. Use cases in the contact center and beyond • Customer

    service • E-commerce • Home entertainment • Auto • Organizational knowledge • Onboarding & Helpdesk
  2. Consumers have high expectations Based on data collected in Fall

    2017 from sample of 1,051 U.S. adults, ages 18-64.
  3. 5 50% of enterprises spend more time on creating bots

    than on mobile app development by 2021 —Gartner
  4. 6 Chatbots are expected to trim business costs by more

    than $8 billion per year by 2022. - Juniper Research
  5. 10 It’s easier to make computers learn than to build

    smarter computers Machine Learning Process of making computers learn Artificial Intelligence Process of building smarter computers
  6. Dialogflow users benefit from world-class AI assets & capabilities, including:

    Google is an AI company Goal: Make AI easy, fast, and useful for enterprises and developers Machine learning leadership Natural language understanding Knowledge graph Search across unstructured data Speech recognition & synthesis TPUs and unrivaled compute infra for ML
  7. Cloud AI Less ML expertise More ML expertise Cloud AI

    solutions Cloud Job Discovery Contact Center Document Understanding Cloud AI building blocks Cloud AI platform Cloud ML Engine Cloud Video Intelligence ML professionals & service partners ASL Professional Services Organization Cloud AutoML Vision Vision Cloud Vision Language Conversation Cloud Natural Language Cloud AutoML NL Dialogflow Enterprise Cloud Translation Cloud Speech-to-Text Cloud Text-to-Speech Cloud AutoML Translation New New New Cloud GPU Cloud TPU Cloud Dataflow Cloud Dataproc Machine & Deep Learning ML accelerators ML libraries Tensorflow Kubeflow Kaggle/datasets Datasets
  8. 14 Bots to improve your customer experience Callbots in callcenters

    Chatbots in websites, apps or social media platforms. Voice Activated Speakers & smart assistants.
  9. 15 70% of requests are in natural language Is it

    gonna rain tomorrow? Tomorrow it will be sunny In Amsterdam!
  10. 16 A conversation between you and Google that helps you

    get more done in your world Meet the Google Assistant
  11. 17 Terminology Google Assistant — The virtual assistant of Google.

    Out of the box on Android 6+. For iOS available as app. Action — A third party app, running on top of the Google Assistant. Google Home — Voice-activated speaker powered by Voice. Smart Display — Voice-activated speaker with screen powered by Voice and Touch.
  12. 18 • Manage tasks Ok Google, what’s my confirmation number

    for my flight? • Plan the day Ok Google, how is my commute to the office? • Get answers: Ok Google, who is the King of the Netherlands? • Make memories Ok Google, remember I left my keys on the Kitchen table. • Control your home Ok Google, turn off the bedroom lights. • Enjoy Entertainment Ok Google, play the Pixies on Spotify. Things you can ask Google...
  13. 21 3rd party integration Extend the Google Assistant with your

    own custom actions. Hey Google, let me talk to BookAMeetingRoom Welcome, how can I help you? I want to book a meeting room for 3 persons. Let’s get BookAMeetingRoom Sure, for when? Tomorrow, from 2pm to 3pm.
  14. Confidential + Proprietary Confidential + Proprietary How can you build

    your own action on top of the Google Assistant?
  15. 24 • Write the conversation - Dialogflow (Enterprise) • Deploy

    on GA+ UX components - Actions on Google Optional: • Back-end integration - Fulfillment app (dialogflow/aog SDK) • Communication to back-ends - Your own APIs Tooling
  16. 25 Testing tools Ngrok secure internet tunnels to localhost •

    Actions on Google Simulator • Device Testing • Dialogflow Simulator • Dialogflow Diagnostics • GCP Stackdriver • Cloud Functions Emulator • Ngrok Secure Tunneling • Dialogflow Training
  17. 27 • Previously known as API.AI ◦ (Sept 2016, acquired

    by Google) • Powered by Machine Learning: ◦ Natural Language Understanding (NLU) ◦ Intent Matching ◦ Conversation Training • Cross platform • Build faster with the Web UI • Scalable: separate your conversation text from code • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Development suite for building Conversational UIs.
  18. 32 • Google Assistant • Amazon Alexa • MS Cortana

    • Web • iOS • Android Integrations • Facebook Messenger • Twitter • Slack • Telegram • Skype • Cisco Spark • Dialogflow Phone • Twilio • Viber • Kik • Line
  19. 34 • Your application back-end code. ◦ Cloud Function /

    App Engine / GKE ...? • Router to catch all intents, that have webhooks enabled. • Application code • Response messages • Calls to external / on-premise APIs Fulfillment App
  20. 36 • Bring your agents to smart speakers (Google Home)

    or phones (Android, iOS app) • Actions on Google includes: ◦ UI toolkit, ◦ Audio toolkit ◦ Account Linking API ◦ SDKs ◦ tutorial guides • UI components such as: ◦ Buttons, Images ◦ Cards, Carousels, ◦ Lists ◦ Tables Program for developers of Actions (“apps”) that run via Google Assistant Actions on Google
  21. 37 SSML Speech Synthesis Markup Language (SSML) is an XML

    based markup language for defining speech. • By using SSML, you can make your agent's responses seem more life-like. • Tags for defining: ◦ Breaks ◦ Audio snippets ◦ Type of text constructs (date, time, alphabet..) ◦ Pitch, Speaking rates ◦ Emphasis
  22. 38 • Formatting Numbers - ($100.000 - > 100000) http://numeraljs.com/

    • Format JS internationalization (dates etc) - https://formatjs.io/ • Moment JS (dates, times) - https://momentjs.com/ • Pluralize - https://www.npmjs.com/package/pluralize • Lightweight Translation Module - (Multi languages in fulfillment apps) - https://github.com/mashpie/i18n-node Handy JS libraries
  23. 57 Sure! I’d like to transfer 100 euro to my

    wife her bank account.” A customer communicates with the Google Assistant
  24. Confidential + Proprietary Advanced Chatflow with machine learning bot analytics

    User types to custom UI or channel Chatbot replies Dialogflow Enterprise Customer Client JS Angular 5 web front-end Kubernetes Engine Chat Server Dialogflow SDK / socket.io Kubernetes Engine Back-end CRM Python / Django Kubernetes Engine Container Registry Containers images can be stored in the Container Registry Messaging Publisher Pub/Sub Webhook Router Cloud Function Webhook Container Builder Building Dev Pipelines
  25. Confidential + Proprietary Advanced Chatflow with machine learning and bot

    analytics User types to custom UI or channel Chatbot replies Dialogflow Enterprise Customer Client JS Angular 5 web front-end Kubernetes Engine Chat Server Dialogflow SDK / socket.io Kubernetes Engine Back-end CRM Python / Django Kubernetes Engine Subscription Cloud Function Sensitivity Filter DLP API Sentiment Detector NLP API Data Warehouse BigQuery Messaging Publisher Pub/Sub Webhook Router Cloud Function Webhook
  26. Confidential & Proprietary Demo: A TV Guide Do it yourself:

    https://goo.gl/pH86aT Ok Google, let me talk to the TV Guide Welcome, I’m the Dutch TV Guide. You can ask me the following: What’s on a channel? What’s on RTL 4? Sure! Here’s The TV Guide Enter Earcon On RTL 4: At 7am: Nieuws At 7:30am: Nieuws ... Exit Earcon . . .
  27. Confidential + Proprietary ElasticSearch live search results Architecture: Dialogflow with

    live search results Router Cloud Functions Webhook Workflow Management Calls to logics layers Dialogflow Enterprise Elastic Search User types in chat UI Chatbot or User replies On premise banking systems