Share
Embed
Transcript
69 slides
-
1 Creating Conversations For Smart Assistants Lee Boonstra Customer Engineer,
Google Twitter: @ladysign -
Use cases in the contact center and beyond • Customer
service • E-commerce • Home entertainment • Auto • Organizational knowledge • Onboarding & Helpdesk -
Consumers have high expectations Based on data collected in Fall
2017 from sample of 1,051 U.S. adults, ages 18-64. -
5 50% of enterprises spend more time on creating bots
than on mobile app development by 2021 —Gartner -
6 Chatbots are expected to trim business costs by more
than $8 billion per year by 2022. - Juniper Research -
Confidential + Proprietary Confidential + Proprietary Chatbots exists since the
90’s… So why are they popular now? -
10 It’s easier to make computers learn than to build
smarter computers Machine Learning Process of making computers learn Artificial Intelligence Process of building smarter computers -
Dialogflow users benefit from world-class AI assets & capabilities, including:
Google is an AI company Goal: Make AI easy, fast, and useful for enterprises and developers Machine learning leadership Natural language understanding Knowledge graph Search across unstructured data Speech recognition & synthesis TPUs and unrivaled compute infra for ML -
Cloud AI Less ML expertise More ML expertise Cloud AI
solutions Cloud Job Discovery Contact Center Document Understanding Cloud AI building blocks Cloud AI platform Cloud ML Engine Cloud Video Intelligence ML professionals & service partners ASL Professional Services Organization Cloud AutoML Vision Vision Cloud Vision Language Conversation Cloud Natural Language Cloud AutoML NL Dialogflow Enterprise Cloud Translation Cloud Speech-to-Text Cloud Text-to-Speech Cloud AutoML Translation New New New Cloud GPU Cloud TPU Cloud Dataflow Cloud Dataproc Machine & Deep Learning ML accelerators ML libraries Tensorflow Kubeflow Kaggle/datasets Datasets -
14 Bots to improve your customer experience Callbots in callcenters
Chatbots in websites, apps or social media platforms. Voice Activated Speakers & smart assistants. -
15 70% of requests are in natural language Is it
gonna rain tomorrow? Tomorrow it will be sunny In Amsterdam! -
16 A conversation between you and Google that helps you
get more done in your world Meet the Google Assistant -
17 Terminology Google Assistant — The virtual assistant of Google.
Out of the box on Android 6+. For iOS available as app. Action — A third party app, running on top of the Google Assistant. Google Home — Voice-activated speaker powered by Voice. Smart Display — Voice-activated speaker with screen powered by Voice and Touch. -
18 • Manage tasks Ok Google, what’s my confirmation number
for my flight? • Plan the day Ok Google, how is my commute to the office? • Get answers: Ok Google, who is the King of the Netherlands? • Make memories Ok Google, remember I left my keys on the Kitchen table. • Control your home Ok Google, turn off the bedroom lights. • Enjoy Entertainment Ok Google, play the Pixies on Spotify. Things you can ask Google... -
Google | Proprietary & Confidential 20 recognitionResult listenEnd recognitionResult voicestart
listenStart listenEnd voiceEnd eventName -
21 3rd party integration Extend the Google Assistant with your
own custom actions. Hey Google, let me talk to BookAMeetingRoom Welcome, how can I help you? I want to book a meeting room for 3 persons. Let’s get BookAMeetingRoom Sure, for when? Tomorrow, from 2pm to 3pm. -
Confidential + Proprietary Confidential + Proprietary How can you build
your own action on top of the Google Assistant? -
24 • Write the conversation - Dialogflow (Enterprise) • Deploy
on GA+ UX components - Actions on Google Optional: • Back-end integration - Fulfillment app (dialogflow/aog SDK) • Communication to back-ends - Your own APIs Tooling -
25 Testing tools Ngrok secure internet tunnels to localhost •
Actions on Google Simulator • Device Testing • Dialogflow Simulator • Dialogflow Diagnostics • GCP Stackdriver • Cloud Functions Emulator • Ngrok Secure Tunneling • Dialogflow Training -
27 • Previously known as API.AI ◦ (Sept 2016, acquired
by Google) • Powered by Machine Learning: ◦ Natural Language Understanding (NLU) ◦ Intent Matching ◦ Conversation Training • Cross platform • Build faster with the Web UI • Scalable: separate your conversation text from code • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Development suite for building Conversational UIs. -
32 • Google Assistant • Amazon Alexa • MS Cortana
• Web • iOS • Android Integrations • Facebook Messenger • Twitter • Slack • Telegram • Skype • Cisco Spark • Dialogflow Phone • Twilio • Viber • Kik • Line -
34 • Your application back-end code. ◦ Cloud Function /
App Engine / GKE ...? • Router to catch all intents, that have webhooks enabled. • Application code • Response messages • Calls to external / on-premise APIs Fulfillment App -
36 • Bring your agents to smart speakers (Google Home)
or phones (Android, iOS app) • Actions on Google includes: ◦ UI toolkit, ◦ Audio toolkit ◦ Account Linking API ◦ SDKs ◦ tutorial guides • UI components such as: ◦ Buttons, Images ◦ Cards, Carousels, ◦ Lists ◦ Tables Program for developers of Actions (“apps”) that run via Google Assistant Actions on Google -
37 SSML Speech Synthesis Markup Language (SSML) is an XML
based markup language for defining speech. • By using SSML, you can make your agent's responses seem more life-like. • Tags for defining: ◦ Breaks ◦ Audio snippets ◦ Type of text constructs (date, time, alphabet..) ◦ Pitch, Speaking rates ◦ Emphasis -
38 • Formatting Numbers - ($100.000 - > 100000) http://numeraljs.com/
• Format JS internationalization (dates etc) - https://formatjs.io/ • Moment JS (dates, times) - https://momentjs.com/ • Pluralize - https://www.npmjs.com/package/pluralize • Lightweight Translation Module - (Multi languages in fulfillment apps) - https://github.com/mashpie/i18n-node Handy JS libraries -
57 Sure! I’d like to transfer 100 euro to my
wife her bank account.” A customer communicates with the Google Assistant -
Confidential + Proprietary Advanced Chatflow with machine learning bot analytics
User types to custom UI or channel Chatbot replies Dialogflow Enterprise Customer Client JS Angular 5 web front-end Kubernetes Engine Chat Server Dialogflow SDK / socket.io Kubernetes Engine Back-end CRM Python / Django Kubernetes Engine Container Registry Containers images can be stored in the Container Registry Messaging Publisher Pub/Sub Webhook Router Cloud Function Webhook Container Builder Building Dev Pipelines -
Confidential + Proprietary Advanced Chatflow with machine learning and bot
analytics User types to custom UI or channel Chatbot replies Dialogflow Enterprise Customer Client JS Angular 5 web front-end Kubernetes Engine Chat Server Dialogflow SDK / socket.io Kubernetes Engine Back-end CRM Python / Django Kubernetes Engine Subscription Cloud Function Sensitivity Filter DLP API Sentiment Detector NLP API Data Warehouse BigQuery Messaging Publisher Pub/Sub Webhook Router Cloud Function Webhook -
Confidential & Proprietary Demo: A TV Guide Do it yourself:
https://goo.gl/pH86aT Ok Google, let me talk to the TV Guide Welcome, I’m the Dutch TV Guide. You can ask me the following: What’s on a channel? What’s on RTL 4? Sure! Here’s The TV Guide Enter Earcon On RTL 4: At 7am: Nieuws At 7:30am: Nieuws ... Exit Earcon . . . -
Confidential + Proprietary ElasticSearch live search results Architecture: Dialogflow with
live search results Router Cloud Functions Webhook Workflow Management Calls to logics layers Dialogflow Enterprise Elastic Search User types in chat UI Chatbot or User replies On premise banking systems