How to build & measure natural conversations for the Google Assistant

How to build & measure natural conversations for the Google Assistant

Transcript

1. 1 How to build & measure natural conversations for the Google Assistant Lee Boonstra Customer Engineer, Google Twitter: @ladysign
2. 2 Lee Boonstra @ladysign
3. 3 A conversation between you and Google that helps you get more done in your world Meet the Google Assistant
4. 4 Terminology Google Assistant — The virtual assistant of Google. Out of the box on Android 6+. For iOS available as app. Action — A third party app, running on top of the Google Assistant. Google Home — Voice-activated speaker powered by Voice. Smart Display — Voice-activated speaker with screen powered by Voice and Touch.
5. 5 • Google Assistant is now in 80 countries with support for 30 languages. • Google Assistant will soon be on 1 billion devices thanks to Android phones
7. 7 Assistance to improve your customer experience Callbots in callcenters Chatbots in websites, apps or social media platforms. Voice Activated Speakers & smart assistants.
8. 8 50% of enterprises spend more time on creating bots than on mobile app development by 2021 —Gartner
9. 9 Chatbots are expected to trim business costs by more than $8 billion per year by 2022. - Juniper Research
10. Confidential + Proprietary Confidential + Proprietary Chatbots exists since the 90’s… So why are they popular now?
11. 11 1994, the first chatbot was born 2016, Focus on AI First
12. 12 Machine Learning How did you learn your first language? or
13. 13 It’s easier to make computers learn than to build smarter computers Machine Learning Process of making computers learn Artificial Intelligence Process of building smarter computers
14. 14 It’s all about Machine Learning • Natural Language Understanding • Text to Speech • Speech Models (Wavenet)
15. 15 70% of requests are in natural language Is it gonna rain tomorrow? Tomorrow it will be sunny In Amsterdam!
17. Confidential + Proprietary Confidential + Proprietary You will need to design your conversation
18. 18 Website Filter on account name or account number Lot’s of results on a screen.
19. 19 Website with Natural Language... Natural way of asking!
20. 20 How much have I spent on taxis last month? It looks like, you spent about 20 euros on taxis last month. You took the TCA taxi twice. Voice channels There’s no screen. Focus on the conversation.
21. 21 It looks like, you spent about 20 euros on taxis last month. You took the TCA taxi twice. Here’s an overview: Voice channels with screens How much have I spent on taxis last month? Focus on the conversation. But also display stuff.
22. 22 Assistance is not just about voice
23. Confidential + Proprietary Confidential + Proprietary What happens under the hood?
24. Google | Proprietary & Confidential 24 GOOGLE ASSISTANT USER Hey Google.. Idle
25. Google | Proprietary & Confidential 25 GOOGLE ASSISTANT USER Hey Google.. ..will it rain today? Listening
26. Google | Proprietary & Confidential 26 GOOGLE ASSISTANT USER WEB SERVER Hey Google.. ..will it rain today? GET www.weather.com/info city: Amsterdam Date: 2019-02-06 Recognizing
27. Google | Proprietary & Confidential 27 GOOGLE ASSISTANT USER WEB SERVER Hey Google.. ..will it rain today? GET www.weather.com/info city: Amsterdam Date: 2019-02-06 { location: “amsterdam” weather: “rain”, temperature: 8 } Thinking
28. Google | Proprietary & Confidential 28 GOOGLE ASSISTANT USER WEB SERVER Hey Google.. ..will it rain today? GET www.weather.com/info city: Amsterdam Date: 2019-02-06 { location: “amsterdam” weather: “rain”, temperature: 8 } Yes, it will rain in Amsterdam all day today. Speaking
29. Confidential + Proprietary Confidential + Proprietary How can you build your own action on top of the Google Assistant?
30. 30 3rd party integration Extend the Google Assistant with your own custom actions. Hey Google, let me talk to BookAMeetingRoom Welcome, how can I help you? I want to book a meeting room for 3 persons. Let’s get BookAMeetingRoom Sure, for when? Tomorrow, from 2pm to 3pm.
31. 31 Ok Google, talk to __________. Ok Google, connect me with __________. Ok Google, get __________. Start a 3rd party action There is an app directory! (appstore). And the Google Assistant can give app suggestions.
32. 32 Many brands are available on Google Assistant • Bol.com • Albert Heijn • Post.nl • Rabobank • Centraal Beheer • ...
33. 33 • Write the conversation - Dialogflow (Enterprise) • Deploy on GA+ UX components - Actions on Google Optional: • Back-end integration - Fulfillment app (dialogflow/aog SDK) • Communication to back-ends - Your own APIs What do I need to build my own action?
34. 34 • Previously known as API.AI ◦ (Sept 2016, acquired by Google) • Powered by Machine Learning: ◦ Natural Language Understanding (NLU) ◦ Intent Matching ◦ Conversation Training • Cross platform • Build faster with the Web UI • Scalable: separate your conversation text from code • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Development suite for building Conversational UIs.
35. 35 • Bring your agents to smart speakers (Google Home) or phones (Android, iOS app) • Actions on Google includes: ◦ UI toolkit, ◦ Audio toolkit ◦ Account Linking API ◦ SDKs ◦ tutorial guides • UI components such as: ◦ Buttons, Images ◦ Cards, Carousels, ◦ Lists ◦ Tables Program for developers of Actions (“apps”) that run via Google Assistant Actions on Google
36. Confidential + Proprietary Demo
37. 37 Dialogflow has been used by over 600,000+ developers
38. 38 Intents
39. 39 Intent Responses
40. 40 Entities
41. 41 • Google Assistant • Amazon Alexa • MS Cortana • Web • iOS • Android Integrations • Facebook Messenger • Twitter • Slack • Telegram • Skype • Cisco Spark • Dialogflow Phone • Twilio • Viber • Kik • Line
42. 42 Fulfillment
43. Confidential + Proprietary Confidential + Proprietary How to measure your app usage?
44. Confidential + Proprietary Which customers are unhappy and why?
45. Confidential + Proprietary How can I improve the user experience?
46. 46 Sure! I’d like to transfer 100 euro to my wife her bank account.” A customer communicates with the Google Assistant
47. 47 What happens under the hood...
48. 48 Collect real-time chats from Dialogflow SDK
49. 49 Mask sensitive Information with DLP API
50. 50 Understand the text with NLP API
51. 51 Store all data in a data-warehouse
52. 52 Optimize your agent
53. Confidential + Proprietary Demo
54. Confidential + Proprietary Confidential + Proprietary Virtual assistance is an important channel. Your customers expect to find you there.
55. Confidential + Proprietary Confidential + Proprietary Virtual assistance complements the other channels. (social media, website, contact center...)
56. BigQuery Text to S Speech Google Assistant Website Social media Channel Agent Assist Call Center Agent Your System
57. Confidential + Proprietary Confidential + Proprietary But if even if you just add one new AI channel. You can improve your customer experience and trim business costs.
58. Like smart assistants... Dialogflow Enterprise Google Assistant Call Center Agent
59. Confidential + Proprietary Confidential + Proprietary Thank you! Lee Boonstra @ladysign