Creating Conversations for Google Home

Creating Conversations for Google Home - Api.ai / Conversation Engine - Machine Learning.

Transcript

1. Creating Conversations For Chatbots and Voice Activated speakers By Lee Boonstra Customer Engineer, Google
2. Agenda • About chatbots and conversation agents • What’s Google Home • Powered by Machine Learning • How to create custom conversation agents
3. of web browsing sessions will be done without a screen. of all searches will be voice. of customer interactions will be managed without a human. By 2020... Gartner ComScore Gartner 30% 50% >85%
4. This is possible through webservices and APIs... { “id”: “4f932d9-5678902”, “timestamp”: “2017-05-26”, “lang”: “en”, “result”: { “source”: “agent”, “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”, “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” } }
5. How do you go from code to conversation?
6. Chatbots & Voice Activated Speakers
7. ...but chatbots exist since the 90’s? COMPUTER SAYS NO 1994: First chatbot 2016: AI First
8. Google Home
9. Google Home — Voice-activated speaker powered Google Assistant — A conversation between you and Google that helps you get more done in your world
10. A conversation between you and Google that helps you get more done in your world
12. Get help, anytime, anywhere • Manage tasks • Plan the day • Get answers • Make memories • Control your home • Enjoy Entertainment
13. Ok Google, let me talk to BookAMeetingRoom Welcome, how can I help you? I want to book a meeting room for 3 persons. Sure! Here’s BookAMeetingRoom Sure, for when? Tomorrow, from 2pm to 3pm. Example of a Custom Use Case
14. Powered by Machine Learning
15. “We will move from mobile first to an AI first world. We see huge opportunities to dramatically improve how people work.” Sundar Pichai CEO, Google
16. or How did you learn your first language? or
18. It’s easier to make computer learn than to build smarter computers Machine Learning Process of making computers learn Artificial Intelligence Process of building smarter computers
20. 20 Storage Compute
21. 21 Google Cloud brings battle hardened tech from Google products
22. Machine Learning in Google Cloud Pre-Trained Models Train your own Conversation Agents
23. Creating Custom Conversation Agents
24. An engine for building advanced conversations http://www.api.ai 14 languages 32 platform SDKs and integrations 200K+ developers
25. Conversation Engine Enterprise version with SLA and Google Cloud integration.
26. A Conversation Flow In Production Your APIs and services
27. Invoke “My Banking Agent” action [user start typing] Intent Recognition Context Awareness Training Multi-language support CRM Other systems & APIs Directory Natural Language API Container Engine Cloud Functions Compute Engine AppEngine “Welcome, how can I help you?” “I like to transfer 50 euro to my wife’s bank account.” “Sure, I’ve transfered 50 euro to your wife’s bank account.” “Do you want to hear your new balance?”
28. Invoke “My Banking Agent” action “Welcome, how can I help you?” “Sure, I’ve transfered 50 euro to your wife’s bank account.” “Do you want to hear your new balance?” “I like to transfer 50 euro to my wife’s bank account.” Intent Recognition Context Awareness Training Multi-language support CRM Other systems & APIs Directory Natural Language API Container Engine Cloud Functions Compute Engine AppEngine “Ok Google, talk to My Banking Agent” “Sure, here’s My Banking Agent”
29. WebIntents An intent represents a mapping between what a user says and what action should be taken by your software.
30. Entities Entities are objects your app or device takes action on.
31. Training • Train your intents
32. Webhooks (Fulfillment) Webhook integration allows you to pass information from a matched intent into a web service and get a result from it. You can pass in entities as a parameter, to post to a webservice.
33. “Transfer 50 euro to my wife’s bank account?” 50 euro Example of a webhook WebService.transferMoney(‘50eur’,‘NL99ABNA0123456789’) Sure. I’ve transfered 50 euro to your wife her bank account. my wife’s
34. Integrations • On your website • In your (native) app • Skype, Facebook, Twitter…. • Siri • Alexa • Cortana
35. Bot Analytics • Amount Used Intents • Amount Used Queries • Time of response
36. Advanced Solutions
38. Review & Approval Web-based portal • Triggering Information • Merchandising and information Approvals • Automatic and manual policy checks • Turn around in about 1 week
39. Who is using api.ai today?
40. ING Belgium ING presented their usecase at Google Next Amsterdam: https://youtu.be/ycONHpmxQL8?t=26m9s
41. It’s hot & happening!
42. Demo: A TV Guide Do it yourself: https://goo.gl/fdCh3I Ok Google, let me talk to the TV Guide Welcome, I’m the Dutch TV Guide. You can ask me the following: What’s on a channel? What’s on RTL 4? Sure! Here’s The TV Guide Enter Earcon On RTL 4: At 7am: Nieuws At 7:30am: Nieuws ... Exit Earcon . . .
43. 43 g.co/dev/ActionsDesign
44. Resources • Google Dev Docs - https://developers.google.com/actions/develop/conversation • Examples - https://github.com/actions-on-google • API.AI - https://console.api.ai • Simulator - https://developers.google.com/actions/tools/web-simulator • Hands-on Materials - https://goo.gl/fdCh3I
45. Thank you