Google Assistant

Transcript

1. Deep diving into creating conversations with Google Assistant Dmytro Kuiko
2. What is Google Assistant?
3. What is Google Assistant?
4. Why should I care about it?
5. Actions
6. Actions From Google
7. Actions From Google From other developers
8. Action invocation
9. Action invocation Find in a catalogue of Actions
10. Action invocation Find in a catalogue of Actions Explicit
11. Action invocation Find in a catalogue of Actions Explicit Implicit
12. How to develop an action?
13. How to develop an action? Predefined templates
14. How to develop an action? Predefined templates DialogFlow
15. How to develop an action? Predefined templates DialogFlow SDK
16. DialogFlow
17. Intent
18. Intent Context
19. Context
20. Context Input
21. Context Input Output C C
22. Context Input lifespan Output C lifespan C
23. Intent Context Events
24. Events
25. Events Base
26. Events Base HelpersC
27. Events Base actions_intent_MAIN, … HelpersC actions_intent_CONFIRMATION, …C
28. Intent Context Events Training Phrases
29. Intent Context Events Training Phrases Actions and Parameters
30. Intent Context Events Training Phrases Actions and Parameters Responses
31. Responses
32. Responses Text Response
33. Responses Text Response Basic Card
34. Basic Card
35. Responses Text Response Basic Card List
36. List
37. Responses Text Response Basic Card List Suggestion Chip
38. Suggestion Chip
39. Responses Text Response Basic Card List Suggestion Chip Carousel Card
40. Intent Context Events Training Phrases Actions and Parameters Responses Fullfilment
41. Fulfillment
42. Fulfillment Webhook
43. Fulfillment Webhook Integration with Cloud Functions
44. Webhook
45. Webhook const agent = new WebhookClient({request, response}); const intentMap = new Map(); intentMap.set('start', start); … agent.handleRequest(intentMap);
46. Webhook function start(agent) { agent.add("Hello! Nice to see you at DevFest!”); } function start(agent) { const conv = agent.conv(); conv.ask('Hello!...'); agent.add(conv); }
47. Webhook const {WebhookClient, Card, Suggestion, Text, Image} = require('dialogflow-fulfillment');
48. Webhook const {WebhookClient, Card, Suggestion, Text, Image} = require('dialogflow-fulfillment');
49. Webhook function start(agent) { agent.add(“Hello! ..."); agent.add(new Suggestion('Some text')); }
50. Webhook const {List, Carousel, Image, Suggestions, Confirmation, DateTime, Permission, Place, SignIn, DeepLink} = require("actions-on-google");
51. Webhook const {List, Carousel, Image, Suggestions, Confirmation, DateTime, Permission, Place, SignIn, DeepLink} = require("actions-on-google");
52. Webhook function start(agent) { const conv = agent.conv(); conv.ask('Hello!...'); conv.ask(new Suggestions(['Some text']); agent.add(conv); }
53. Webhook agent.setContext(‘DevFest schedule');
54. Webhook agent.setContext(‘DevFest schedule'); const context = {'name': ‘DevFest schedule', 'lifespan': 2, 'parameters': {'day': 'first'}}; agent.setContext(context);
55. Webhook agent.setFollowupEvent('scheduleChosen')
56. Webhook const choice = agent.parameters['day'];
57. Webhook const {Card, Suggestion, Text, Image, …} = require(‘dialogflow-fulfillment');
58. Webhook const {Card, Suggestion, Text, Image, …} = require(‘dialogflow-fulfillment'); const {Button, Table, BrowseCarousel, Carousel, List, MediaObject, Image, Suggestions, …} = require("actions-on-google");
59. Webhook agent.add(new Card({ title: 'DevFest', imageUrl: 'https://...', text: 'Warsaw. December 1-2, 2018...', buttonText: 'Link', buttonUrl: 'https://warsaw.devfest.pl' }) );
60. Webhook const conv = agent.conv(); conv.ask('Greetings from GDG Warsaw!'); const list = new List({ title: 'Schedule', items: { 'firstDay': { synonyms: ['beginning','saturday'], title: '1 December’, image: new Image({...}), }, 'secondDay': {...} } }); conv.ask(list); agent.add(conv);
61. Webhook
62. Webhook const choice = agent.consoleMessages[0].text;
64. Helpers
65. Helpers Confirmation
66. Helpers const {Confirmation} = require("actions-on-google"); function confirmation(agent) { const conv = agent.conv(); conv.ask(new Confirmation('Would you mind confirming...')); agent.add(conv); }
67. Helpers function confirmationResponse(agent) { const conv = agent.conv(); const isConfirmationGranted = conv.arguments.parsed.input.CONFIRMATION; if (isConfirmationGranted) {...} else {...} ... }
68. Helpers Confirmation Date and Time
69. Helpers function dateTime(agent) { const conv = agent.conv(); const options = { prompts: { initial: 'When would you like to receive your tickets?', date: 'What day was that?', time: 'What time?', }, }; conv.ask(new DateTime(options)); agent.add(conv); }
70. Helpers function datetimeReceived(agent) { const conv = agent.conv(); const date = conv.arguments.parsed.input.DATETIME.date; const time = conv.arguments.parsed.input.DATETIME.time; agent.add(conv); }
71. Helpers Confirmation Date and Time User name, Place and Location
72. Helpers function permission(agent) { const conv = agent.conv(); const options = { context: 'To greet you by name at the entrance at DevFest', permissions: ['NAME', 'DEVICE_PRECISE_LOCATION'], }; conv.ask(new Permission(options)); agent.add(conv); }
73. Helpers function permissionConfirmation(agent, app) { const conv = agent.conv(); const isGranted = conv.arguments.parsed.input.PERMISSION; }C
74. Helpers function permissionConfirmation(agent, app) { const conv = agent.conv(); const isGranted = conv.arguments.parsed.input.PERMISSION; if (confirmationGranted) { const location = conv.device; const name = conv.name; if (name) ... if (location) ... } ... }C
75. Helpers Confirmation Date and Time Place and Location Account SingIn
76. Helpers Confirmation Date and Time Place and Location Account SingIn DeepLink
77. Helpers function deeplink(agent) { const conv = agent.conv(); const options = { destination: 'DevFest', url: 'devfest://warsaw', package: 'pl.devfest.warsaw', reason: 'handle this for you', }; }C
78. Helpers function deeplink(agent) { const conv = agent.conv(); const options = { destination: 'DevFest', url: 'devfest://warsaw', package: 'pl.devfest.warsaw', reason: 'handle this for you', }; conv.ask('Great! looks like maybe we can do that in the app.'); conv.ask(new DeepLink(options)); agent.add(conv); }C
79. Store
80. Store Conversation token
81. Store Conversation token Output context
82. Store const context = {'name': ‘DevFest schedule', 'lifespan': 2, 'parameters': {'day': 'first'}}; agent.setContext(context);
83. Store const conv = agent.conv(); conv.data.zip = { events: 'DevFest Warsaw', reason: ['Cool community', 'Perfect organised', ...] };
84. Store Conversation token Output context User Storage
85. Store const conv = agent.conv(); conv.user.storage.zip = { events: 'DevFest Warsaw', reason: ['Cool community', 'Perfect organized', ...] };
86. Store const conv = agent.conv(); conv.user.storage.zip = { events: 'DevFest Warsaw', reason: ['Cool community', 'Perfect organized', ...] }; conv.user.storage = {};
87. Thanks for the attention! @dimiKuiko https://speakerdeck.com/dmytrykuiko/google-assistant https://codelabs.developers.google.com/codelabs/actions-1 https://codelabs.developers.google.com/codelabs/actions-2
88. Thanks for your Attention!