Actions on Google Overview

Google Developers ML Summit

Transcript

1. Actions on Google Overview Google Developers ML Summit, Dec 14 2018, Yoichiro Tanaka
2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
3. What image do you have against Computers?
5. User Interfaces Character User Interface Graphical User Interface
7. We mainly use eyes and hands.
10. We sometimes cannot use eyes and hands. But, must do something...
11. We almost don't use ears and mouse. If they are available against computers...
12. ･･･ ･･･ ? ?
13. ･･･ ･･･
14. Ask something by Voice Know something by Voice
15. Voice User Interface
16. I would like to go to the Shibuya Hikarie. Sure. I just set there to the navigation system.
17. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context analysis
18. Machine Learning Deep Learning Recently, we can do Natural Language Processing in low cost. Big Data
19. User
20. How far is the moon? The Moon is 384,400 kilometers from earth. User
21. Google Assistant
22. 30 months after the Google Assistant launched on Google I/O 2016
23. (Question) (Answer) User
24. Order a hamburger. Is that a small, medium or large? User Your Service Is that a small, medium or large?
25. Actions on Google
29. Conversational Actions Smart Home Actions
30. Devices Actions Webhook Speech Recognition Decision of invoked action Text to Speech
31. NLP Engine You can select your favorite NLP engine. Actions ? Actions ?
32. Dialogflow
39. Devices Dialogflow
40. Devices Actions Dialogflow Webhook
41. Developers can write a fulfillment code with the actions on google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);
42. Order a hamburger. Is that a small, medium or large? User Your Service Is that a small, medium or large?
43. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium or large?'); }); You can implement your fulfillment code easily.
45. 終わります。 終わりますか？ よくわかりません。 期待する回答： 「はい」「いいえ」 期待と違ったので
46. 「終わりますか？」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。 やめます。 ですね。 ・・・
47. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか？ それとも取り消します か？
48. To implement VUI is easy. To design VUI is very difficult.
49. https://designguidelines.withgoogle.com/conversation
50. What is conversation design? Learn about conversation How do I get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
51. Multimodal
56. Basic card, Suggestion chip, Carousel
57. Media responses, Table, List
59. Business (Auth & Purchase)
60. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })
61. You can integrate physical purchase feature in your actions with Google Payment/your own payment.
62. Digital Goods Transactions feature uses In-app products in Google Play.
63. Digital Goods Transactions feature uses In-app products in Google Play.
64. Relationship with Web & Android
65. +
68. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow
69. Google Assistant is Internet.
70. (Your Brand Name) Search Search Engine Optimization was an important thing.
71. Assistant Optimization will be an important thing than SEO. (Your Brand Name) を知りたい
72. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine and Communication
73. Is AI changing our life?
74. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status Very Important Layers!
75. We just have been starting building an ecosystem of the Google Assistant. We need your cooperations.
76. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan
77. Thank you. Any questions? Google Developers ML Summit, Dec 14 2018, Yoichiro Tanaka