VUIが作る未来 〜 NEM9

Googleアシスタントを利用可能なデバイスの数は、10億を超えました。皆さんの身近な存在であるGoogleアシスタントは、VUI（Voice User Interface）という新しい体験を人々に提供します。VUIは、コンピュータの使い方を大きく変え、そして人々の生活をより豊かにすることが期待されています。この講演では、VUIやGoogleアシスタントがどのように人々の暮らしを変えようとしているのか、そしてそのエコシステムに参加するにはどうすれば良いのか、といったことをお話いたします。

https://nem.connpass.com/event/122056/

Transcript

1. VUIがつくる未来 Yoichiro Tanaka, NEM #9, April 20 2019
2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
3. Build Actions for Your Community event has been held in the worldwide last year.
4. Build Actions for your community: I visited at Tokyo, Ishinomaki and Kyoto.
5. Build Actions for GDG Tokyo
6. Build Actions for GDG Ishinomaki
7. Build Actions for GDG Kyoto
8. Assistant Developer Conference vol.1
9. I believe that many developers will start building great actions from today in Niigata! http://www.city.niigata.lg.jp/shisei/gaiyo/profile/siseigaiyou.images/niigatacitykusatsu.jpg
10. Today's Agenda
17. User Interfaces Character User Interface Graphical User Interface
19. We mainly use eyes and hands.
22. We sometimes cannot use eyes and hands. But, must do something...
23. We almost don't use ears and mouse. If they are available against computers...
24. ･･･ ･･･ ? ?
25. ･･･ ･･･
26. Ask something by Voice Know something by Voice
27. Voice User Interface
30. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context analysis
31. Machine Learning Deep Learning Recently, we can do Natural Language Processing in low cost. Big Data
32. User
33. How far is the moon? The Moon is 384,400 kilometers from earth. User
34. Google Assistant
35. 34 months after the Google Assistant launched on Google I/O 2016
36. 8 → 30 languages 14 → 80 countries The Assistant went global (up from last year).
37. "active users of the Google Assistant grew four times over the past year. By the end of this month, we expect the Google Assistant to be available on one billion devices, up from 500 million last May." Here’s how the Google Assistant became more helpful in 2018
38. Google Assistant is in many devices including Android, iOS, PCs, TVs, Cars, Headphones, Watches and Speakers. devices where Google Assistant lives. 1B
44. People can order Coffee with AI Assistant provided by Android Auto.
46. Google Home Hub becomes a hub for all IoT devices and an entrance for communication.
49. People are currently walking using Smartphone...
50. People will walk seeing forward, with wearable devices.
51. 6ooo913
52. Devices Actions Telephone Network Internet
54. How far is the moon? The Moon is 384,400 kilometers from earth. User
55. (Question) (Answer) User
56. Order a hamburger. Is that a small, medium or large? User Your Service Is that a small, medium or large?
57. Actions on Google
61. Conversational Actions Smart Home Actions
62. Devices Actions Webhook Speech Recognition Decision of invoked action Text to Speech
63. NLP Engine You can select your favorite NLP engine. Actions ? Actions ?
64. Dialogflow
71. Devices Dialogflow
72. Devices Actions Dialogflow Webhook
73. Developers can write a fulfillment code with the actions on google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);
74. Order a hamburger. Is that a small, medium or large? User Your Service Is that a small, medium or large?
75. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium or large?'); }); You can implement your fulfillment code easily.
77. 終わります。 終わりますか？ よくわかりません。 期待する回答： 「はい」「いいえ」 「はい」「いいえ」では なかった！
78. 「終わりますか？」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。 やめます。 ですね。 ・・・
79. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか？ それとも取り消します か？
80. To implement VUI is easy. To design VUI is very difficult.
81. https://designguidelines.withgoogle.com/conversation
82. What is conversation design? Learn about conversation How do I get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
83. Multimodal
88. Basic card, Suggestion chip, Carousel
89. Media responses, Table, List
91. Business (Auth & Purchase)
92. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })
93. You can integrate physical purchase feature in your actions with Google Payment/your own payment.
94. Digital Goods Transactions feature uses In-app products in Google Play.
95. Digital Goods Transactions feature uses In-app products in Google Play.
96. Relationship with Web & Android
97. +
100. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow
101. Google Assistant is Internet.
102. There are some issues...
103. Smart Speakers cannot protect privacy information...
104. AI Assistant currently can't address users...
105. AI Assistant does not know enough context of the user...
106. AI Assistant is NOT good match with Advertisement.
107. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine and Communication
108. Is AI changing our life?
109. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status Very Important Layers!
110. We just have been starting building an ecosystem of the Google Assistant. We need your cooperations.
111. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan
112. Thank you. Any questions? NEM9, Apr 20 2019, Yoichiro Tanaka