VUIが作る未来 〜 NEM9

Transcript

1. VUIがつくる未来 Yoichiro Tanaka, NEM #9, April 20 2019

2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

   (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka

3. Build Actions for Your Community event has been held in

   the worldwide last year.

4. Build Actions for your community: I visited at Tokyo, Ishinomaki

   and Kyoto.

5. Build Actions for GDG Tokyo

6. Build Actions for GDG Ishinomaki

7. Build Actions for GDG Kyoto

8. Assistant Developer Conference vol.1

9. I believe that many developers will start building great actions

   from today in Niigata! http://www.city.niigata.lg.jp/shisei/gaiyo/profile/siseigaiyou.images/niigatacitykusatsu.jpg

10. Today's Agenda

11. None
12. None
13. None
14. None
15. None
16. None

17. User Interfaces Character User Interface Graphical User Interface

18. None

19. We mainly use eyes and hands.

20. None
21. None

22. We sometimes cannot use eyes and hands. But, must do

    something...

23. We almost don't use ears and mouse. If they are

    available against computers...

24. ･･･ ･･･ ? ?

25. ･･･ ･･･

26. Ask something by Voice Know something by Voice

27. Voice User Interface

28. None
29. None

30. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context

    analysis

31. Machine Learning Deep Learning Recently, we can do Natural Language

    Processing in low cost. Big Data

32. User

33. How far is the moon? The Moon is 384,400 kilometers

    from earth. User

34. Google Assistant

35. 34 months after the Google Assistant launched on Google I/O

    2016

36. 8 → 30 languages 14 → 80 countries The Assistant

    went global (up from last year).

37. "active users of the Google Assistant grew four times over

    the past year. By the end of this month, we expect the Google Assistant to be available on one billion devices, up from 500 million last May." Here’s how the Google Assistant became more helpful in 2018

38. Google Assistant is in many devices including Android, iOS, PCs,

    TVs, Cars, Headphones, Watches and Speakers. devices where Google Assistant lives. 1B
39. None
40. None
41. None
42. None
43. None

44. People can order Coffee with AI Assistant provided by Android

    Auto.
45. None

46. Google Home Hub becomes a hub for all IoT devices

    and an entrance for communication.
47. None
48. None

49. People are currently walking using Smartphone...

50. People will walk seeing forward, with wearable devices.

51. 6ooo913

52. Devices Actions Telephone Network Internet

53. None

54. How far is the moon? The Moon is 384,400 kilometers

    from earth. User

55. (Question) (Answer) User

56. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?

57. Actions on Google

58. None
59. None
60. None

61. Conversational Actions Smart Home Actions

62. Devices Actions Webhook Speech Recognition Decision of invoked action Text

    to Speech

63. NLP Engine You can select your favorite NLP engine. Actions

    ? Actions ?

64. Dialogflow

65. None
66. None
67. None
68. None
69. None
70. None

71. Devices Dialogflow

72. Devices Actions Dialogflow Webhook

73. Developers can write a fulfillment code with the actions on

    google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);

74. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?

75. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium

    or large?'); }); You can implement your fulfillment code easily.
76. None

77. 終わります。 終わりますか？ よくわかりません。 期待する回答： 「はい」「いいえ」 「はい」「いいえ」では なかった！

78. 「終わりますか？」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。

    やめます。 ですね。 ・・・

79. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか？ それとも取り消します か？

80. To implement VUI is easy. To design VUI is very

    difficult.

81. https://designguidelines.withgoogle.com/conversation

82. What is conversation design? Learn about conversation How do I

    get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation

83. Multimodal

84. None
85. None
86. None
87. None

88. Basic card, Suggestion chip, Carousel

89. Media responses, Table, List

90. None

91. Business (Auth & Purchase)

92. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account

    details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })

93. You can integrate physical purchase feature in your actions with

    Google Payment/your own payment.

94. Digital Goods Transactions feature uses In-app products in Google Play.

95. Digital Goods Transactions feature uses In-app products in Google Play.

96. Relationship with Web & Android

97. +

98. None
99. None

100. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK

     Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow

101. Google Assistant is Internet.

102. There are some issues...

103. Smart Speakers cannot protect privacy information...

104. AI Assistant currently can't address users...

105. AI Assistant does not know enough context of the user...

106. AI Assistant is NOT good match with Advertisement.

107. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine

     and Communication

108. Is AI changing our life?

109. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status

     Very Important Layers!

110. We just have been starting building an ecosystem of the

     Google Assistant. We need your cooperations.

111. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan

112. Thank you. Any questions? NEM9, Apr 20 2019, Yoichiro Tanaka