VUIが作る未来 〜 NEM9

VUIが作る未来 〜 NEM9

Googleアシスタントを利用可能なデバイスの数は、10億を超えました。皆さんの身近な存在であるGoogleアシスタントは、VUI(Voice User Interface)という新しい体験を人々に提供します。VUIは、コンピュータの使い方を大きく変え、そして人々の生活をより豊かにすることが期待されています。この講演では、VUIやGoogleアシスタントがどのように人々の暮らしを変えようとしているのか、そしてそのエコシステムに参加するにはどうすれば良いのか、といったことをお話いたします。

https://nem.connpass.com/event/122056/

6d5d830c8d2805a2c22ea2eb1e2431cc?s=128

Yoichiro Tanaka

April 20, 2019
Tweet

Transcript

  1. VUIがつくる未来 Yoichiro Tanaka, NEM #9, April 20 2019

  2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

    (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
  3. Build Actions for Your Community event has been held in

    the worldwide last year.
  4. Build Actions for your community: I visited at Tokyo, Ishinomaki

    and Kyoto.
  5. Build Actions for GDG Tokyo

  6. Build Actions for GDG Ishinomaki

  7. Build Actions for GDG Kyoto

  8. Assistant Developer Conference vol.1

  9. I believe that many developers will start building great actions

    from today in Niigata! http://www.city.niigata.lg.jp/shisei/gaiyo/profile/siseigaiyou.images/niigatacitykusatsu.jpg
  10. Today's Agenda

  11. None
  12. None
  13. None
  14. None
  15. None
  16. None
  17. User Interfaces Character User Interface Graphical User Interface

  18. None
  19. We mainly use eyes and hands.

  20. None
  21. None
  22. We sometimes cannot use eyes and hands. But, must do

    something...
  23. We almost don't use ears and mouse. If they are

    available against computers...
  24. ・・・ ・・・ ? ?

  25. ・・・ ・・・

  26. Ask something by Voice Know something by Voice

  27. Voice User Interface

  28. None
  29. None
  30. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context

    analysis
  31. Machine Learning Deep Learning Recently, we can do Natural Language

    Processing in low cost. Big Data
  32. User

  33. How far is the moon? The Moon is 384,400 kilometers

    from earth. User
  34. Google Assistant

  35. 34 months after the Google Assistant launched on Google I/O

    2016
  36. 8 → 30 languages 14 → 80 countries The Assistant

    went global (up from last year).
  37. "active users of the Google Assistant grew four times over

    the past year. By the end of this month, we expect the Google Assistant to be available on one billion devices, up from 500 million last May." Here’s how the Google Assistant became more helpful in 2018
  38. Google Assistant is in many devices including Android, iOS, PCs,

    TVs, Cars, Headphones, Watches and Speakers. devices where Google Assistant lives. 1B
  39. None
  40. None
  41. None
  42. None
  43. None
  44. People can order Coffee with AI Assistant provided by Android

    Auto.
  45. None
  46. Google Home Hub becomes a hub for all IoT devices

    and an entrance for communication.
  47. None
  48. None
  49. People are currently walking using Smartphone...

  50. People will walk seeing forward, with wearable devices.

  51. 6ooo913

  52. Devices Actions Telephone Network Internet

  53. None
  54. How far is the moon? The Moon is 384,400 kilometers

    from earth. User
  55. (Question) (Answer) User

  56. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  57. Actions on Google

  58. None
  59. None
  60. None
  61. Conversational Actions Smart Home Actions

  62. Devices Actions Webhook Speech Recognition Decision of invoked action Text

    to Speech
  63. NLP Engine You can select your favorite NLP engine. Actions

    ? Actions ?
  64. Dialogflow

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. Devices Dialogflow

  72. Devices Actions Dialogflow Webhook

  73. Developers can write a fulfillment code with the actions on

    google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);
  74. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  75. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium

    or large?'); }); You can implement your fulfillment code easily.
  76. None
  77. 終わります。 終わりますか? よくわかりません。 期待する回答: 「はい」「いいえ」 「はい」「いいえ」では なかった!

  78. 「終わりますか?」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。

    やめます。 ですね。 ・・・
  79. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか? それとも取り消します か?

  80. To implement VUI is easy. To design VUI is very

    difficult.
  81. https://designguidelines.withgoogle.com/conversation

  82. What is conversation design? Learn about conversation How do I

    get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
  83. Multimodal

  84. None
  85. None
  86. None
  87. None
  88. Basic card, Suggestion chip, Carousel

  89. Media responses, Table, List

  90. None
  91. Business (Auth & Purchase)

  92. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account

    details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })
  93. You can integrate physical purchase feature in your actions with

    Google Payment/your own payment.
  94. Digital Goods Transactions feature uses In-app products in Google Play.

  95. Digital Goods Transactions feature uses In-app products in Google Play.

  96. Relationship with Web & Android

  97. +

  98. None
  99. None
  100. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK

    Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow
  101. Google Assistant is Internet.

  102. There are some issues...

  103. Smart Speakers cannot protect privacy information...

  104. AI Assistant currently can't address users...

  105. AI Assistant does not know enough context of the user...

  106. AI Assistant is NOT good match with Advertisement.

  107. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine

    and Communication
  108. Is AI changing our life?

  109. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status

    Very Important Layers!
  110. We just have been starting building an ecosystem of the

    Google Assistant. We need your cooperations.
  111. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan

  112. Thank you. Any questions? NEM9, Apr 20 2019, Yoichiro Tanaka