Actions on Google Latest Updates

Actions on Google Latest Updates

ATLabo平成30年12月度定例会

6d5d830c8d2805a2c22ea2eb1e2431cc?s=128

Yoichiro Tanaka

December 13, 2018
Tweet

Transcript

  1. Actions on Google Latest Updates ATLabo平成30年12月度定例会, Dec 13 2018, Yoichiro

    Tanaka
  2. bit.ly/ATLabo

  3. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

    (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
  4. Google Assistant Latest Updates Today's Theme

  5. What image do you have against Computers?

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None
  12. None
  13. Previous User Interfaces Character User Interface Graphical User Interface

  14. We mainly use eyes and hands.

  15. None
  16. None
  17. We sometimes cannot use eyes and hands. But, must do

    something...
  18. We almost don't use ears and mouse. If they are

    available against computers...
  19. ・・・? ・・・?

  20. ・・・ ・・・

  21. Ask something by Voice Know something by Voice

  22. Current User Interfaces Character User Interface Graphical User Interface Voice

    User Interface
  23. None
  24. None
  25. Kit, I would like to go to the Shibuya Hikarie.

    Sure. I just set there to the navigation system.
  26. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context

    analysis
  27. None
  28. None
  29. Machine Learning Deep Learning Recently, we can do Natural Language

    Processing in low cost. Big Data
  30. User

  31. How far is the moon? The Moon is 384,400 kilometers

    from earth. User
  32. How far is the moon? The Moon is 384,400 kilometers

    from earth. User
  33. Google Assistant

  34. 30 months after the Google Assistant launched on Google I/O

    2016
  35. None
  36. None
  37. None
  38. None
  39. None
  40. None
  41. None
  42. None
  43. None
  44. 6ooo913

  45. Devices Actions Telephone Network Internet

  46. Google Assistant is in many devices including Android, iOS, PCs,

    TVs, Cars, Headphones, Watches and Speakers. devices where Google Assistant lives. 500M
  47. None
  48. ・・・ ・・・ User

  49. ・・・ ・・・ User Your Service ・・・

  50. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  51. Actions on Google

  52. None
  53. None
  54. None
  55. Conversational Actions Smart Home Actions

  56. Devices Actions Webhook Speech Recognition Decision of invoked action Text

    to Speech
  57. NLP Engine You can select your favorite NLP engine. Actions

    ? Actions ?
  58. Dialogflow

  59. None
  60. None
  61. None
  62. None
  63. None
  64. None
  65. Devices Dialogflow

  66. Devices Actions Dialogflow Webhook

  67. Developers can write a fulfillment code with the actions on

    google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);
  68. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  69. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium

    or large?'); }); You can implement your fulfillment code easily.
  70. Smart Home actions What is the temperature in the house?

    Link 28 degree Set the house to 25 25 degree Unlink SYNC QUERY EXECUTE DISCONECT 23 degree REPORT STATE
  71. Devices Actions Webhook SYNC QUERY EXECUTE DISCONECT REPORT STATE

  72. None
  73. 終わります。 終わりますか? よくわかりません。

  74. 「終わりますか?」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。

    やめます。 ですね。 ・・・
  75. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか? それとも取り消します か?

  76. To implement VUI is easy. To design VUI is very

    difficult.
  77. https://designguidelines.withgoogle.com/conversation

  78. What is conversation design? Learn about conversation How do I

    get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
  79. What is conversation design? Learn about conversation How do I

    get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
  80. None
  81. Multimodal

  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. Basic card, Browse carousel, Suggestion chip

  89. Media responses, Table, List

  90. Carousel

  91. Multimodal brings more rich experiences.

  92. Business

  93. For Business User Authentication OAuth 2.0 Physical Purchases Digital Purchases

  94. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account

    details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })
  95. You can integrate physical purchase feature in your actions with

    Google Payment/your own payment.
  96. You can integrate physical purchase feature in your actions with

    Google Payment/your own payment.
  97. Digital Goods Transactions feature uses In-app products in Google Play.

  98. Digital Goods Transactions feature uses In-app products in Google Play.

  99. Relationship with Android & Web

  100. None
  101. None
  102. +

  103. (Your Brand Name) Search Search Engine Optimization was an important

    thing.
  104. Assistant Optimization will be an important thing than SEO. (Your

    Brand Name) を知りたい
  105. Assistant Optimization will be an important thing than SEO. (Your

    Brand Name) を知りたい A I
  106. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK

    Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow
  107. None
  108. Google Assistant is Internet.

  109. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine

    and Communication
  110. Is AI changing our life?

  111. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status

    Very Important Layers!
  112. We just have been starting building an ecosystem of the

    Google Assistant. We need your cooperations.
  113. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan

  114. Thank you. Any questions? ATLabo平成30年12月度定例会, Dec 13 2018, Yoichiro Tanaka