Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Actions on Google Overview

Actions on Google Overview

Google Developers ML Summit

Yoichiro Tanaka

December 14, 2018

More Decks by Yoichiro Tanaka

Other Decks in Programming


  1. Actions on Google Overview Google Developers ML Summit, Dec 14

    2018, Yoichiro Tanaka
  2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

    (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
  3. What image do you have against Computers?

  4. None
  5. User Interfaces Character User Interface Graphical User Interface

  6. None
  7. We mainly use eyes and hands.

  8. None
  9. None
  10. We sometimes cannot use eyes and hands. But, must do

  11. We almost don't use ears and mouse. If they are

    available against computers...
  12. ・・・ ・・・ ? ?

  13. ・・・ ・・・

  14. Ask something by Voice Know something by Voice

  15. Voice User Interface

  16. I would like to go to the Shibuya Hikarie. Sure.

    I just set there to the navigation system.
  17. Natural Language Processing Morphological analysis Syntax analysis Semantic analysis Context

  18. Machine Learning Deep Learning Recently, we can do Natural Language

    Processing in low cost. Big Data
  19. User

  20. How far is the moon? The Moon is 384,400 kilometers

    from earth. User
  21. Google Assistant

  22. 30 months after the Google Assistant launched on Google I/O

  23. (Question) (Answer) User

  24. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  25. Actions on Google

  26. None
  27. None
  28. None
  29. Conversational Actions Smart Home Actions

  30. Devices Actions Webhook Speech Recognition Decision of invoked action Text

    to Speech
  31. NLP Engine You can select your favorite NLP engine. Actions

    ? Actions ?
  32. Dialogflow

  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. Devices Dialogflow

  40. Devices Actions Dialogflow Webhook

  41. Developers can write a fulfillment code with the actions on

    google nodejs library. 'use strict'; const { dialogflow } = require('actions-on-google'); const functions = require('firebase-functions'); const app = dialogflow({ debug: true }); app.intent('Default Welcome Intent', conv => { conv.close('Hello, world.'); }); export.fulfillment = functions.https.onRequest(app);
  42. Order a hamburger. Is that a small, medium or large?

    User Your Service Is that a small, medium or large?
  43. app.intent('Order Hamburger', conv => { conv.ask('Is that a small, medium

    or large?'); }); You can implement your fulfillment code easily.
  44. None
  45. 終わります。 終わりますか? よくわかりません。 期待する回答: 「はい」「いいえ」 期待と違ったので

  46. 「終わりますか?」 はい。 終わります。 終わるよ。 そうだね。 うん。 だね。 そうします。 終了。 やめる。

    やめます。 ですね。 ・・・
  47. イチ 予約確認はイチと、 取り消しはニと言って ください。 予約を確認した いです。 予約確認しますか? それとも取り消します か?

  48. To implement VUI is easy. To design VUI is very

  49. https://designguidelines.withgoogle.com/conversation

  50. What is conversation design? Learn about conversation How do I

    get started? Is conversation the right fit? Who are your users? Who is your persona? Draft a conversation Design for multiple devices Style guide Conversational components Error handling Visual components https://designguidelines.withgoogle.com/conversation
  51. Multimodal

  52. None
  53. None
  54. None
  55. None
  56. Basic card, Suggestion chip, Carousel

  57. Media responses, Table, List

  58. None
  59. Business (Auth & Purchase)

  60. app.intent('Start Signin', conv => { conv.ask(new SignIn('To get your account

    details')) }) app.intent('Get Signin', (conv, params, signin) => { if (signin.status === 'OK') { const payload = conv.user.profile.payload conv.ask(`I got your account details, ${payload.name}. What do you want to do next?`) } else { conv.ask(`I won't be able to save your data, but what do you want to do next?`) } })
  61. You can integrate physical purchase feature in your actions with

    Google Payment/your own payment.
  62. Digital Goods Transactions feature uses In-app products in Google Play.

  63. Digital Goods Transactions feature uses In-app products in Google Play.

  64. Relationship with Web & Android

  65. +

  66. None
  67. None
  68. Google Cloud Platform Android, Google Play, Web, etc. Assistant SDK

    Actions on Google Smart-(phones | watches | speakers | earphones | tvs), PCs, Cars SDKs for Actions, Actions API, Assistant API, Home Graph API Dialogflow
  69. Google Assistant is Internet.

  70. (Your Brand Name) Search Search Engine Optimization was an important

  71. Assistant Optimization will be an important thing than SEO. (Your

    Brand Name) を知りたい
  72. Economic Growth Electricity, Public health, Chemistry, Pharmaceutical industry, Internal-combustion engine

    and Communication
  73. Is AI changing our life?

  74. Basic Research/Study Platform/Infrastructure Services/Applications/Use-cases Current Hot Layers Current AI Status

    Very Important Layers!
  75. We just have been starting building an ecosystem of the

    Google Assistant. We need your cooperations.
  76. Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack Assistant Developer Community Japan

  77. Thank you. Any questions? Google Developers ML Summit, Dec 14

    2018, Yoichiro Tanaka