Upgrade to Pro — share decks privately, control downloads, hide ads and more …

I/O Extended 2018 Tokyo@GDG - Assistant

I/O Extended 2018 Tokyo@GDG - Assistant

Session 3 Assistent

Yoichiro Tanaka

May 19, 2018
Tweet

More Decks by Yoichiro Tanaka

Other Decks in Programming

Transcript

  1. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

    (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
  2. Assistant I/O 2018 I believe that this Google I/O 2018

    may be renamed as "Assistant I/O 2018" !
  3. By Pretty Please feature, if a child says some phrase

    with "please", Google Assistant replies "Thanks for saying please".
  4. Users use different devices for each situation. Of course, contents,

    services and apps are different for situations.
  5. App Actions Slices App Links AMP Support Built-in Intents Routine

    Suggestion Table card Theme customization Notification Many features were announced in this I/O to achieve the integration.
  6. App Actions Slices App Links AMP Support Built-in Intents Routine

    Suggestion Table card Theme customization Notification First, talk about each feature to integrate Google Assistant with Android and Web.
  7. The related app is launched and is deep-linked. That is,

    the content about the selected text is shown.
  8. The AI recognizes the content, then the AI lists up

    actions which the user may do. Finally, related apps are suggested.
  9. Up to now, users select an app to use, then

    some content is consumed in the app. From now on, they will be inverted.
  10. <?xml version="1.0" encoding="utf-8"?> <actions> <action intentName="actions.intent.TAKE_COURSE"> <parameter name="course"> <entity-set-reference entityType="org.schema.type.Course"

    urlFilter="https://www.coursera.org/.*" /> </parameter> <fulfillment urlTemplate="{url}?referrer=actions-on-google-previews" /> </action> </actions> This is an "Actions.xml" file to define actions which the app can treat. Actions on Google recognizes this definitions.
  11. When the user clicks the suggestion, the app is launched

    with the deep-link based on the URL.
  12. If the user says "I want to play a game",

    Google Assistant suggests game apps which have the "Play game" intent.
  13. Developers can provide "Sliced" UI for each content on the

    Search Result page and the Google Assistant (later this year).
  14. If you have web contents, you can provide and optimize

    them for Google Assistant without creating Custom Actions.
  15. For example, developers can create a content using AMP and

    embed a structured data markup dynamically.
  16. If AMP and Structured Data Markup supported, you will receive

    an email explaining how to claim your directory page.
  17. App Actions Slices App Links AMP Support Built-in Intents Routine

    Suggestion Table card Theme customization Notification The preceding pages were how to integrate Android and Web with Google Assistant.
  18. Related sessions Getting started with App Actions Android Slices: build

    interactive results for Google Search Integrating your Android apps with the Google Assistant Integrating your content with the Google Assistant using AMP and markup An introduction to developing Actions for the Google Assistant How to build a user base for your Actions
  19. App Actions Slices App Links AMP Support Built-in Intents Routine

    Suggestion Table card Theme customization Notification Next, talk about new features of Google Assistant itself.
  20. Default Routines are sets of actions for each event. One

    routine can has one or more actions.
  21. conv.ask(new Suggestion("Add to routine")); "Routine Suggestions" is a new feature

    to suggest to add your action to the routine the user has.
  22. For example, users can add the "Order Coffee to Starbucks"

    action to the "Commuting to work" routine.
  23. A new rich response named "Table card" to show users

    3x3 information brings more visual and more clear.
  24. conv.ask("Simple response"); conv.ask(new Table({ dividers: true, columns: ["Header1", "Header2", "Header3"],

    rows: [ ["Row1 Item1", "Row1 Item2", …], ["Row2 Item1", "Row2 Item2", …], ["Row3 Item1", "Row3 Item2", …] ] }); Since actions-on-google-nodejs version 2.1.0, the Table card has been supported.
  25. "Theme customization" allows you to customize the design of rich

    responses. When specifying the background image,
  26. Related sessions Design Actions for the Google Assistant: beyond smart

    speakers, to phones and smart display 10 tips for building better Actions Best practices for testing your Actions Personalize Actions for the Google Assistant Add transactional capabilities to your Actions
  27. Voice User Interface Design & Usecase Building games for the

    Google Assistant on smart displays Creating a persona: what does your product sound like? Build engaging conversations for the Google Assistant using Dialogflow Smart Home, Automotive and others Integrate your smart home device with the Google Assistant What's new in automotive What's new with the Google Assistant SDK for devices
  28. Build Actions for the Google Assistant (Level 1) Creating a

    new project, intent, Using an entity and Handing them by fulfillment code with the inline editor. Build Actions for the Google Assistant (Level 2) Creating own fulfillment code, custom entity, Adding a deep-link, follow-up intent and Using helpers, SSML Smart Home Washer Creating a new project, a washer on local, Adding modes, toggles, request syncs and report states Codelabs
  29. We just have been starting building an ecosystem of the

    Google Assistant. We need your cooperations.