Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Assistant - Google I/O 2019 Extended

Assistant - Google I/O 2019 Extended

This is a summary slides about Google Assistant announced at Google I/O 2019.

Yoichiro Tanaka

May 18, 2019

More Decks by Yoichiro Tanaka

Other Decks in Technology


  1. Assistant Google I/O 2019 #io19jp

  2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert

    (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
  3. For Assistant users...

  4. Current Google Assistant Status

  5. 35 months after the Google Assistant launched on Google I/O

  6. 8 → 30 languages 14 → 80 countries The Assistant

    went global (up from last year).
  7. Improvement of Google Assistant

  8. None
  9. None
  10. Speech recognition becomes so fast by next generation assistant.

  11. Google Assistant shows you a specific result by Personalize help.

  12. "Hey Google, let's drive" Driving mode brings a user many

    things, which the user may do during driving a car.
  13. Users can stop the alarm by calling "Stop!" only without

    "Hey Google".
  14. Duplex on the web

  15. For example, there are so many steps to book a

  16. Duplex on the web supports to book a car instead

    of operating by a user.
  17. Web developers can analyze the web site's flow for Duplex

    on the web and can issue a test account on Search Console.
  18. Nest Hub / Nest Hub Max

  19. Google focuses on Smart Display.

  20. "Google Home Hub" rebrands as "Nest Hub". Nest Hub will

    sale some countries including Japan!
  21. 10 inch display with Camera Face Match with Camera Operate

    by Gesture with Camera Video Call with Google Duo $229 this summer on US, UK, AU Nest Hub Max
  22. For action developers...

  23. For action developers If you are a... • Content Owner

    • Android app developer • Hardware developer • Innovator in the Conversational space Markup, Template, Mini-apps App Actions Smart Home Conversation Actions, Interactive Canvas
  24. How-to and FAQ content

  25. <script type="application/ld+json"> { "@context": "http://schema.org", "@type": "HowTo", "name": "How to

    Install a Dog Door", "description": "...easy instructions on how to install a dog door...", "step": [ { "@type": "HowToStep", "name": "Remove Screen Door", "image": "https://diy.snding.com/content/...", "text": "Remove the screen door from the door frame...", "url": "https://www.diynetwork.com/.../install-a-dog-door#step1" }, ... ] } </script> When writing a metadata with "HowTo" type defined by schema.org,
  26. the instruction will not only be shown on the search

    result with rich UI experience,
  27. but it also will be shown on Smart Display as

    well. If clicking the "Start tutorial" button, the instruction is started.
  28. In addition, if you have a video to instruct something,

    you can change it to the instruction content.
  29. When defining each step with title, description and video timestamp

    on Google Sheets and uploading it to AoG console,
  30. the video will be shown on Smart Display as instruction

  31. Mini-apps

  32. "Mini-apps are a new capability on Search and the Assistant

    that enable you all to engage users with interactive flows and live content right on each surface." ~ Allen Harvey, Google
  33. Interactive & Rich Live content Mini-apps are: • Can provide

    Interactive and Rich Live content as each Search Result. • Can build Mini-apps with Web Technology including HTML, CSS and Javascript.
  34. "name": "Google I/O Mini-app" "description": "A Hello World Mini-app" "company":

    "Google" "url": "www.google.com" ... "supportedLanguages": ["en"] "supportedRegions": ["US"] "webhook": "https://mywebhook.example.com/mini-app Create the app configuration
  35. <button text="Update"> <on-click:event-handler> <intent name="HelloWorldconfirmation"> <arg name="InputName" /> </intent> </on-click:event-handler>

    </button> Choose from a library of UI Components • Text • Carousel • Chip • Button • Image • etc.
  36. "perLocaleQueryExamples": [{ "language": "en", "queryExamples": [ {"pattern": "hello world"}, {"pattern":

    "hello Google I/O"} }] Setup triggering
  37. Register and Test the Mini-app on Actions on Google Console

  38. Run the same Mini-app on Smart Display

  39. Can fill in something with voice

  40. https://developers.google.com/search/docs/guides/mini-apps

  41. App Actions

  42. App Actions let users launch specific features in your app

    using the Google Assistant.
  43. Google Assistant sends an intent to the registered Android app.

  44. None
  45. Smart Home

  46. None
  47. Each element which consists of Smart Home is managed by

    Home Graph.
  48. Traits are each behavior of devices. These new traits have

    been defined.
  49. We have a integration way with Cloud-to-Cloud path. Now, we

    will a new way with Local Home SDK as well.
  50. Local Home SDK brings a new capability to control each

    device from the code deployed in the Google Home directly.
  51. Interactive Canvas

  52. Canvas is a framework that allows developers to add a

    visual, immersive experience to conversational Actions.
  53. Interactive Canvas can be built with Web Standard Technologies.

  54. Canvas is invoked by Immersive Response, and Interactive Canvas API

    is used to communicate to the device.
  55. None
  56. None
  57. None
  58. None
  59. https://github.com/actions-on-google/dialogflow-interactive-canvas-nodejs

  60. Sessions

  61. Design and Build Actions For designing and building your actions:

    • Prototyping Voice Experiences: Design Sprints for the Google Assistant • Intro to the Google Assistant: Build Your First Action • 10 Best Practices for High Quality Actions • Let’s Talk: Designing Quality Conversations for the Google Assistant
  62. Smart Home For building Smart Home actions: • Smart Home

    101: How to Develop for the Connected Home • Local Technologies for the Smart Home • Tools for Building Better Smart Home Actions
  63. Search and Assistant For providing your contents : • Create

    App-like Experiences on Google Search and the Google Assistant • Enhance Your Search and Assistant Presence with Structured Data
  64. Android For integrating with Android: • Extend Your Android App

    to the Google Assistant
  65. Smart Display For adjusting your actions for Smart Display: •

    What’s New in the Google Cast SDK • Build Interactive Games for the Google Assistant • Voice and Visual: How to Build Actions for Smart Displays and More Devices
  66. Others • Reach the Next Billion Users with Your Actions

    for the Google Assistant • How We Built the Google Assistant Sandbox Demos (And How You Can Too) • Data and Insights to Build for the Digital Assistant Era
  67. Assistant Developer Community Japan Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack

  68. Any questions?