Assistant - Google I/O 2019 Extended

This is a summary slides about Google Assistant announced at Google I/O 2019.

Transcript

1. Assistant Google I/O 2019 #io19jp
2. Yoichiro Tanaka Software Engineer / IT Architect Google Developers Expert (Assistant, Web) twitter.com/yoichiro google.com/+YoichiroTanaka
3. For Assistant users...
4. Current Google Assistant Status
5. 35 months after the Google Assistant launched on Google I/O 2016
6. 8 → 30 languages 14 → 80 countries The Assistant went global (up from last year).
7. Improvement of Google Assistant
10. Speech recognition becomes so fast by next generation assistant.
11. Google Assistant shows you a specific result by Personalize help.
12. "Hey Google, let's drive" Driving mode brings a user many things, which the user may do during driving a car.
13. Users can stop the alarm by calling "Stop!" only without "Hey Google".
14. Duplex on the web
15. For example, there are so many steps to book a car.
16. Duplex on the web supports to book a car instead of operating by a user.
17. Web developers can analyze the web site's flow for Duplex on the web and can issue a test account on Search Console.
18. Nest Hub / Nest Hub Max
19. Google focuses on Smart Display.
20. "Google Home Hub" rebrands as "Nest Hub". Nest Hub will sale some countries including Japan!
21. 10 inch display with Camera Face Match with Camera Operate by Gesture with Camera Video Call with Google Duo $229 this summer on US, UK, AU Nest Hub Max
22. For action developers...
23. For action developers If you are a... • Content Owner • Android app developer • Hardware developer • Innovator in the Conversational space Markup, Template, Mini-apps App Actions Smart Home Conversation Actions, Interactive Canvas
24. How-to and FAQ content
25. <script type="application/ld+json"> { "@context": "http://schema.org", "@type": "HowTo", "name": "How to Install a Dog Door", "description": "...easy instructions on how to install a dog door...", "step": [ { "@type": "HowToStep", "name": "Remove Screen Door", "image": "https://diy.snding.com/content/...", "text": "Remove the screen door from the door frame...", "url": "https://www.diynetwork.com/.../install-a-dog-door#step1" }, ... ] } </script> When writing a metadata with "HowTo" type defined by schema.org,
26. the instruction will not only be shown on the search result with rich UI experience,
27. but it also will be shown on Smart Display as well. If clicking the "Start tutorial" button, the instruction is started.
28. In addition, if you have a video to instruct something, you can change it to the instruction content.
29. When defining each step with title, description and video timestamp on Google Sheets and uploading it to AoG console,
30. the video will be shown on Smart Display as instruction content.
31. Mini-apps
32. "Mini-apps are a new capability on Search and the Assistant that enable you all to engage users with interactive flows and live content right on each surface." ~ Allen Harvey, Google
33. Interactive & Rich Live content Mini-apps are: • Can provide Interactive and Rich Live content as each Search Result. • Can build Mini-apps with Web Technology including HTML, CSS and Javascript.
34. "name": "Google I/O Mini-app" "description": "A Hello World Mini-app" "company": "Google" "url": "www.google.com" ... "supportedLanguages": ["en"] "supportedRegions": ["US"] "webhook": "https://mywebhook.example.com/mini-app Create the app configuration
35. <button text="Update"> <on-click:event-handler> <intent name="HelloWorldconfirmation"> <arg name="InputName" /> </intent> </on-click:event-handler> </button> Choose from a library of UI Components • Text • Carousel • Chip • Button • Image • etc.
36. "perLocaleQueryExamples": [{ "language": "en", "queryExamples": [ {"pattern": "hello world"}, {"pattern": "hello Google I/O"} }] Setup triggering
37. Register and Test the Mini-app on Actions on Google Console
38. Run the same Mini-app on Smart Display
39. Can fill in something with voice
40. https://developers.google.com/search/docs/guides/mini-apps
41. App Actions
42. App Actions let users launch specific features in your app using the Google Assistant.
43. Google Assistant sends an intent to the registered Android app.
45. Smart Home
47. Each element which consists of Smart Home is managed by Home Graph.
48. Traits are each behavior of devices. These new traits have been defined.
49. We have a integration way with Cloud-to-Cloud path. Now, we will a new way with Local Home SDK as well.
50. Local Home SDK brings a new capability to control each device from the code deployed in the Google Home directly.
51. Interactive Canvas
52. Canvas is a framework that allows developers to add a visual, immersive experience to conversational Actions.
53. Interactive Canvas can be built with Web Standard Technologies.
54. Canvas is invoked by Immersive Response, and Interactive Canvas API is used to communicate to the device.
59. https://github.com/actions-on-google/dialogflow-interactive-canvas-nodejs
60. Sessions
61. Design and Build Actions For designing and building your actions: • Prototyping Voice Experiences: Design Sprints for the Google Assistant • Intro to the Google Assistant: Build Your First Action • 10 Best Practices for High Quality Actions • Let’s Talk: Designing Quality Conversations for the Google Assistant
62. Smart Home For building Smart Home actions: • Smart Home 101: How to Develop for the Connected Home • Local Technologies for the Smart Home • Tools for Building Better Smart Home Actions
63. Search and Assistant For providing your contents : • Create App-like Experiences on Google Search and the Google Assistant • Enhance Your Search and Assistant Presence with Structured Data
64. Android For integrating with Android: • Extend Your Android App to the Google Assistant
65. Smart Display For adjusting your actions for Smart Display: • What’s New in the Google Cast SDK • Build Interactive Games for the Google Assistant • Voice and Visual: How to Build Actions for Smart Displays and More Devices
66. Others • Reach the Next Billion Users with Your Actions for the Google Assistant • How We Built the Google Assistant Sandbox Demos (And How You Can Too) • Data and Insights to Build for the Digital Assistant Era
67. Assistant Developer Community Japan Google Groups http://bit.ly/assistant-dev-japan Slack http://bit.ly/assistant-dev-slack
68. Any questions?