Slide 1
Slide 1 text
Assistant
Google I/O 2019
#io19jp
Slide 2
Slide 2 text
Yoichiro Tanaka
Software Engineer / IT Architect
Google Developers Expert (Assistant, Web)
twitter.com/yoichiro
google.com/+YoichiroTanaka
Slide 3
Slide 3 text
For Assistant users...
Slide 4
Slide 4 text
Current Google Assistant Status
Slide 5
Slide 5 text
35 months
after the Google Assistant launched on Google I/O 2016
Slide 6
Slide 6 text
8 → 30 languages
14 → 80 countries
The Assistant went global (up from last year).
Slide 7
Slide 7 text
Improvement of Google Assistant
Slide 8
Slide 8 text
No content
Slide 9
Slide 9 text
No content
Slide 10
Slide 10 text
Speech recognition becomes so fast by next generation assistant.
Slide 11
Slide 11 text
Google Assistant shows you a specific result by Personalize help.
Slide 12
Slide 12 text
"Hey Google, let's drive" Driving mode brings a user many things, which the user may do during driving a car.
Slide 13
Slide 13 text
Users can stop the alarm by calling "Stop!" only without "Hey Google".
Slide 14
Slide 14 text
Duplex on the web
Slide 15
Slide 15 text
For example, there are so many steps to book a car.
Slide 16
Slide 16 text
Duplex on the web supports to book a car instead of operating by a user.
Slide 17
Slide 17 text
Web developers can analyze the web site's flow for Duplex on the web and can issue a test account on Search Console.
Slide 18
Slide 18 text
Nest Hub / Nest Hub Max
Slide 19
Slide 19 text
Google focuses on Smart Display.
Slide 20
Slide 20 text
"Google Home Hub" rebrands as "Nest Hub". Nest Hub will sale some countries including Japan!
Slide 21
Slide 21 text
10 inch display with Camera
Face Match with Camera
Operate by Gesture with Camera
Video Call with Google Duo
$229 this summer on US, UK, AU
Nest Hub Max
Slide 22
Slide 22 text
For action developers...
Slide 23
Slide 23 text
For action developers
If you are a...
● Content Owner
● Android app developer
● Hardware developer
● Innovator in the
Conversational space
Markup, Template, Mini-apps
App Actions
Smart Home
Conversation Actions,
Interactive Canvas
Slide 24
Slide 24 text
How-to and FAQ content
Slide 25
Slide 25 text
{
"@context": "http://schema.org",
"@type": "HowTo",
"name": "How to Install a Dog Door",
"description": "...easy instructions on how to install a dog door...",
"step": [
{
"@type": "HowToStep",
"name": "Remove Screen Door",
"image": "https://diy.snding.com/content/...",
"text": "Remove the screen door from the door frame...",
"url": "https://www.diynetwork.com/.../install-a-dog-door#step1"
}, ...
]
}
When writing a metadata with "HowTo" type defined by schema.org,
Slide 26
Slide 26 text
the instruction will not only be shown on the search result with rich UI experience,
Slide 27
Slide 27 text
but it also will be shown on Smart Display as well. If clicking the "Start tutorial" button, the instruction is started.
Slide 28
Slide 28 text
In addition, if you have a video to instruct something, you can change it to the instruction content.
Slide 29
Slide 29 text
When defining each step with title, description and video timestamp on Google Sheets and uploading it to AoG console,
Slide 30
Slide 30 text
the video will be shown on Smart Display as instruction content.
Slide 31
Slide 31 text
Mini-apps
Slide 32
Slide 32 text
"Mini-apps are a new capability on Search and
the Assistant that enable you all to engage users
with interactive flows and live content right on
each surface."
~ Allen Harvey, Google
Slide 33
Slide 33 text
Interactive & Rich
Live content
Mini-apps are:
● Can provide
Interactive and Rich
Live content as each
Search Result.
● Can build Mini-apps
with Web
Technology including
HTML, CSS and
Javascript.
Slide 34
Slide 34 text
"name": "Google I/O Mini-app"
"description": "A Hello World Mini-app"
"company": "Google"
"url": "www.google.com"
...
"supportedLanguages": ["en"]
"supportedRegions": ["US"]
"webhook": "https://mywebhook.example.com/mini-app
Create the app configuration
Slide 35
Slide 35 text
Choose from a
library of UI
Components
● Text
● Carousel
● Chip
● Button
● Image
● etc.
Slide 36
Slide 36 text
"perLocaleQueryExamples": [{
"language": "en",
"queryExamples": [
{"pattern": "hello world"},
{"pattern": "hello Google I/O"}
}]
Setup triggering
Slide 37
Slide 37 text
Register and Test the Mini-app on Actions on Google Console
Slide 38
Slide 38 text
Run the same Mini-app on Smart Display
Slide 39
Slide 39 text
Can fill in something with voice
Slide 40
Slide 40 text
https://developers.google.com/search/docs/guides/mini-apps
Slide 41
Slide 41 text
App Actions
Slide 42
Slide 42 text
App Actions let users launch specific features in your app using the Google Assistant.
Slide 43
Slide 43 text
Google Assistant sends an intent to the registered Android app.
Slide 44
Slide 44 text
No content
Slide 45
Slide 45 text
Smart Home
Slide 46
Slide 46 text
No content
Slide 47
Slide 47 text
Each element which consists of Smart Home is managed by Home Graph.
Slide 48
Slide 48 text
Traits are each behavior of devices. These new traits have been defined.
Slide 49
Slide 49 text
We have a integration way with Cloud-to-Cloud path. Now, we will a new way with Local Home SDK as well.
Slide 50
Slide 50 text
Local Home SDK brings a new capability to control each device from the code deployed in the Google Home directly.
Slide 51
Slide 51 text
Interactive Canvas
Slide 52
Slide 52 text
Canvas is a framework that allows developers to add a visual, immersive experience to conversational Actions.
Slide 53
Slide 53 text
Interactive Canvas can be built with Web Standard Technologies.
Slide 54
Slide 54 text
Canvas is invoked by Immersive Response, and Interactive Canvas API is used to communicate to the device.
Slide 55
Slide 55 text
No content
Slide 56
Slide 56 text
No content
Slide 57
Slide 57 text
No content
Slide 58
Slide 58 text
No content
Slide 59
Slide 59 text
https://github.com/actions-on-google/dialogflow-interactive-canvas-nodejs
Slide 60
Slide 60 text
Sessions
Slide 61
Slide 61 text
Design and Build Actions
For designing and building your actions:
● Prototyping Voice Experiences: Design Sprints for the Google Assistant
● Intro to the Google Assistant: Build Your First Action
● 10 Best Practices for High Quality Actions
● Let’s Talk: Designing Quality Conversations for the Google Assistant
Slide 62
Slide 62 text
Smart Home
For building Smart Home actions:
● Smart Home 101: How to Develop for the Connected Home
● Local Technologies for the Smart Home
● Tools for Building Better Smart Home Actions
Slide 63
Slide 63 text
Search and Assistant
For providing your contents :
● Create App-like Experiences on Google Search and the Google Assistant
● Enhance Your Search and Assistant Presence with Structured Data
Slide 64
Slide 64 text
Android
For integrating with Android:
● Extend Your Android App to the Google Assistant
Slide 65
Slide 65 text
Smart Display
For adjusting your actions for Smart Display:
● What’s New in the Google Cast SDK
● Build Interactive Games for the Google Assistant
● Voice and Visual: How to Build Actions for Smart Displays and More Devices
Slide 66
Slide 66 text
Others
● Reach the Next Billion Users with Your Actions for the Google Assistant
● How We Built the Google Assistant Sandbox Demos (And How You Can Too)
● Data and Insights to Build for the Digital Assistant Era
Slide 67
Slide 67 text
Assistant Developer Community Japan
Google Groups http://bit.ly/assistant-dev-japan
Slack http://bit.ly/assistant-dev-slack
Slide 68
Slide 68 text
Any questions?