11.30 - 12.30 Chatbots & Google Assistant by Lee ▶ 12.30 - 13.00 Lunch ▶ 13.00 - 14.00 Cloud AI by Lee ▶ 14.00 - 14.15 Quiz - (Win a Google Home!) ▶ 14.15 - 14.30 Conclusions by Tessa Agenda
Dialogflow Expert Chapter Lead ERG Gayglers Public Speaker (since 2013) Writer/Blogger for Techzine, .Net Magazine, Marketingfacts.nl, CustomerTalk.nl and Google Cloud Blog www.leeboonstra.com
2, mobile web development) Technical Trainer @ Sencha Inc. 2012 - 2016 Lead Client-side Engineer @ Valtech 2009 - 2012 Senior Java Developer @ Accenture 2007 - 2009 Founder of my own company 2004 www.leeboonstra.com
AI solutions Cloud Job Discovery Contact Center Document Understanding Cloud AI building blocks Cloud AI platform Cloud ML Engine Cloud Video Intelligence ML professionals & service partners ASL Professional Services Organization Cloud AutoML Vision Vision Cloud Vision Language Cloud Natural Language Cloud AutoML NL Dialogflow Enterprise Cloud Translation Cloud Speech-to-Text Cloud Text-to-Speech Cloud AutoML Translation New New New Cloud GPU Cloud TPU Cloud Dataflow Cloud Dataproc Machine & Deep Learning ML accelerators ML libraries Tensorflow Kubeflow Kaggle/datasets Datasets
by Google) • Powered by Machine Learning: ◦ Natural Language Understanding (NLU) ◦ Intent Matching ◦ Conversation Training • Cross platform • Build faster with the Web UI • Scalable: separate your conversation text from code • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Direct integration with 15+ channels like Google Assistant, Slack, Twilio, Facebook... Development suite for building Conversational UIs.
easy integration with over 100 Cloud components • Cloud Support and SLA available • Compliance • Extensive Documentation and training programs available. • Powerful IAM; User Roles and Permissions • Stackdriver integration for automatic logging, debugging, tracing and error reporting • Unlimited API call quotas
on social media like Facebook Messenger, Slack.... Voice Activated Speakers Smart Assistants, like Google Assistant, Alexa, Siri, on mobile phones and devices like Google Home, Google Hub, Watches, TVs... Callbots Chatbots integrated in IVR systems, phone reservation systems, contact centers...
Chatbots that face customers. • Chatbots to collect feedback. • Topic Modelling • Chatbots for intent matching (Natural Language for Searching on websites.) • Chatbots on social media.
Bank. Customers can ask ‘Inge’ information about their accounts and debit cards. Inge can detect the sentiment. When customers get frustrated, it will automatically route the user to a human agent.
since it’s very accessible. • Google Assistant has over 1 billion of users. • According to Adobe Analytics, 71% of owners of smart speakers use voice assistants at least daily, and 44% using them multiple times a day. • Extend the Google Assistant with your apps. Users expect your brand to be available on smart speakers.
Assistant can help you with banking via voice. You can request your balance, transfer money or set budget notifications. It’s available in multiple languages for Google Assistant on mobile devices and on the Google Home.
taxis last month. You took the TCA taxi twice. Here’s an overview: Voice channels with screens How much have I spent on taxis last month? Focus on the conversation. But also display stuff.
SERVER Hey Google.. ..will it rain today? GET www.weather.com/info city: Amsterdam Date: 2019-02-06 { location: “amsterdam” weather: “rain”, temperature: 8 } Yes, it will rain in Amsterdam all day today. Speaking
own custom actions. Hey Google, let me talk to BookAMeetingRoom Welcome, how can I help you? I want to book a meeting room for 3 persons. Let’s get BookAMeetingRoom Sure, for when? Tomorrow, from 2pm to 3pm.
with __________. Ok Google, get __________. Start a 3rd party action There is an app directory! (appstore). And the Google Assistant can give app suggestions.
on GA+ UX components - Actions on Google Optional: • Back-end integration - Fulfillment app (dialogflow/aog SDK) • Communication to back-ends - Your own APIs What do I need to build my own action?
or phones (Android, iOS app) • Actions on Google includes: ◦ UI toolkit, ◦ Audio toolkit ◦ Account Linking API ◦ SDKs ◦ tutorial guides • UI components such as: ◦ Buttons, Images ◦ Cards, Carousels, ◦ Lists ◦ Tables Program for developers of Actions (“apps”) that run via Google Assistant Actions on Google
Unlimited Call transfers • IVR difficult to navigate • Availability • Inadequate information • Agents have to answer same types of questions over and over again.
give on screen solutions to the human agent. • Always answers the right question. • Shorten hold times • Shorten the call time Bots that understand your question. • No longer you need to listen to audio recordings & press keys. • You don’t need to be transferred from one agent to the other Bots that can answer / resolve common questions. • Shorten hold times • Shorten the call time • Availability • No longer you’ve been told to look on the website
contact center spikes. At the end of the year, customers are able to change their insurance. Which results in long waiting times and students that aren’t trained, picking up the phone. Calls needs to be monitored, to gather analytics about the type of questions and provided service.
let me talk to Babs The Banking Bot Welcome, how can I help you? I want to transfer money. Let’s get Babs the Banking Bot How much do you want to transfer? 100 euro.
User types to custom UI or channel Chatbot replies Dialogflow Enterprise Customer Client JS Angular 5 web front-end Kubernetes Engine Chat Server Dialogflow SDK / socket.io Kubernetes Engine Back-end CRM Python / Django Kubernetes Engine Container Registry Containers images can be stored in the Container Registry Messaging Publisher Pub/Sub Webhook Router Cloud Function Webhook Container Builder Building Dev Pipelines
use for our own internal machine learning projects, and now it’s available to you! Google made it open source. • More than 480 contributions • 10,000 commits in a year • 53k star rating http://www.tensorflow.org
Custom ML Model • Need a custom ML model • Have a team of data scientist • Run Hybrid / On-premise Pretrained Google ML Models • Don’t have much data • Have a team of developers • Run as full AI solution (no developers or data scientists needed) Retrain a Google ML Model • Need a custom ML model • Have a team of developers
AI solutions Cloud Job Discovery Contact Center Document Understanding Cloud AI building blocks Cloud AI platform Cloud ML Engine Cloud Video Intelligence ML professionals & service partners ASL Professional Services Organization Cloud AutoML Vision Vision Cloud Vision Language Cloud Natural Language Cloud AutoML NL Dialogflow Enterprise Cloud Translation Cloud Speech-to-Text Cloud Text-to-Speech Cloud AutoML Translation New New New Cloud GPU Cloud TPU Cloud Dataflow Cloud Dataproc Machine & Deep Learning ML accelerators ML libraries Tensorflow Kubeflow Kaggle/datasets Datasets
Models Cloud AI Platform Hardware optimised for your problem Cloud TPU, GPU, CPU Any ML framework Cloud ML Engine Managed Portable Portable & Open Kubeflow One stop AI catalog AI Hub
Learning pipeline Data ingestion 1 Data analysis 2 Data transformation 3 Train 4 Model evaluation 5 Model validation 6 Deploy 7 Pub/Sub Data studio Datalab Dataproc Dataflow Dataprep BigQuery
Learning pipeline Data ingestion 1 Data analysis 2 Data transformation 3 Train 4 Model evaluation 5 Model validation 6 Deploy 7 • Managed service to make training & prediction easy • Easy distributed training • Hyperparameter tuning • Top 4 frameworks • Custom container support coming soon
Kubernetes Easy to get started • Out-of-box support for top frameworks ◦ pytorch, caffe, tf and xgboost • Kubernetes manages dependencies, resources Swappable & scalable • Library of ML services • CPU, GPU, TPU • Massive scale Meet customer where they are • GCP • On-prem ML microservices Kubernetes Cloud On-prem Training Predict Training Predict … …
play pipelines & other content built by Google AI. 01 Private hosting Host pipelines and ML content with private sharing controls within an enterprise to foster reuse within organizations. 02 Easy deployment on GCP and hybrid Deploy pipelines via Kubeflow on GCP and on premise. 03 (g.co/aihub)
Deep Learning VM Images Cloud Dataflow Cloud Dataproc Google BigQuery Cloud Dataprep Google Data Studio Notebooks Data Labeling Training Predictions Pre-built Algorithms For data warehousing For data transformation For data cleansing For Hadoop and Spark clusters For BI dashboards AI Hub
power your applications.. No need for signal processing or noise cancellation before calling API. Can handle noisy audio from a variety of environments. Noise Robustness Can provide context hints for improved accuracy. Especially useful for device and app use cases. Word Hints Speech Recognition Recognizes over 80 languages & variants. Can also filter inappropriate content in text results Over 80 languages Can stream text results, returning partial recognition results as they become available. Can also be run on buffered or archived audio files. Real-time results
gRPC Recognized Text gRPC streaming request with initial context Real time streaming results while speaking Bi-directional: Streams audio in while stream text out 1 2 3
Uses DeepMind’s WaveNet technology (It closes the voice-quality gap with human voice (based on the Mean Opinion Score for voice quality) by over 70 percent.) • Also used for Phone Calls, when making use of the Phone Gateway. • Device Profiles (Shape the waveform differently, depending on the speaker you use.) • You will need to enable Automatic Text to Speech in Settings/Speech menu. Text to Speech (TTS)
Voices sound natural and unique • Capture subtleties like pitch, pace, and all the pauses that convey meaning • Create New voices in weeks i.s. Months https://deepmind.com/blog/wavenet-generative-model-raw-audio/ DeepMinds WaveNet Technology
as person, organization, location, events, products and media. Enables you to easily analyze text in multiple languages including English, Spanish and Japanese. Extract tokens and sentences, identify parts of speech (PoS) and create dependency parse trees for each sentence. Syntax analysis Entity Recognition Multi-Language Support Understand the overall sentiment expressed in a block of text. Sentiment Analysis
PII and sensitive data with Machine Learning • Scan for and anonymize sensitive data to comply with regulations or policies (text, text on file system, Cloud Storage, DataStore, BigQuery) • Clear reporting for review and auditing
languages wiht high accuracy. Easy to use Google REST API. You don’t have to extract text from you document. Just send it HTML documents and get back translated text. Can seamlessly scale with almost any volume. If a higher quota is needed, you can simply request an increase. Highly scalable The Premium edition is tailored for users who need precise, long-form translation services (e.g. livestream translations, high volume of emails, detailed articles and documents) Premium edition BETA Detect + translate Simple integration TRY THE API
ranging from modes of transportation to animals. Analyze facial features to detect emotions: joy, sorrow, anger. Detect logos. Detect and extract text within an image, with support for a broad range of languages, along with support for automatic language identification. Extract text Detect different types of inappropriate content from adult to violent content. Powered by Google Safe Search Detect inappropriate content Object Recognition Facial sentiment & logos
"dog", "flower" or "car". You can now search your video catalog the same way you search text documents.. Extract actionable insights from video files without requiring any machine learning or computer vision knowledge. Enable Video Search Label Detection Insights From Videos
this before Trained on common classes Specific to your dataset ML APIs TensorFlow “cat” “bob” AUTO ML Developer Data Scientist Developer or Data scientist
DATA PREPROCESSING Introducing Cloud AutoML A technology that can automatically create a Machine Learning Model UPDATE DEPLOY EVALUATE TUNE ML MODEL PARAMETERS ML MODEL DESIGN DATA PREPROCESSING
• Create models for your own domain, but use the Google pre-trained models as a base. ◦ Vision, Translation, or NLP • Web Interface, to upload a CSV with labeled data. • Your use-case is: ◦ Not supported by pre-built APIs AND ◦ Has sufficient labeled training data • You want to get to produce a model and predict quickly • You don’t want to build a model from scratch
savelee
niw
coe
monoqlo
logico
fromatom
fabpot
kiwi26
0si43
1ftseabass
koooootake
kwada
fkino
malarkey
tanoku
myddelton
philnash
hannesfritz
addyosmani
paulrobertlloyd
andyhume
davidbonilla
jlugia
reverentgeek
chriscoyier
