Voice Activated UI - Devfest DC 2017

Products like the Amazon Echo and Google Home are primarily targeted at making it possible to access information and engage with services without a screen, but there is also great opportunity to use these same devices to control existing UIs (such as is being done with voice on TV platforms).

In this session, we’ll cover some examples of how to use a Google Home device to make using complex UI interaction easier, developed with Angular, and what considerations are needed to make voice interactivity possible.

Presentation from http://www.devfestdc.org/sessions/voice-user-interfaces-with-angular-and-google-home/

Transcript

1. Voice Activated UI Jeremy Wilken @gnomeontherun
2. Jeremy Wilken @gnomeontherun • Staff UI Engineer at VMware • Google Developer Expert • Author of Angular in Action, Ionic in Action • Homebrewer, Certified Beer Judge • Live in Austin, TX
3. A look at the future, from the past.
5. Applications of tomorrow will use natural language to improve user experience.
6. Use case: Databank
8. Challenges in traditional user experience
9. – R O B E R T O R B E N “To err is human - and to blame it on a computer is even more so.”
10. Demo using natural language
12. – J E A N R O S TA N D “Think? Why think! We have computers to do that for us.”
13. Actions on Google
14. Actions on Google
16. – T E M P L E G R A N D I N “Language for me narrates the pictures in my mind.”
17. Actions on Google
18. API.ai maps language to actions
20. Show me a list of countries by population. Display a table of most populous countries. Show countries with the largest population. Display Mode Metric Sort
21. Show me a list of countries by population. Display a table of most populous countries. Show countries with the largest population. Display Mode Metric Sort
22. Show countries with the most crime. "I'm sorry, I don't have that data. Can you select another type of data?"
23. – D O U G L A R S O N “If the English language made any sense, lackadaisical would have something to do with a shortage of flowers.”
24. Actions on Google
25. Firebase database pushes updates • Firebase receives data from server • Automatically syncs the client with current state by pushing new data • Happens in real time
27. Actions on Google
28. Angular application reacts to actions • Firebase pushes new data to controller • Controller determines if the action is valid and what to do • Renders the resulting display
30. – N I C H O L A S N E G R O P O N T E “Computing is not about computers any more. It is about living.”
31. Potential use cases
32. – T E D N E L S O N “The good news about computers is that they do what you tell them to do. The bad news is that they do what you tell them to do.”
33. A word of caution with voice commands
34. – A R T H U R K O E S T L E R “True creativity often starts where language ends.”
35. https://github.com/gnomeontherun/ voice-activated-ui-ng-conf-2017 Jeremy Wilken @gnomeontherun https://gnomeontherun.com Credits: https://www.flickr.com/photos/lumiereimages/14433154384/ https://www.flickr.com/photos/michaeljzealot/16639251005/ https://www.flickr.com/photos/dstrelau/5864824829/ https://www.flickr.com/photos/janitors/14063292049/ https://www.flickr.com/photos/142305740@N05/33433114206