Intelligent Personal Assistants Environment

An overview about Intelligent Personal Assistants, more specic on the voice commands interaction,
from the perspective of the software and user interface with the current environment.

João Ricardo Mattos e Silva
github.com/joaoricardo000
linkedin.com/in/joaoricardo000

Transcript

1. Intelligent Personal Assistants Environment João Ricardo
2. Intelligent Personal Assistants - IPA Examples of such an agent are Microsoft's Office Assistant and later Cortana, Apple's Siri, Google's Google Home, Google Now (earlier Android versions had voice search via Google Search; later Google introduced Google Assistant). Amazon Alexa, Amazon's Evi (branded as Evi), the open source Lucida, Braina (application developed by Brainasoft for Microsoft Windows), Samsung's S Voice, LG G3's Voice Mate, BlackBerry's Assistant, SILVIA, HTC's Hidi, IBM's Watson (computer), Facebook's M (app) and One Voice Technologies (IVAN).
3. Intelligent Personal Assistants - IPA Examples of such an agent are Microsoft's Office Assistant and later Cortana, Apple's Siri, Google's Google Home, Google Now (earlier Android versions had voice search via Google Search; later Google introduced Google Assistant). Amazon Alexa, Amazon's Evi (branded as Evi), the open source Lucida, Braina (application developed by Brainasoft for Microsoft Windows), Samsung's S Voice, LG G3's Voice Mate, BlackBerry's Assistant, SILVIA, HTC's Hidi, IBM's Watson (computer), Facebook's M (app) and One Voice Technologies (IVAN).
4. Utterance "Alexa, ask cheesecake who is the best caker" User Interface
5. Intent "Alexa, ask cheesecake who is the best caker" User Interface > Random User
6. User express an intent with an utterance. Utterances and Intents User Interface
7. "Alexa, ask cheesecake who is the best caker" Software Interface
8. "Alexa, ask cheesecake who is the best caker" Software Interface "wake up" word invocation name utterance
9. "Alexa, ask cheesecake who is the best caker" Software Interface "wake up" word invocation name utterance > Random User Intent
10. "Alexa, ask cheesecake who is the best caker" Software Interface "wake up" word invocation name utterance > Random User Intent > Server query CKL API for a random User < "João Ricardo"
11. "Alexa, ask cheesecake who is the best caker" Software Interface utterances > Random User Intent who is awesome who should win the ticket
12. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent
13. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent > Send RF command from the bond to the respective user's matching home appliances < "Ok"
14. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent turn off the lights in the kitchen shades up turn all lights on ...
15. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent
16. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent {Location} Kitchen Office Garage Bedroom .... {Device} Fan Shade Light Air Conditioner ... {Command} Speed 1-5 On/Off Up/Down Reverse … Slots (or entities or parameters)
17. Alexa, ask home bond to set speed 5 on the kitchen fan Software Interface utterance > Command Intent turn off the lights in the kitchen shades up turn all lights on {Location} {Device} {Command}
18. Software Interface > Command Intent turn {Command} the {Device} in the {Location} {Device} {Command} set {Location} {Device} {Command} {Device} at the {Location} to {Command} ...
19. Software Interface POST { "user": "user_id", "token": "user_access_token", "intent": "CommandIntent", "parameters":{ "command": "up", "device": "shades", "location": "" } }
20. Software Interface Responses! > "Ok!" > "Sorry, could not do that" > "Please, login in the app to link your account"
21. Software Interface Questions?! < "Alexa, ask home bond shades up!" > "Which shade, the one in the office or bedroom?" < "Bedroom" > "Ok!"
22. Software Interface Questions?! < "Alexa, start cheesecake" > "Here is cheesecake, what do you want?" Welcome Intent
23. Skill (or assistant) Interaction Model - Utterances - Intents - Slots
24. Thank you!
25. Intelligent Personal Assistants Environment João Ricardo