Alexa goes Azure

Alexa, Cortana oder Google Assistant heißen die neuesten Familienmitglieder in vielen Haushalten, welche bereits von Haus aus mit vielen nützlichen Fähigkeiten ausgestattet sind. In dieser Session möchte Sebastian Jensen, Software-Entwickler bei der medialesson GmbH, einen Überblick über die etablierten Sprachassistenten geben. Im Mittelpunkt steht hierbei, wie die Funktionen von Alexa, dem Sprachassistenten von Amazon, durch selbstentwickelte Skills auch mit der Hilfe von Microsoft Azure erweitert werden können. An praktischen Beispielen werden Tipps und Tricks bei der Skillentwicklung erörtert.

Transcript

1. Alexa goes Azure Introduction
2. Sebastian Jensen Developer jensen@medialesson.de @tsjdevapps
3. Agenda • Introduction • Wording • Accounts • Skill Development • Recap • Resources
4. Introduction
5. Quelle: YouTube | https://www.youtube.com/watch?v=kty0xCgIYjA
6. Definition Virtual Assistant An intelligent virtual assistant (IVA) or intelligent personal assistant (IPA) is a software agent that can perform tasks or services for an individual based on commands. Some virtual assistants are able to interpret human speech and respond via synthesized voices.
7. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019
8. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri • Apple • October 2011 • iOS, macOS, watchOS, tvOS
9. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Cortana • Microsoft • April 2014 • Windows, xBox, Android, iOS
10. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Alexa • Amazon • November 2014 • Echo Family, Android, iOS, Windows Cortana
11. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Google Assistant • Google • May 2016 • Android, iOS, Google Home Cortana Alexa
12. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Bixby • Samsung • April 2017 • Samsung Devices Google Assistant Cortana Alexa
13. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Hallo Magenta • Telekom • May 2019 • Smart Speaker Google Assistant Bixby Cortana Alexa
14. Current Voice Assistants 2011 2012 2013 2014 2015 2016 2017 2018 2019 Siri Google Assistant Bixby Hallo Magenta Cortana Alexa
15. Skill Development Alexa Cortana Siri Google Manufacturer Amazon Microsoft Apple Google Devices Echo, Fire TV, Fire Tablet, App Windows 10 iOS, macOS, watchOS, tvOS Android, iOS, Google Home Languages DE, EN, IT, ES, JA, FR, PR EN - ALL Input Speech & Touch Speech, Touch & Text Speech Speech & Text Portal developer.amazon.com developer.microsoft.com - developers.google.com
16. Wording
17. Wording: Skill • Voice Experiences, which can be developed by 3rd parties • Extends the available functions, like getting the weather • "Voice Apps" with focused functionality • Mostly available for free, but ISP is possible • Be activated or deactivated via voice commands or companion apps
18. Wording: Invocation Name • word or phrase used to trigger a skill • voice’s equivalent of an app icon • usually matches the skill’s name • Alexa start Invocation Name
19. Wording: Intent • what a user is trying to accomplish • how you define your function • a skill can have many different intents • Alexa ask Invocation Name for the weather.
20. Wording: Utterances • specific phrases that people will use when making a request • have to be coded to tell Alexa what to expect • sometimes this means typing out dozens of very slight variations
21. Wording: Slot • a variable that relates to an intent • Amazon provides a number of built in slot types – dates – numbers – durations – time – names • you can create custom slots for variables which are specific to your skill
22. Necessary Accounts
23. Amazon Developer Account https://developer.amazon.com
24. Microsoft Azure Account https://portal.azure.com
25. Optional: Amazon AWS Account https://aws.amazon.com
26. Skill Development
27. Recap
28. Alexa Skill Request
29. Alexa Skill Response
30. Alexa.NET https://www.nuget.org/packages/Alexa.NET/
31. Validate a request https://www.nuget.org/packages/Alexa.NET.Security.Functions/
32. Multilingualism of a Skill https://www.nuget.org/packages/Alexa.NET.LocaleSpeech/
33. Resources • Amazon Developer Console – https://developer.amazon.com/ • Azure Portal – https://portal.azure.com • Sample Code – https://github.com/tsjdev-apps/dwx2019-alexa
34. Any questions?
35. Thank you for your attention www.medialesson.de