"Hey, Alexa!" – Wie APIs das alltägliche Leben erobern

Eines ist sicher: Die Verbreitung von APIs schreitet voran. Für manche Anwendungsfälle offensichtlich und merklich spürbar, für andere eher im Verborgenen. In diesem Abendvortrag wollen Manuel Rauber und Christian Weyer in entspannter Atmosphäre einen kurzen Einblick in die Programmierung von Amazons Echo mit dessen diversen APIs wie dem Alexa Sprachservice geben. Vielleicht steht ja bereits ein solches oder ähnliches Gerät in Ihrem Wohnzimmer? Dann lassen Sie uns doch ein bisschen programmieren und Alexa unseren Abend ein Stück weit angenehmer machen – ob das klappt?

GitHub: https://github.com/thinktecture/basta-herbst-2017-alexa

Transcript

1. “Hey, Alexa!”
   Wie APIs das alltägliche Leben erobern
   Manuel Rauber
   @manuelrauber
   Consultant
   Christian Weyer
   @christianweyer
   CTO
   

   View Slide

2. Christian Weyer
   ! @christianweyer
   " https://www.thinktecture.com
   Co-founder, co-owner and
   CTO at Thinktecture AG
   Manuel Rauber
   ! @manuelrauber
   " https://manuel-rauber.com
   Consultant at Thinktecture AG
   Hey, Alexa!
   Wie APIs das alltägliche Leben erobern
   Speakers
   

   View Slide

3. Topics
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

4. Disclaimer
   We are not affiliated with Amazon,
   whatsoever
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

5. APIs everywhere
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

6. § APIs are everywhere – or rather: should be everywhere
   § „APIs FTW!“
   § Internet-of-Things (IoT) only really works with APIs
   § HTTPS, WebSockets, AMQP etc.
   § BTW: https://www.programmableweb.com/ has some nice public APIs
   to play with
   API-ification
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

7. Voice User Interfaces
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

8. Punch cars
   Text input & keyboard
   Mouse & GUI
   Touch
   Gestures
   Voice & speech
   VUI = Voice user interface
   How we got there
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

9. § We always need a client use cases define the interactions
   § Talk to the client application, rather than use a mouse or a finger
   § Voice user interfaces are not yet as ubiquitous
   § We need different UX we still need to learn
   § Siri, Cortana, Alexa, Bixby etc. are already here
   § Can be used in any kind of application
   § Bots backed by artificial intelligence can leverage voice services as
   their input interface / API
   It is all about the use cases
   Wie APIs das alltägliche Leben erobern
   Hey, Alexa!
   

   View Slide

10. Voice-enabled
    personal assistants
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

11. § They are spreading like crazy
    Google, Apple & Co.
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

12. § Amazon‘s entry into the game
    Amazon Echo & Echo Dot
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

13. Amazon Alexa
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

14. § ”Intelligent” personal assistant
    § Alexa Voice Services
    § Open for custom services & 3rd party device integration
    § “AVS-enabled product”
    § “Alexa-enabled product”
    § https://github.com/alexa/alexa-avs-sample-app/wiki/Raspberry-Pi
    § Like Microsoft’s Cognitive Services or Google’s Speech API
    § MS currently has the broadest set of APIs
    § Used by Amazon Lex
    § Provides speech recognition & natural language understanding
    § For building conversational interfaces (e.g. chatbots)
    Amazon Alexa
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

15. Skills Programming
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

16. § Two developer accounts
    § aws.amazon.com
    § developer.amazon.com
    § AWS: Lambda Function
    § Code is done directly in AWS or locally
    § Upload is needed when developing locally
    § Debugging is PITA
    § Skills can also be hosted anywhere (as a Web API)
    § Developer: Alexa Skill & Interaction Building
    § Intent
    § Utterance
    § Slots
    Basic Alexa Skill programming
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

17. “Real World” Demo !
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

18. § … he has to go to school ...
    The robot maker
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

19. Hey, Alexa!
    Wie APIs das alltägliche Leben erobern
    

    View Slide

20. Hey, Alexa!
    Wie APIs das alltägliche Leben erobern
    Alexa Mindstorms EV3 Demo - Architecture
    

    View Slide

21. NOTE - Demo
    Please do NOT USE the WIFI J
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

22. EV3 on steroids
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

23. § Debian Linux-based operating system
    § Runs on several LEGO® MINDSTORMS compatible platforms
    § Full development environment available
    § http://www.ev3dev.org
    § Python is best suited to build & run
    custom code
    ev3dev
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!
    

    View Slide

24. Thank you!
    Questions?
    Demo Repository
    Hey, Alexa!
    https://github.com/thinktecture/basta-herbst-2017-alexa
    Manuel Rauber
    @manuelrauber
    Consultant
    Christian Weyer
    @christianweyer
    CTO
    

    View Slide