Upgrade to Pro — share decks privately, control downloads, hide ads and more …

"Hey, Alexa!" – Wie APIs das alltägliche Leben erobern

"Hey, Alexa!" – Wie APIs das alltägliche Leben erobern

Eines ist sicher: Die Verbreitung von APIs schreitet voran. Für manche Anwendungsfälle offensichtlich und merklich spürbar, für andere eher im Verborgenen. In diesem Abendvortrag wollen Manuel Rauber und Christian Weyer in entspannter Atmosphäre einen kurzen Einblick in die Programmierung von Amazons Echo mit dessen diversen APIs wie dem Alexa Sprachservice geben. Vielleicht steht ja bereits ein solches oder ähnliches Gerät in Ihrem Wohnzimmer? Dann lassen Sie uns doch ein bisschen programmieren und Alexa unseren Abend ein Stück weit angenehmer machen – ob das klappt?

GitHub: https://github.com/thinktecture/basta-herbst-2017-alexa

Manuel Rauber

September 27, 2017
Tweet

More Decks by Manuel Rauber

Other Decks in Programming

Transcript

  1. “Hey, Alexa!”
    Wie APIs das alltägliche Leben erobern
    Manuel Rauber
    @manuelrauber
    Consultant
    Christian Weyer
    @christianweyer
    CTO

    View Slide

  2. Christian Weyer
    ! @christianweyer
    " https://www.thinktecture.com
    Co-founder, co-owner and
    CTO at Thinktecture AG
    Manuel Rauber
    ! @manuelrauber
    " https://manuel-rauber.com
    Consultant at Thinktecture AG
    Hey, Alexa!
    Wie APIs das alltägliche Leben erobern
    Speakers

    View Slide

  3. Topics
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  4. Disclaimer
    We are not affiliated with Amazon,
    whatsoever
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  5. APIs everywhere
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  6. § APIs are everywhere – or rather: should be everywhere
    § „APIs FTW!“
    § Internet-of-Things (IoT) only really works with APIs
    § HTTPS, WebSockets, AMQP etc.
    § BTW: https://www.programmableweb.com/ has some nice public APIs
    to play with
    API-ification
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  7. Voice User Interfaces
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  8. Punch cars
    Text input & keyboard
    Mouse & GUI
    Touch
    Gestures
    Voice & speech
    VUI = Voice user interface
    How we got there
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  9. § We always need a client use cases define the interactions
    § Talk to the client application, rather than use a mouse or a finger
    § Voice user interfaces are not yet as ubiquitous
    § We need different UX we still need to learn
    § Siri, Cortana, Alexa, Bixby etc. are already here
    § Can be used in any kind of application
    § Bots backed by artificial intelligence can leverage voice services as
    their input interface / API
    It is all about the use cases
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  10. Voice-enabled
    personal assistants
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  11. § They are spreading like crazy
    Google, Apple & Co.
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  12. § Amazon‘s entry into the game
    Amazon Echo & Echo Dot
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  13. Amazon Alexa
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  14. § ”Intelligent” personal assistant
    § Alexa Voice Services
    § Open for custom services & 3rd party device integration
    § “AVS-enabled product”
    § “Alexa-enabled product”
    § https://github.com/alexa/alexa-avs-sample-app/wiki/Raspberry-Pi
    § Like Microsoft’s Cognitive Services or Google’s Speech API
    § MS currently has the broadest set of APIs
    § Used by Amazon Lex
    § Provides speech recognition & natural language understanding
    § For building conversational interfaces (e.g. chatbots)
    Amazon Alexa
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  15. Skills Programming
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  16. § Two developer accounts
    § aws.amazon.com
    § developer.amazon.com
    § AWS: Lambda Function
    § Code is done directly in AWS or locally
    § Upload is needed when developing locally
    § Debugging is PITA
    § Skills can also be hosted anywhere (as a Web API)
    § Developer: Alexa Skill & Interaction Building
    § Intent
    § Utterance
    § Slots
    Basic Alexa Skill programming
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  17. “Real World” Demo !
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  18. § … he has to go to school ...
    The robot maker
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  19. Hey, Alexa!
    Wie APIs das alltägliche Leben erobern

    View Slide

  20. Hey, Alexa!
    Wie APIs das alltägliche Leben erobern
    Alexa Mindstorms EV3 Demo - Architecture

    View Slide

  21. NOTE - Demo
    Please do NOT USE the WIFI J
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  22. EV3 on steroids
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  23. § Debian Linux-based operating system
    § Runs on several LEGO® MINDSTORMS compatible platforms
    § Full development environment available
    § http://www.ev3dev.org
    § Python is best suited to build & run
    custom code
    ev3dev
    Wie APIs das alltägliche Leben erobern
    Hey, Alexa!

    View Slide

  24. Thank you!
    Questions?
    Demo Repository
    Hey, Alexa!
    https://github.com/thinktecture/basta-herbst-2017-alexa
    Manuel Rauber
    @manuelrauber
    Consultant
    Christian Weyer
    @christianweyer
    CTO

    View Slide