Trivadis TechEvent 2019: Intelligenz-als-Service mit Azure Cognitive Services

Mit den Cognitive Services der Microsoft Azure Cloud können eigene Anwendungen mit minimalem Aufwand um Funktionalität erweitert werden, die vor wenigen Jahren undenkbar war. Microsoft Research stellt uns Entwicklern die Resultate von jahrzehntelanger Forschung über einfach zu benutzende REST-Schnittstellen zur Verfügung. Egal, ob es um Gesichts-/Gefühls-/Sprach-/Texterkennung, Übersetzung oder Informationssuche geht, mit den Cognitive Services können wir die Applikationen der Zukunft schreiben. In dieser Session erzählen wir worum es geht und was man mit dieser Intelligenz-als-Service so alles machen kann.

Transcript

1. Intelligence-as-a-Service
   mit Azure Cognitive Services
   Thomas Gassmann, Manuel Meyer
   @gassmannT
   @manumeyer1
   www.thomasgassmann.net/
   www.manuelmeyer.net/
   

   View Slide

2. Agenda
   ▪ Overview
   ▪ The APIs
   ▪ Applications
   

   View Slide

3. Overview
   

   View Slide

4. What are Cognitive Services?
   ▪ Over 40 APIs
   ▪ Platform independent,
   REST-based
   ▪ Pay-as-you-go
   ▪ Start for free.
   

   View Slide

5. Roll your own with REST APIs
   Simple to add: just a few lines of
   code required
   Integrate into the language and
   platform of your choice
   Breadth of offerings helps you find the
   right API for your app
   Built by experts in their field from
   Microsoft Research, Bing, and Azure
   Machine Learning
   Quality documentation, sample
   code, and community support
   Easy Flexible Tested
   GET A
   KEY
   

   View Slide

6. Application Examples
   ▪ Emotion Detection at a Retail Display
   ▪ Facial Identification to find missing children
   ▪ Sentiment Analysis to learn how customers feel
   ▪ Face detection to calculate male/female ratio at the
   TechEvent
   ▪ Language Understanding to support Bots
   ▪ Object recognition to help a blind person read a menu.
   

   View Slide

7. Demo
   Intelligent Kiosk
   https://github.com/Microsoft/Cognitive-Samples-IntelligentKiosk
   

   View Slide

8. The APIs
   Vision, Speech, Language, Knowledge, Search
   

   View Slide

9. Vision API
   Computer Vision API
   Distill actionable
   information from
   images
   Video API
   Face API Emotion API
   

   View Slide

10. Vision API Applications
    

    View Slide

11. Demo Vision APIs
    

    View Slide

12. Face API Explorer
    1. Get Keys: https://azure.microsoft.com/de-
    de/services/cognitive-services/
    2. Face API Docs:
    https://westus.dev.cognitive.microsoft.com/docs/services/56
    3879b61984550e40cbbe8d/operations/563879b61984550f3
    0395236
    3. Face API Console:
    https://westeurope.dev.cognitive.microsoft.com/docs/service
    s/563879b61984550e40cbbe8d/operations/563879b6198455
    0f30395236/console
    

    View Slide

13. Demo Face API Explorer
    

    View Slide

14. Vision API
    Bing Speech API Speaker Recognition API Custom Recognition
    Intelligent Service
    

    View Slide

15. Demo Speech APIs
    

    View Slide

16. Language API
    Bing Spell
    Check API
    Language
    Understanding
    Intelligent
    Service
    Web Language
    Model API
    Linguistic
    Analysis API
    Text Analytics
    API
    

    View Slide

17. Demo JFK Files
    https://azure.microsoft.com/en-us/services/cognitive-services/text-analytics/
    https://www.ailab.microsoft.com/experiments/jfk-files
    

    View Slide

18. Search API
    Academic
    Knowledge API Recommendations
    API
    Knowledge
    Exploration
    Service
    Entity Linking
    Service
    

    View Slide

19. The Applications
    

    View Slide

20. Q&A Bot Maker
    https://qnamaker.ai
    

    View Slide

21. Seeing AI App
    ▪ “Seeing AI” from Saqib Shaik
    ▪ Speak about surroundings
    ▪ Read text
    ▪ https://www.youtube.com/watch?v=R
    2mC-NUAmMk&t=
    ▪ https://www.microsoft.com/en-
    us/seeing-ai/
    See4Me by DotNetToscana
    https://github.com/DotNetToscana/See4Me
    Credits: https://twitter.com/marcominerva/
    

    View Slide

22. Powerpoint Presentation Translator
    ▪ Live subtitle
    ▪ Translation into 60 languages
    ▪ Join via mobile device.
    https://translator.microsoft.com/help/presentation-translator/
    

    View Slide

23. Thank you!
    Manuel Meyer
    www.manuelmeyer.net
    @manumeyer1
    manuel.meyer@trivadis.com
    Thomas Gassmann
    www.thomasgassmann.net
    @gassmannT
    thomas.gassmann@trivadis.com
    Raum Basel
    11:00
    

    View Slide

24. View Slide

25. Links
    ▪ Intelligence Kiosk
    ▪ https://github.com/Microsoft/Cognitive-Samples-
    IntelligentKiosk
    ▪ Speech-to-Text, Translation
    ▪ https://github.com/Azure-Samples/cognitive-services-
    speech-sdk
    ▪ QnA Maker
    ▪ https://qnamaker.ai
    ▪ SeeingAI / See4Me
    ▪ https://www.youtube.com/watch?v=R2mC-NUAmMk&t=12s
    ▪ https://github.com/DotNetToscana/See4Me
    

    View Slide

26. Links
    ▪ Free Credits
    ▪ https://www.microsoft.com/cognitive-
    services/en-us/sign-up
    ▪ Documentation
    ▪ https://azure.microsoft.com/en-
    us/services/cognitive-services/
    

    View Slide