Improving your vision with Azure Cognitive Services

Presentation about Azure Cognitive Services for the first meetup for the Dutch Mixed Reality User Group (http://www.mixug.nl/) at Ettu on Wednesday 13th of September 2017.

Transcript

1. Improving your vision with Azure Cognitive Services - MixUG 1 Improving your vision with Azure Cognitive Services 13 September - MixUG
2. About me: Marc Duiker mduiker@xpirit.com @marcduiker www.xpirit.com blog.marcduiker.nl ‘13-’16
3. ML & AI is hot! Improving your vision with Azure Cognitive Services - MixUG 3
4. Cortana Intelligence Suite Improving your vision with Azure Cognitive Services - MixUG 4
5. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
6. How did we end up here? Improving your vision with Azure Cognitive Services - MixUG 6 Microsoft Cognitive Services Bing Search Project Oxford Microsoft Cognitive Toolkit (CNTK) Microsoft Technology & Research 2015 2009 2016
7. Improving your vision with Azure Cognitive Services - MixUG 7
8. Improving your vision with Azure Cognitive Services - MixUG 8
9. Improving your vision with Azure Cognitive Services - MixUG 9
10. Improving your vision with Azure Cognitive Services - MixUG 10
11. Improving your vision with Azure Cognitive Services - MixUG 11
12. Improving your vision with Azure Cognitive Services - MixUG 12
13. Improving your vision with Azure Cognitive Services - MixUG 13
14. Improving your vision with Azure Cognitive Services - MixUG 14
15. Microsoft Cognitive Services Docs https://docs.microsoft.com/en-us/azure/cognitive-services/index Improving your vision with Azure Cognitive Services - MixUG 15
16. Improving your vision with Azure Cognitive Services - MixUG 16 Computer Vision API
17. Computer Vision API • Recognize and understand information from images Improving your vision with Azure Cognitive Services - MixUG 17 Tags Descriptions Faces Colors Domain models Cognitive Services Computer Vision API
18. Computer Vision API • Examples • https://azure.microsoft.com/en-us/services/cognitive-services/computer- vision/ • API Reference • https://westus.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf2 3d8ec6739/operations/56f91f2e778daf14a499e1fa Improving your vision with Azure Cognitive Services - MixUG 18
19. Improving your vision with Azure Cognitive Services - MixUG 19
20. Cognitive Services Demo App Improving your vision with Azure Cognitive Services - MixUG 20 http://... <img> <img> <img> File Scrape images Analyze Save results Cognitive Services uri uri uri Get sources Goal: Analyze images on a website
21. Cognitive Services Demo App • Computer Vision API • Analyze image • Describe image • OCR (optical character recognition) • Domain model detection: Landmarks • Emotion API • Emotion analysis Improving your vision with Azure Cognitive Services - MixUG 21 https://github.com/marcduiker/demos-azure-cognitive-services
22. Improving your vision with Azure Cognitive Services - MixUG 22 Custom Vision API (preview)
23. Custom Vision API • Image classification Improving your vision with Azure Cognitive Services - MixUG 23 Cognitive Services Custom Vision API Train #A #B ? #A
24. Custom Vision Demo Improving your vision with Azure Cognitive Services - MixUG 24 Ferrari 250 GT SWB Aston Martin DB4
25. To sum it up • Ever growing collection of ‘intelligent’ APIs • Easy to get started • Choose carefully which API best suits your need • Think about confidence levels • When dealing with faces or handwriting: Personally identifiable information (PII) -> Privacy Improving your vision with Azure Cognitive Services - MixUG 25
26. Improving your vision with Azure Cognitive Services - MixUG 26 Thanks! See you next time!
27. Marc Duiker mduiker@xpirit.com @marcduiker Xpirit Laapersveld 27 Hilversum www.xpirit.com
28. Cognitive Services Related Resources • https://azure.microsoft.com/en-us/services/cognitive-services/ • https://docs.microsoft.com/en-us/azure/cognitive-services/ • https://channel9.msdn.com/Search?term=Cognitive%20Services • https://www.microsoft.com/en-us/seeing-ai/ • https://www.microsoft.com/en-us/research/research-area/computer-vision/ • https://www.customvision.ai/ • https://github.com/marcduiker/demos-azure-cognitive-services Improving your vision with Azure Cognitive Services - MixUG 28