Slide 1
Slide 1 text
Improving your vision with Azure Cognitive Services - MixUG 1
Improving your vision with Azure Cognitive Services
13 September - MixUG
Slide 2
Slide 2 text
About me:
Marc Duiker
[email protected]
@marcduiker
www.xpirit.com
blog.marcduiker.nl
‘13-’16
Slide 3
Slide 3 text
ML & AI is hot!
Improving your vision with Azure Cognitive Services - MixUG 3
Slide 4
Slide 4 text
Cortana Intelligence Suite
Improving your vision with Azure Cognitive Services - MixUG 4
Slide 5
Slide 5 text
Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
Slide 6
Slide 6 text
How did we end up here?
Improving your vision with Azure Cognitive Services - MixUG 6
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft Cognitive Toolkit
(CNTK)
Microsoft Technology & Research
2015
2009 2016
Slide 7
Slide 7 text
Improving your vision with Azure Cognitive Services - MixUG 7
Slide 8
Slide 8 text
Improving your vision with Azure Cognitive Services - MixUG 8
Slide 9
Slide 9 text
Improving your vision with Azure Cognitive Services - MixUG 9
Slide 10
Slide 10 text
Improving your vision with Azure Cognitive Services - MixUG 10
Slide 11
Slide 11 text
Improving your vision with Azure Cognitive Services - MixUG 11
Slide 12
Slide 12 text
Improving your vision with Azure Cognitive Services - MixUG 12
Slide 13
Slide 13 text
Improving your vision with Azure Cognitive Services - MixUG 13
Slide 14
Slide 14 text
Improving your vision with Azure Cognitive Services - MixUG 14
Slide 15
Slide 15 text
Microsoft Cognitive Services Docs
https://docs.microsoft.com/en-us/azure/cognitive-services/index
Improving your vision with Azure Cognitive Services - MixUG 15
Slide 16
Slide 16 text
Improving your vision with Azure Cognitive Services - MixUG 16
Computer Vision API
Slide 17
Slide 17 text
Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - MixUG 17
Tags
Descriptions
Faces
Colors
Domain models
Cognitive Services
Computer Vision API
Slide 18
Slide 18 text
Computer Vision API
• Examples
• https://azure.microsoft.com/en-us/services/cognitive-services/computer-
vision/
• API Reference
• https://westus.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf2
3d8ec6739/operations/56f91f2e778daf14a499e1fa
Improving your vision with Azure Cognitive Services - MixUG 18
Slide 19
Slide 19 text
Improving your vision with Azure Cognitive Services - MixUG 19
Slide 20
Slide 20 text
Cognitive Services Demo App
Improving your vision with Azure Cognitive Services - MixUG 20
http://...
![]()
![]()
![]()
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website
Slide 21
Slide 21 text
Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - MixUG 21
https://github.com/marcduiker/demos-azure-cognitive-services
Slide 22
Slide 22 text
Improving your vision with Azure Cognitive Services - MixUG 22
Custom Vision API (preview)
Slide 23
Slide 23 text
Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - MixUG 23
Cognitive Services
Custom Vision API
Train
#A #B
? #A
Slide 24
Slide 24 text
Custom Vision Demo
Improving your vision with Azure Cognitive Services - MixUG 24
Ferrari 250 GT SWB Aston Martin DB4
Slide 25
Slide 25 text
To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - MixUG 25
Slide 26
Slide 26 text
Improving your vision with Azure Cognitive Services - MixUG 26
Thanks! See you next time!
Slide 27
Slide 27 text
Marc Duiker
[email protected]
@marcduiker
Xpirit
Laapersveld 27
Hilversum
www.xpirit.com
Slide 28
Slide 28 text
Cognitive Services Related Resources
• https://azure.microsoft.com/en-us/services/cognitive-services/
• https://docs.microsoft.com/en-us/azure/cognitive-services/
• https://channel9.msdn.com/Search?term=Cognitive%20Services
• https://www.microsoft.com/en-us/seeing-ai/
• https://www.microsoft.com/en-us/research/research-area/computer-vision/
• https://www.customvision.ai/
• https://github.com/marcduiker/demos-azure-cognitive-services
Improving your vision with Azure Cognitive Services - MixUG 28