Adding AI to App

Adding AI to App - Xamarin & Azure Cognitive Services

In this session, we will discuss the following
- Introduction and explore various Azure Cognitive Services
- How to integrate cognitive services into a Xamarin.Forms app
- How to train ML models in Azure Cognitive Services
- Demo on Computer Vision, Face, Emotion, Language and Bing Search API

Github Repo; https://github.com/ksivamuthu/XamAI

Transcript

1. Adding AI to App Xamarin and Azure Cognitive Services
2. HELLO! I am Siva - Working as Mobile Architect in Computer Enterprises Inc, - I am here to connect with you all. - You can find me at @ksivamuthu
3. Agenda Overview to Azure Cognitive Services How to implement Cognitive Services in Xamarin apps Demo Resources
4. Azure Cognitive Services
5. Azure Cognitive Services Vision From faces to feelings, it allows app to understand images and video Speech Hear and speak by identifying speakers and understanding intent Language Process text and learn how to recognize what users want Knowledge Tap into rich knowledge from the web, academia and on your own data Search Access billions of pages, digital assets & news with power of Bing API
6. Vision Complex image detection with simple API request
7. Object classification Landmark Recognition Face Recognition OCR Explicit Content Video Indexer
8. “ Computer Vision Access to advanced algorithms for processing images and returning information
10. Labeled Training Data
11. Cat 92% Dog 8% Deep learning layers
12. Image Caption
13. “ Demo Identify and describe the image
14. Face Recognition
15. “ Demo Search GIFS using your face emotion
16. Emotion Gif Search Take a picture of your face Get a random GIF of your emotion
17. “ Custom Vision
18. Custom Vision
19. “ Buckled up or Not Predict whether driver is buckled up or not, using custom vision api
20. Buckled up Not Buckled up
21. Buckled or Not Buckled
22. Speech Convert spoken audio into text, use voice for verification, or add speaker recognition to your app.
23. Speech Convert spoken audio to text. You can use this API to build voice-triggered smart apps Converts text to audio in near real-time, improving accessibility and usability for users. Build apps and services that speak with user naturally Use your voice for verification. The API can be used to power applications with an intelligent verification tool. Enables developers to add end-to-end, real-time, speech translations to their applications or services. Speech to Text Text to Speech Speaker Recognition Speech Translation
24. Language Ensure apps and services can understand the meaning of unstructured text or recognize the intent behind a speaker’s utterances
25. Language Text Analytics Translator Text Content Moderator Language Understanding Named Entity Recognition | Keyphrase Extraction | Sentiment Analysis Bing Spell Check Web-scale, multilingual spell checking | Contextual spell checking Automatic language detection | Automated text translation | Customizable translation Contextual language understanding Explicit / offensive content moderation | Tools for including feedback from human moderators
26. Search Add Bing Search APIs to your apps and harness the ability to comb billions of webpages, images, videos, and news with a single API call.
27. Search Bing Web Search Bing Video Search Ad-free web search | Safe web search | Location aware web search Bing Custom Search Custom search engine creation | Ad-free custom search results Ad-free video search | Video topic and trend notification Bing Image Search Ad-free image search Bing Visual Search Bing News Search Knowledge acquisition from images | Identification of similar images Bing Entity Search Named entity recognition and classification | Knowledge acquisition for named entities Ad-free news search results | Trending topic identification Bing Autosuggest Search query autocomplete
28. Resources Demo - https://github.com/ksivamuthu/XamAI Azure Cognitive Services - https://azure.microsoft.com/en-us/services/cognitive-services/ Microsoft Docs https://docs.microsoft.com/en-us/xamarin/xamarin-forms/data-cloud/cognitive-services/
29. Thank you !!! If you’ve any questions, Stay on, we will talk or you can reach me out @ksivamuthu