Adding AI to App

Adding AI to App

Adding AI to App - Xamarin & Azure Cognitive Services

In this session, we will discuss the following
- Introduction and explore various Azure Cognitive Services
- How to integrate cognitive services into a Xamarin.Forms app
- How to train ML models in Azure Cognitive Services
- Demo on Computer Vision, Face, Emotion, Language and Bing Search API

Github Repo; https://github.com/ksivamuthu/XamAI

F90901a95c7fbb99b541e8189838cf43?s=128

Sivamuthu Kumar

July 09, 2018
Tweet

Transcript

  1. Adding AI to App Xamarin and Azure Cognitive Services

  2. HELLO! I am Siva - Working as Mobile Architect in

    Computer Enterprises Inc, - I am here to connect with you all. - You can find me at @ksivamuthu
  3. Agenda Overview to Azure Cognitive Services How to implement Cognitive

    Services in Xamarin apps Demo Resources
  4. Azure Cognitive Services

  5. Azure Cognitive Services Vision From faces to feelings, it allows

    app to understand images and video Speech Hear and speak by identifying speakers and understanding intent Language Process text and learn how to recognize what users want Knowledge Tap into rich knowledge from the web, academia and on your own data Search Access billions of pages, digital assets & news with power of Bing API
  6. Vision Complex image detection with simple API request

  7. Object classification Landmark Recognition Face Recognition OCR Explicit Content Video

    Indexer
  8. “ Computer Vision Access to advanced algorithms for processing images

    and returning information
  9. None
  10. Labeled Training Data

  11. Cat 92% Dog 8% Deep learning layers

  12. Image Caption

  13. “ Demo Identify and describe the image

  14. Face Recognition

  15. “ Demo Search GIFS using your face emotion

  16. Emotion Gif Search Take a picture of your face Get

    a random GIF of your emotion
  17. “ Custom Vision

  18. Custom Vision

  19. “ Buckled up or Not Predict whether driver is buckled

    up or not, using custom vision api
  20. Buckled up Not Buckled up

  21. Buckled or Not Buckled

  22. Speech Convert spoken audio into text, use voice for verification,

    or add speaker recognition to your app.
  23. Speech Convert spoken audio to text. You can use this

    API to build voice-triggered smart apps Converts text to audio in near real-time, improving accessibility and usability for users. Build apps and services that speak with user naturally Use your voice for verification. The API can be used to power applications with an intelligent verification tool. Enables developers to add end-to-end, real-time, speech translations to their applications or services. Speech to Text Text to Speech Speaker Recognition Speech Translation
  24. Language Ensure apps and services can understand the meaning of

    unstructured text or recognize the intent behind a speaker’s utterances
  25. Language Text Analytics Translator Text Content Moderator Language Understanding Named

    Entity Recognition | Keyphrase Extraction | Sentiment Analysis Bing Spell Check Web-scale, multilingual spell checking | Contextual spell checking Automatic language detection | Automated text translation | Customizable translation Contextual language understanding Explicit / offensive content moderation | Tools for including feedback from human moderators
  26. Search Add Bing Search APIs to your apps and harness

    the ability to comb billions of webpages, images, videos, and news with a single API call.
  27. Search Bing Web Search Bing Video Search Ad-free web search

    | Safe web search | Location aware web search Bing Custom Search Custom search engine creation | Ad-free custom search results Ad-free video search | Video topic and trend notification Bing Image Search Ad-free image search Bing Visual Search Bing News Search Knowledge acquisition from images | Identification of similar images Bing Entity Search Named entity recognition and classification | Knowledge acquisition for named entities Ad-free news search results | Trending topic identification Bing Autosuggest Search query autocomplete
  28. Resources Demo - https://github.com/ksivamuthu/XamAI Azure Cognitive Services - https://azure.microsoft.com/en-us/services/cognitive-services/ Microsoft

    Docs https://docs.microsoft.com/en-us/xamarin/xamarin-forms/data-cloud/cognitive-services/
  29. Thank you !!! If you’ve any questions, Stay on, we

    will talk or you can reach me out @ksivamuthu