Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Overview of Microsoft AI Platform: from Cognitive Services to Azure ML

Overview of Microsoft AI Platform: from Cognitive Services to Azure ML

Dmitri Soshnikov

November 01, 2021
Tweet

More Decks by Dmitri Soshnikov

Other Decks in Technology

Transcript

  1. Dmitry Soshnikov

    View full-size slide

  2. Innovation
    • Open AI, GPT-3
    • Human Parity in Speech/Image/QnA
    Cloud for AI
    • Cognitive Services
    • Platform AI Services
    • Data Services
    Responsible AI
    • AI Ethics
    • Tools for Fairness and Interpretability

    View full-size slide

  3. arXiv:1610.05256 [cs.CL]
    arXiv:2009.13682v1 [cs.CV]
    DOI: 10.1109/ICCV.2015.123
    arXiv:1803.05567 [cs.CL]

    View full-size slide

  4. AI Business School
    https://aka.ms/ailearn/businessschool
    In partnership with

    View full-size slide

  5. Computer Vision
    Face API
    Text Analytics
    LUIS
    Custom Vision
    Lobe.ai
    Automatic ML
    Azure ML Designer

    View full-size slide

  6. AI / Machine Learning on Azure
    Domain specific pretrained models
    To reduce time to market
    Azure
    Databricks
    Machine
    Learning VMs
    Popular frameworks
    To build advanced deep learning solutions
    TensorFlow
    Pytorch Onnx
    Azure Machine
    Learning
    Language
    Speech

    Search
    Vision
    Productive services
    To empower data science and development teams
    Powerful infrastructure
    To accelerate deep learning
    Scikit-Learn
    PyCharm Jupyter
    Familiar Data Science tools
    To simplify model development
    Visual Studio Code Command line
    CPU GPU FPGA
    From the Intelligent Cloud to the Intelligent Edge

    View full-size slide

  7. Vision Face Custom Vision LUIS + Text QnA Maker Bot
    Framework

    View full-size slide

  8. a group of people sitting at a table a man in a suit and tie
    person, building, outdoor, man, cake,
    holding, carrying, standing, street, wearing,
    walking, young, food, woman, table, large,
    suit, city, people, riding
    table, indoor, person, sitting, child, food,
    group, eating, laptop, computer, woman,
    people, front, small, boy, young, little,
    cake, man, desk, baby, room, plate, white

    View full-size slide

  9. Knowledge Extraction from Text
    arXiv:2110.15453 [cs.CL]
    http://eazify.net/paper_analysis

    View full-size slide

  10. Utterance Intent
    Greeting
    Weather
    Question Answer
    Hi, how are you? - I am doing great
    - I am fine, thanks
    What are you feeling? - I am a bot, I do not
    have feelings
    Create Responsible Bot to Help Students Learn
    https://aka.ms/ailearn/responsiblebots

    View full-size slide

  11. https://aka.ms/ailearn/vision
    https://aka.ms/ailearn/explorenlp
    https://aka.ms/ailearn/explorebots
    https://aka.ms/ailearn/text
    https://aka.ms/ailearn/speech
    https://aka.ms/ailearn/images
    https://aka.ms/ailearn/language
    https://aka.ms/ailearn/search
    https://aka.ms/ailearn/bots

    View full-size slide

  12. https://aka.ms/ailearn/dsvm
    Vision Face Custom Vision LUIS + Text QnA Maker

    View full-size slide

  13. https://aka.ms/ailearn/dsvm
    Vision Face Custom Vision LUIS + Text QnA Maker

    View full-size slide

  14. https://aka.ms/ailearn/nocode
    https://aka.ms/ailearn/buildsolutions

    View full-size slide

  15. Train Model Split
    Score
    Evaluate

    View full-size slide

  16. http://aka.ms/azmlstudio

    View full-size slide

  17. Some yummy goodness
    Text Analytics

    View full-size slide

  18. Some yummy goodness

    View full-size slide

  19. AVG LIKES BY MAIN CATEGORY

    View full-size slide

  20. 2. Regression
    Run the Experiment and Train the Model

    View full-size slide

  21. Azure Machine Learning
    Workspace
    Dataset
    Datastore
    Compute
    Compute
    Cluster
    Experiments
    Notebooks
    Model Deployment
    Designer
    AutoML

    View full-size slide

  22. http://aka.ms/azml_gan
    http://aka.ms/creative_ai
    http://aka.ms/cognitive_portrait_exhibit
    http://aka.ms/deeppavlov

    View full-size slide

  23. FATE: Fairness, Accountability, Transparency, Ethical
    Fairness Accountability Transparency Ethical
    Is anyone treated differently?
    Is the training data
    representative/relevant?
    Are there systems in place to detect
    and address potential unfairness?
    Is there a mechanism to
    feedback/challenge results?
    Is there ultimately a human
    accountable?
    Is the AI behaviour verifiable (in the
    real world)?
    Is it clear an AI is being used?
    Is the AI clear, understandable and
    well-described?
    Are inadequacies/limitations clearly
    shared?
    Does it comply with privacy laws
    and contain appropriate use
    controls?
    What are the societal implications
    (think suffering, autonomy,
    equality)?
    Are there protections against
    unintended behaviour?
    Is there human monitoring?
    If lives are impacted, it’s important
    people understand how the
    decision was made

    View full-size slide

  24. https://aka.ms/ailearn/exploredata
    https://aka.ms/ailearn/relational
    https://aka.ms/ailearn/nosql
    https://aka.ms/ailearn/analytics
    https://aka.ms/ailearn/getstarted
    https://aka.ms/ailearn/nocode
    https://aka.ms/ailearn/vision
    https://aka.ms/ailearn/explorenlp
    https://aka.ms/ailearn/explorebots

    View full-size slide

  25. https://aka.ms/ailearn/createmodels
    https://aka.ms/ailearn/nocode
    https://aka.ms/ailearn/buildsolutions
    https://aka.ms/ailearn/text
    https://aka.ms/ailearn/speech
    https://aka.ms/ailearn/images
    https://aka.ms/ailearn/language
    https://aka.ms/ailearn/search
    https://aka.ms/ailearn/bots
    https://aka.ms/ailearn/dataeng
    https://aka.ms/ailearn/data
    https://aka.ms/ailearn/databricks
    https://aka.ms/ailearn/streaming
    https://aka.ms/ailearn/synapse

    View full-size slide

  26. Dmitry Soshnikov
    Overview of Microsoft AI Platform
    from Cognitive Services
    to Azure ML
    http://azure-for-academics.github.io

    View full-size slide