Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)

Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)

Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
https://www.slideshare.net/satonaoki/ml15min-microsoft-openai-recent-updates

SATO Naoki (Neo)

February 25, 2023
Tweet

More Decks by SATO Naoki (Neo)

Other Decks in Technology

Transcript

  1. View Slide

  2. 1956
    Artificial Intelligence
    1997
    Machine Learning
    2017
    Deep Learning
    2021
    Generative AI

    View Slide

  3. GPT-3: We’re at the very beginning of a new app ecosystem |
    VentureBeat
    How the tech behind ChatGPT could change the world—an
    updated episode from our archive | The Economist
    OpenAI’s ChatGPT is a fascinating glimpse into the scary power of
    AI - Vox
    dall-e | TechCrunch
    A.I. Can Now Write Its Own Computer Code. That’s Good News for Humans. - The New York
    Times (nytimes.com)
    Microsoft Bets Big on the Creator of ChatGPT in Race to
    Dominate A.I. - The New York Times (nytimes.com)

    View Slide

  4. View Slide

  5. https://blogs.microsoft.com/blog/2023/01/23/
    microsoftandopenaiextendpartnership/
    https://news.microsoft.com/ja-jp/2023/01/25/
    230125-microsoftandopenaiextendpartnership/

    View Slide

  6. Ensure that artificial
    general intelligence (AGI)
    benefits humanity.
    Empower every person and
    organization on the planet
    to achieve more
    GPT-3
    Generate and Understand Text
    Codex
    Generate and Understand Code
    DALL·E
    Generate images from text prompts

    View Slide

  7. Generative AI
    Prompt:
    Write a tagline for an ice
    cream shop.
    Response:
    We serve up smiles with every
    scoop!
    Prompt:
    Table customers, columns =
    [CustomerId, FirstName,
    LastName, Company, Address,
    City, State, Country,
    PostalCode]
    Create a SQL query for all
    customers in Texas named Jane
    query =
    Response:
    SELECT *
    FROM customers
    WHERE State = 'TX' AND
    FirstName = 'Jane'
    Prompt: A white Siamese cat
    Response:
    GPT-3 Codex DALL·E

    View Slide

  8. The new Bing

    View Slide

  9. https://blogs.microsoft.com/blog/2023/02/07/
    reinventing-search-with-a-new-ai-powered-microsoft-
    bing-and-edge-your-copilot-for-the-web/
    https://news.microsoft.com/ja-jp/2023/02/08/
    230208-reinventing-search-with-a-new-ai-powered-
    microsoft-bing-and-edge-your-copilot-for-the-web/

    View Slide

  10. https://blogs.microsoft.com/blog/2023/02/22/
    the-new-bing-preview-experience-arrives-on-bing-and-
    edge-mobile-apps-introducing-bing-now-in-skype/
    https://news.microsoft.com/ja-jp/2023/02/24/
    230224-the-new-bing-preview-experience-arrives-on-bing-
    and-edge-mobile-apps-introducing-bing-now-in-skype/

    View Slide

  11. View Slide

  12. Search 20 years ago Search today

    View Slide

  13. Search

    View Slide

  14. Powerful & Exciting Generative AI
    Reliable and Well-Known Search
    Search + AI = The Answer Engine
    ChatGPT
    Bing

    View Slide

  15. AI-powered copilot for the web
    Joy of discovery

    View Slide

  16. AI-powered copilot for the web
    A better Search
    It’s search you are familiar
    with that’s safe, more
    reliable, and delivers
    results like you expect.
    Web navigations
    Weather queries
    Answers for You
    It reviews results from
    across the web to find and
    summarize the answer
    you're looking for.
    Comprehensive summary
    Comparative insights
    A new chat experience
    Use chat to ask questions
    and get suggestions.
    It helps refine complicated
    research to get better
    recommendations.
    Travel planning
    Shopping research
    Sparks your Creativity
    You’re no longer limited
    by searching for what
    already exists. It helps you
    create new content with
    just a description.
    Draft an email
    Create a meal plan
    Responsible & Safe Gives value back Built as a platform
    Scenarios
    Foundational
    Bing

    View Slide

  17. https://blogs.bing.com/

    View Slide

  18. https://www.bing.com/new

    View Slide

  19. ML Platform
    Customizable AI Models
    Cognitive Services
    Scenario-Based Services
    Applied AI Services
    Application Platform
    AI Builder
    Applications
    Azure AI
    Partner Solutions
    Power BI Power Apps Power Automate Power Virtual Agents
    Azure Machine Learning
    Vision Speech Language Decision OpenAI Service
    Immersive Reader
    Form Recognizer
    Bot Service Video Indexer Metrics Advisor
    Cognitive Search
    Developers &
    Data Scientists
    Business
    Users

    View Slide

  20. Azure OpenAI Service
    GPT-3 Codex
    DALL·E (preview)

    View Slide

  21. https://azure.microsoft.com/en-us/blog/general-availability-of-
    azure-openai-service-expands-access-to-large-advanced-ai-
    models-with-added-enterprise-benefits/
    https://azure.microsoft.com/ja-jp/blog/general-availability-of-
    azure-openai-service-expands-access-to-large-advanced-ai-
    models-with-added-enterprise-benefits/

    View Slide

  22. Inferencing time
    Capability
    Ada
    • Simple classification
    • Parsing and formatting text
    Curie
    • Answering questions
    • Complex, nuanced classification
    Davinci
    • Summarizing for
    specific audience
    • Generating creative content
    Babbage
    • Semantic search ranking
    • Moderately complex classification
    Azure OpenAI Service models
    Cushman-codex
    Davinci-codex
    Capability
    Codex
    GPT-3

    View Slide

  23. Comments from code
    Code refactoring
    Creative Ideation
    Image Generation
    Virtual Assistants
    Subject Research
    Essay outlines
    Poem creation
    Azure OpenAI | Capabilities
    Language Translation
    Summarizing text
    Extracting insights
    Classifying text Answering questions
    Dialog agents
    Semantic search
    Writing assistance
    Code generation

    View Slide

  24. Azure OpenAI | Top 4 Capabilities & Use Cases
    Call Center Analytics: Summary
    of customer support
    conversation logs
    Convert Natural Language to
    SQL (or vice versa) for telemetry
    data
    Subject Matter Expert Document
    Summarization (e.g. financial
    reporting, analyst articles)
    Convert Natural Language to
    Query Proprietary Data Models
    Code Documentation
    Search reviews for a specific
    product / service
    Social Media Trends
    Summarization
    Information Discovery and
    Knowledge Mining
    End to End Call Center Analytics: Classification, Sentiment, Entity Extraction, Summarization and Email Generation
    Customer 360: Hyper-personalisation using timely Summarization of customer queries & trends, Search, and Content Generation
    Call Center Analytics:
    Automatically generate
    responses to customer inquiries
    Generate personalised UI for
    your website
    Business Process Automation: Search through structured & unstructured documentation, Generate Code to query data models, Content Generation

    View Slide

  25. Produced 11 years'
    worth of car summaries in a
    matter of Months

    View Slide

  26. Power BI
    Web
    Application
    Cosmos DB
    PDF OCR
    pipeline
    Azure Cognitive
    Search
    Azure OpenAI
    Service
    Azure Form
    Recognizer
    Documents
    Document Process Automation
    Extract rich insights from documents and summarizing them

    View Slide

  27. Contact Center Analytics using Speech API & OpenAI
    Extract rich insights from call transcripts
    Call-Center Agent
    Person-to-Person
    Conversation
    Caller
    Telephony
    Server
    Azure
    Storage
    Azure Cognitive Services –
    Speech & OpenAI
    Intelligent
    Transcription
    Speech-to-Text Azure OpenAI
    Service
    Conversation Trends
    & Insights
    PowerBI Insights
    (near real-time)
    Audio
    Files
    Detailed call history incl.
    summaries, call reasons, etc.
    CRM

    View Slide

  28. Generative pre-trained transformer 3
    (GPT-3)
    Azure OpenAI | Overview of GPT-3

    View Slide

  29. Powerful language
    models accessible to
    all skill levels
    Simple UX—validate proof of concepts fast
    Built in ML science intuition for everyone, with
    deeper controls for ML practitioners
    General purpose text-in/text-out
    interface—flexibility
    Azure OpenAI | GPT-3 Models

    View Slide

  30. Prompt – Text input that
    provides some context to the
    engine on what is expecting.
    Completion – Output that
    GPT-3 generates based on
    the prompt.
    some context
    Azure OpenAI | GPT-3 Prompt Design

    View Slide

  31. Azure OpenAI Instruction
    Output
    Customer conversation
    Azure OpenAI | Sample Use Cases

    View Slide

  32. Customer conversation in
    English (or other language)
    Azure OpenAI
    Instruction in English
    Output as JSON
    Azure OpenAI | Sample Use Cases

    View Slide

  33. Input - German
    Azure OpenAI
    Instruction - English
    Output - English
    Azure OpenAI | Sample Use Cases

    View Slide

  34. Azure OpenAI | GPT-3 Ideate, Experiment and Fine-Tune

    View Slide

  35. Azure OpenAI | Considerations
    Vision Speech Language Decision
    OpenAI Service
    I need a general-purpose model that can handle multiple tasks.
    e.g. translation+entity recognition+sentiment analysis
    I need to generate human-like content, whilst preserving data privacy and security
    e.g., abstractive summarization, content writing, paraphrasing, code
    I could use a model with little or no training
    I need rapid prototyping and quick time to market for many use cases
    I want to explore solutions / use cases that have been described previously
    Azure AI Cognitive Services

    View Slide

  36. Azure OpenAI | Benefits
    Enhanced customer experience with a
    greater focus on customer-centric services
    and products, whilst utilizing feedback and
    trends better
    Increased efficiency and productivity by
    getting more done in lesser time through
    rapid prototyping and quicker time to
    market*
    Faster time to realize value
    Easy to use:
    Even junior data scientists or business users
    can use Azure OpenAI Service Playground
    Ensure data privacy & security, and
    implement it in a responsible manner using
    a Trusted Cloud Provider
    Does not require a long tedious annotation
    process*
    Less training data is required for many
    relevant use cases*
    * in most relevant use cases observed
    Ability to perform text analytics and
    generation tasks that up until now were
    reserved only to humans

    View Slide

  37. Accelerates software development
    Makes APIs more accessible
    Widens who can code
    OpenAI Codex

    View Slide

  38. OpenAI Codex Models
    Derived from base models and trained on both
    NL and code (billions of Lines of Code)
    Support multiple programming languages
    Multiple tasks:
    Use Cases

    View Slide

  39. Codex Models

    View Slide

  40. GitHub Copilot
    Your AI pair programmer

    View Slide

  41. Provide editor context
    Provide suggestions
    Improve suggestions

    View Slide

  42. Power BI
    Generating DAX
    expressions with
    natural language

    View Slide

  43. Power Platform
    Power Fx formulas

    View Slide

  44. Accelerate designs or inspire
    creative decision
    Generate an infinite number of
    images with simple text prompts
    Build capability into enterprise
    applications through APIs and SDKs
    DALL•E 2
    Preview

    View Slide

  45. View Slide

  46. https://aka.ms/AzureAIDay2023

    View Slide

  47. View Slide