Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)

Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

1956 Artificial Intelligence 1997 Machine Learning 2017 Deep Learning 2021 Generative AI

Slide 3

Slide 3 text

GPT-3: We’re at the very beginning of a new app ecosystem | VentureBeat How the tech behind ChatGPT could change the world—an updated episode from our archive | The Economist OpenAI’s ChatGPT is a fascinating glimpse into the scary power of AI - Vox dall-e | TechCrunch A.I. Can Now Write Its Own Computer Code. That’s Good News for Humans. - The New York Times (nytimes.com) Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate A.I. - The New York Times (nytimes.com)

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

https://blogs.microsoft.com/blog/2023/01/23/ microsoftandopenaiextendpartnership/ https://news.microsoft.com/ja-jp/2023/01/25/ 230125-microsoftandopenaiextendpartnership/

Slide 6

Slide 6 text

Ensure that artificial general intelligence (AGI) benefits humanity. Empower every person and organization on the planet to achieve more GPT-3 Generate and Understand Text Codex Generate and Understand Code DALL·E Generate images from text prompts

Slide 7

Slide 7 text

Generative AI Prompt: Write a tagline for an ice cream shop. Response: We serve up smiles with every scoop! Prompt: Table customers, columns = [CustomerId, FirstName, LastName, Company, Address, City, State, Country, PostalCode] Create a SQL query for all customers in Texas named Jane query = Response: SELECT * FROM customers WHERE State = 'TX' AND FirstName = 'Jane' Prompt: A white Siamese cat Response: GPT-3 Codex DALL·E

Slide 8

Slide 8 text

The new Bing

Slide 9

Slide 9 text

https://blogs.microsoft.com/blog/2023/02/07/ reinventing-search-with-a-new-ai-powered-microsoft- bing-and-edge-your-copilot-for-the-web/ https://news.microsoft.com/ja-jp/2023/02/08/ 230208-reinventing-search-with-a-new-ai-powered- microsoft-bing-and-edge-your-copilot-for-the-web/

Slide 10

Slide 10 text

https://blogs.microsoft.com/blog/2023/02/22/ the-new-bing-preview-experience-arrives-on-bing-and- edge-mobile-apps-introducing-bing-now-in-skype/ https://news.microsoft.com/ja-jp/2023/02/24/ 230224-the-new-bing-preview-experience-arrives-on-bing- and-edge-mobile-apps-introducing-bing-now-in-skype/

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

Search 20 years ago Search today

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Powerful & Exciting Generative AI Reliable and Well-Known Search Search + AI = The Answer Engine ChatGPT Bing

Slide 15

Slide 15 text

AI-powered copilot for the web Joy of discovery

Slide 16

Slide 16 text

AI-powered copilot for the web A better Search It’s search you are familiar with that’s safe, more reliable, and delivers results like you expect. Web navigations Weather queries Answers for You It reviews results from across the web to find and summarize the answer you're looking for. Comprehensive summary Comparative insights A new chat experience Use chat to ask questions and get suggestions. It helps refine complicated research to get better recommendations. Travel planning Shopping research Sparks your Creativity You’re no longer limited by searching for what already exists. It helps you create new content with just a description. Draft an email Create a meal plan Responsible & Safe Gives value back Built as a platform Scenarios Foundational Bing

Slide 17

Slide 17 text

https://blogs.bing.com/

Slide 18

Slide 18 text

https://www.bing.com/new

Slide 19

Slide 19 text

ML Platform Customizable AI Models Cognitive Services Scenario-Based Services Applied AI Services Application Platform AI Builder Applications Azure AI Partner Solutions Power BI Power Apps Power Automate Power Virtual Agents Azure Machine Learning Vision Speech Language Decision OpenAI Service Immersive Reader Form Recognizer Bot Service Video Indexer Metrics Advisor Cognitive Search Developers & Data Scientists Business Users

Slide 20

Slide 20 text

Azure OpenAI Service GPT-3 Codex DALL·E (preview)

Slide 21

Slide 21 text

https://azure.microsoft.com/en-us/blog/general-availability-of- azure-openai-service-expands-access-to-large-advanced-ai- models-with-added-enterprise-benefits/ https://azure.microsoft.com/ja-jp/blog/general-availability-of- azure-openai-service-expands-access-to-large-advanced-ai- models-with-added-enterprise-benefits/

Slide 22

Slide 22 text

Inferencing time Capability Ada • Simple classification • Parsing and formatting text Curie • Answering questions • Complex, nuanced classification Davinci • Summarizing for specific audience • Generating creative content Babbage • Semantic search ranking • Moderately complex classification Azure OpenAI Service models Cushman-codex Davinci-codex Capability Codex GPT-3

Slide 23

Slide 23 text

Comments from code Code refactoring Creative Ideation Image Generation Virtual Assistants Subject Research Essay outlines Poem creation Azure OpenAI | Capabilities Language Translation Summarizing text Extracting insights Classifying text Answering questions Dialog agents Semantic search Writing assistance Code generation

Slide 24

Slide 24 text

Azure OpenAI | Top 4 Capabilities & Use Cases Call Center Analytics: Summary of customer support conversation logs Convert Natural Language to SQL (or vice versa) for telemetry data Subject Matter Expert Document Summarization (e.g. financial reporting, analyst articles) Convert Natural Language to Query Proprietary Data Models Code Documentation Search reviews for a specific product / service Social Media Trends Summarization Information Discovery and Knowledge Mining End to End Call Center Analytics: Classification, Sentiment, Entity Extraction, Summarization and Email Generation Customer 360: Hyper-personalisation using timely Summarization of customer queries & trends, Search, and Content Generation Call Center Analytics: Automatically generate responses to customer inquiries Generate personalised UI for your website Business Process Automation: Search through structured & unstructured documentation, Generate Code to query data models, Content Generation

Slide 25

Slide 25 text

Produced 11 years' worth of car summaries in a matter of Months

Slide 26

Slide 26 text

Power BI Web Application Cosmos DB PDF OCR pipeline Azure Cognitive Search Azure OpenAI Service Azure Form Recognizer Documents Document Process Automation Extract rich insights from documents and summarizing them

Slide 27

Slide 27 text

Contact Center Analytics using Speech API & OpenAI Extract rich insights from call transcripts Call-Center Agent Person-to-Person Conversation Caller Telephony Server Azure Storage Azure Cognitive Services – Speech & OpenAI Intelligent Transcription Speech-to-Text Azure OpenAI Service Conversation Trends & Insights PowerBI Insights (near real-time) Audio Files Detailed call history incl. summaries, call reasons, etc. CRM

Slide 28

Slide 28 text

Generative pre-trained transformer 3 (GPT-3) Azure OpenAI | Overview of GPT-3

Slide 29

Slide 29 text

Powerful language models accessible to all skill levels Simple UX—validate proof of concepts fast Built in ML science intuition for everyone, with deeper controls for ML practitioners General purpose text-in/text-out interface—flexibility Azure OpenAI | GPT-3 Models

Slide 30

Slide 30 text

Prompt – Text input that provides some context to the engine on what is expecting. Completion – Output that GPT-3 generates based on the prompt. some context Azure OpenAI | GPT-3 Prompt Design

Slide 31

Slide 31 text

Azure OpenAI Instruction Output Customer conversation Azure OpenAI | Sample Use Cases

Slide 32

Slide 32 text

Customer conversation in English (or other language) Azure OpenAI Instruction in English Output as JSON Azure OpenAI | Sample Use Cases

Slide 33

Slide 33 text

Input - German Azure OpenAI Instruction - English Output - English Azure OpenAI | Sample Use Cases

Slide 34

Slide 34 text

Azure OpenAI | GPT-3 Ideate, Experiment and Fine-Tune

Slide 35

Slide 35 text

Azure OpenAI | Considerations Vision Speech Language Decision OpenAI Service I need a general-purpose model that can handle multiple tasks. e.g. translation+entity recognition+sentiment analysis I need to generate human-like content, whilst preserving data privacy and security e.g., abstractive summarization, content writing, paraphrasing, code I could use a model with little or no training I need rapid prototyping and quick time to market for many use cases I want to explore solutions / use cases that have been described previously Azure AI Cognitive Services

Slide 36

Slide 36 text

Azure OpenAI | Benefits Enhanced customer experience with a greater focus on customer-centric services and products, whilst utilizing feedback and trends better Increased efficiency and productivity by getting more done in lesser time through rapid prototyping and quicker time to market* Faster time to realize value Easy to use: Even junior data scientists or business users can use Azure OpenAI Service Playground Ensure data privacy & security, and implement it in a responsible manner using a Trusted Cloud Provider Does not require a long tedious annotation process* Less training data is required for many relevant use cases* * in most relevant use cases observed Ability to perform text analytics and generation tasks that up until now were reserved only to humans

Slide 37

Slide 37 text

Accelerates software development Makes APIs more accessible Widens who can code OpenAI Codex

Slide 38

Slide 38 text

OpenAI Codex Models Derived from base models and trained on both NL and code (billions of Lines of Code) Support multiple programming languages Multiple tasks: Use Cases

Slide 39

Slide 39 text

Codex Models

Slide 40

Slide 40 text

GitHub Copilot Your AI pair programmer

Slide 41

Slide 41 text

Provide editor context Provide suggestions Improve suggestions

Slide 42

Slide 42 text

Power BI Generating DAX expressions with natural language

Slide 43

Slide 43 text

Power Platform Power Fx formulas

Slide 44

Slide 44 text

Accelerate designs or inspire creative decision Generate an infinite number of images with simple text prompts Build capability into enterprise applications through APIs and SDKs DALL•E 2 Preview