Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)

Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
https://www.slideshare.net/satonaoki/ml15min-microsoft-openai-recent-updates

Transcript

2. 1956 Artificial Intelligence 1997 Machine Learning 2017 Deep Learning 2021 Generative AI
3. GPT-3: We’re at the very beginning of a new app ecosystem | VentureBeat How the tech behind ChatGPT could change the world—an updated episode from our archive | The Economist OpenAI’s ChatGPT is a fascinating glimpse into the scary power of AI - Vox dall-e | TechCrunch A.I. Can Now Write Its Own Computer Code. That’s Good News for Humans. - The New York Times (nytimes.com) Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate A.I. - The New York Times (nytimes.com)
5. https://blogs.microsoft.com/blog/2023/01/23/ microsoftandopenaiextendpartnership/ https://news.microsoft.com/ja-jp/2023/01/25/ 230125-microsoftandopenaiextendpartnership/
6. Ensure that artificial general intelligence (AGI) benefits humanity. Empower every person and organization on the planet to achieve more GPT-3 Generate and Understand Text Codex Generate and Understand Code DALL·E Generate images from text prompts
7. Generative AI Prompt: Write a tagline for an ice cream shop. Response: We serve up smiles with every scoop! Prompt: Table customers, columns = [CustomerId, FirstName, LastName, Company, Address, City, State, Country, PostalCode] Create a SQL query for all customers in Texas named Jane query = Response: SELECT * FROM customers WHERE State = 'TX' AND FirstName = 'Jane' Prompt: A white Siamese cat Response: GPT-3 Codex DALL·E
8. The new Bing
9. https://blogs.microsoft.com/blog/2023/02/07/ reinventing-search-with-a-new-ai-powered-microsoft- bing-and-edge-your-copilot-for-the-web/ https://news.microsoft.com/ja-jp/2023/02/08/ 230208-reinventing-search-with-a-new-ai-powered- microsoft-bing-and-edge-your-copilot-for-the-web/
10. https://blogs.microsoft.com/blog/2023/02/22/ the-new-bing-preview-experience-arrives-on-bing-and- edge-mobile-apps-introducing-bing-now-in-skype/ https://news.microsoft.com/ja-jp/2023/02/24/ 230224-the-new-bing-preview-experience-arrives-on-bing- and-edge-mobile-apps-introducing-bing-now-in-skype/
12. Search 20 years ago Search today
13. Search
14. Powerful & Exciting Generative AI Reliable and Well-Known Search Search + AI = The Answer Engine ChatGPT Bing
15. AI-powered copilot for the web Joy of discovery
16. AI-powered copilot for the web A better Search It’s search you are familiar with that’s safe, more reliable, and delivers results like you expect. Web navigations Weather queries Answers for You It reviews results from across the web to find and summarize the answer you're looking for. Comprehensive summary Comparative insights A new chat experience Use chat to ask questions and get suggestions. It helps refine complicated research to get better recommendations. Travel planning Shopping research Sparks your Creativity You’re no longer limited by searching for what already exists. It helps you create new content with just a description. Draft an email Create a meal plan Responsible & Safe Gives value back Built as a platform Scenarios Foundational Bing
17. https://blogs.bing.com/
18. https://www.bing.com/new
19. ML Platform Customizable AI Models Cognitive Services Scenario-Based Services Applied AI Services Application Platform AI Builder Applications Azure AI Partner Solutions Power BI Power Apps Power Automate Power Virtual Agents Azure Machine Learning Vision Speech Language Decision OpenAI Service Immersive Reader Form Recognizer Bot Service Video Indexer Metrics Advisor Cognitive Search Developers & Data Scientists Business Users
20. Azure OpenAI Service GPT-3 Codex DALL·E (preview)
21. https://azure.microsoft.com/en-us/blog/general-availability-of- azure-openai-service-expands-access-to-large-advanced-ai- models-with-added-enterprise-benefits/ https://azure.microsoft.com/ja-jp/blog/general-availability-of- azure-openai-service-expands-access-to-large-advanced-ai- models-with-added-enterprise-benefits/
22. Inferencing time Capability Ada • Simple classification • Parsing and formatting text Curie • Answering questions • Complex, nuanced classification Davinci • Summarizing for specific audience • Generating creative content Babbage • Semantic search ranking • Moderately complex classification Azure OpenAI Service models Cushman-codex Davinci-codex Capability Codex GPT-3
23. Comments from code Code refactoring Creative Ideation Image Generation Virtual Assistants Subject Research Essay outlines Poem creation Azure OpenAI | Capabilities Language Translation Summarizing text Extracting insights Classifying text Answering questions Dialog agents Semantic search Writing assistance Code generation
24. Azure OpenAI | Top 4 Capabilities & Use Cases Call Center Analytics: Summary of customer support conversation logs Convert Natural Language to SQL (or vice versa) for telemetry data Subject Matter Expert Document Summarization (e.g. financial reporting, analyst articles) Convert Natural Language to Query Proprietary Data Models Code Documentation Search reviews for a specific product / service Social Media Trends Summarization Information Discovery and Knowledge Mining End to End Call Center Analytics: Classification, Sentiment, Entity Extraction, Summarization and Email Generation Customer 360: Hyper-personalisation using timely Summarization of customer queries & trends, Search, and Content Generation Call Center Analytics: Automatically generate responses to customer inquiries Generate personalised UI for your website Business Process Automation: Search through structured & unstructured documentation, Generate Code to query data models, Content Generation
25. Produced 11 years' worth of car summaries in a matter of Months
26. Power BI Web Application Cosmos DB PDF OCR pipeline Azure Cognitive Search Azure OpenAI Service Azure Form Recognizer Documents Document Process Automation Extract rich insights from documents and summarizing them
27. Contact Center Analytics using Speech API & OpenAI Extract rich insights from call transcripts Call-Center Agent Person-to-Person Conversation Caller Telephony Server Azure Storage Azure Cognitive Services – Speech & OpenAI Intelligent Transcription Speech-to-Text Azure OpenAI Service Conversation Trends & Insights PowerBI Insights (near real-time) Audio Files Detailed call history incl. summaries, call reasons, etc. CRM
28. Generative pre-trained transformer 3 (GPT-3) Azure OpenAI | Overview of GPT-3
29. Powerful language models accessible to all skill levels Simple UX—validate proof of concepts fast Built in ML science intuition for everyone, with deeper controls for ML practitioners General purpose text-in/text-out interface—flexibility Azure OpenAI | GPT-3 Models
30. Prompt – Text input that provides some context to the engine on what is expecting. Completion – Output that GPT-3 generates based on the prompt. some context Azure OpenAI | GPT-3 Prompt Design
31. Azure OpenAI Instruction Output Customer conversation Azure OpenAI | Sample Use Cases
32. Customer conversation in English (or other language) Azure OpenAI Instruction in English Output as JSON Azure OpenAI | Sample Use Cases
33. Input - German Azure OpenAI Instruction - English Output - English Azure OpenAI | Sample Use Cases
34. Azure OpenAI | GPT-3 Ideate, Experiment and Fine-Tune
35. Azure OpenAI | Considerations Vision Speech Language Decision OpenAI Service I need a general-purpose model that can handle multiple tasks. e.g. translation+entity recognition+sentiment analysis I need to generate human-like content, whilst preserving data privacy and security e.g., abstractive summarization, content writing, paraphrasing, code I could use a model with little or no training I need rapid prototyping and quick time to market for many use cases I want to explore solutions / use cases that have been described previously Azure AI Cognitive Services
36. Azure OpenAI | Benefits Enhanced customer experience with a greater focus on customer-centric services and products, whilst utilizing feedback and trends better Increased efficiency and productivity by getting more done in lesser time through rapid prototyping and quicker time to market* Faster time to realize value Easy to use: Even junior data scientists or business users can use Azure OpenAI Service Playground Ensure data privacy & security, and implement it in a responsible manner using a Trusted Cloud Provider Does not require a long tedious annotation process* Less training data is required for many relevant use cases* * in most relevant use cases observed Ability to perform text analytics and generation tasks that up until now were reserved only to humans
37. Accelerates software development Makes APIs more accessible Widens who can code OpenAI Codex
38. OpenAI Codex Models Derived from base models and trained on both NL and code (billions of Lines of Code) Support multiple programming languages Multiple tasks: Use Cases
39. Codex Models
40. GitHub Copilot Your AI pair programmer
41. Provide editor context Provide suggestions Improve suggestions
42. Power BI Generating DAX expressions with natural language
43. Power Platform Power Fx formulas
44. Accelerate designs or inspire creative decision Generate an infinite number of images with simple text prompts Build capability into enterprise applications through APIs and SDKs DALL•E 2 Preview
46. https://aka.ms/AzureAIDay2023