Enterprise AI for platform engineers - Building a Foundation For Enterprise AI Innovation — A VMware Tanzu Platform Story [TANB1464BCN]

You've been told there are great expectations for artificial intelligence (AI) improving how your organization functions. And you need to do something about it. But what exactly are the enterprise AI use cases? Few know, or even have proof that it works. Now is the time to start building AI-driven apps to experiment and learn. What do you need in your infrastructure and platforms to kick-start this AI enterprise progress? How do you create sandboxes where developers can safely start building AI apps? This talk tells you exactly that, based on the experiences of large organizations, like Mercedes-Benz and others.

Presented at VMware Explore EU 2024 as "Building a Foundation For Enterprise AI Innovation — A VMware Tanzu Platform Story [TANB1464BCN]."

Transcript

1. 1 Benjamin Miano, Adib Saikal, Coté #vmwareexplore #TANB1464BCN Building A Foundation For Enterprise AI Innovation A VMware Tanzu Platform Story TANB1464BCN Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
2. 2 Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. 1 Disclaimer • Certain information in this presentation may outline Broadcom's general product direction. • This presentation shall not serve to (i) affect the rights and/or obligations of Broadcom or its licensees under any existing or future license agreement or services agreement relating to any Broadcom software product; or (ii) amend any product documentation or specifications for any Broadcom software product. • This presentation is based on current information and resource allocations and is subject to change or withdrawal by Broadcom at any time without notice. • The development, release and timing of any features or functionality described in this presentation remain at Broadcom's sole discretion. • Notwithstanding anything in this presentation to the contrary, upon the general availability of any future Broadcom product release referenced in this presentation, Broadcom may make such release available to new licensees in the form of a regularly scheduled major product release. • Such release may be made available to licensees of the product who are active subscribers to Broadcom maintenance and support, on a when and if-available basis. • The information in this presentation is not deemed to be incorporated into any contract.
3. Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. 3 Benjamin Miano Product Owner DyP PaaS Mercedes-Benz Adib Saikali Distinguished Engineer Broadcom Coté Senior Member of Technical Staff Broadcom
4. Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. 4 Growing trends for AI use cases Organizations would benefit from additional platform capabilities Artificial intelligence incorporated into our platform to help developers deliver faster Enabling developers to safely add AI capabilities in their applications 50% 47% Source: VMware. "State of Cloud Native App Platforms 2024." June 2024.
5. Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. 5 AI Roles & Responsibilities • AI Subject Matter Experts curate models • Platform Engineering configures and publish the models through Tanzu Platform • Devs consume AI models with familiar frameworks through OpenAI REST API Optional Dependencies Tanzu Platform OpenAI API GenAI Apps Externally Managed Models VMware Private AI Foundation OpenAI AWS Bedrock GCP Vertex others… Azure OpenAI Required Dependencies Postgres (Tanzu / BYO) AI server Token Rate Limit Starter Chat History Starter More starters… Spring AI Management / Control plane Model Curation Service Broker Admin PII Service Other platform managed tooling
6. Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. 6 Benjamin Miano Product Owner DyP PaaS Mercedes-Benz Adib Saikali Distinguished Engineer Broadcom Coté Senior Member of Technical Staff Broadcom Discussion
7. 7 Please take your survey. TANB1464BCN “Building A Foundation For Enterprise AI Innovation” Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
8. 8 Thank You Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. Slides & stuff