reserved. Architecture for Gen AI Deploying Gen AI at scale raises requirements on architecture mgmt. & governance Gen AI for Architects Gen AI new capabilities that could impact architect's discipline Image created by midjourney, prompt: future tech version of mind-blowing chatbot, ultra-realistic, photo, --ar 3:4 Agenda for today
2 William El Kaim, PhD IT Architecture Director BCG Platinion, Paris Simon Ramos Visiting Associate BCG Platinion, Paris David Tran Lead IT Architect BCG Platinion, Paris
reserved. 10% 20% 70% Algorithms Generative AI models People & processes Technology / IT Data platforms, data quality, & availability Visualization tools While data and technology are important, the people and process changes are proven to be the most critical factors to succeed Source: BCG Midjourney | "iceberg under the ocean"
just about incorporating new technologies; it’s about fundamentally rethinking how architects design and manage their systems. This transformation requires a holistic approach, considering everything from technology, data, skills, and user experience. As we embrace this GenAI-driven era, enterprises that adapt their architectures to these new paradigms will be best positioned for success 3 Xcelerate
reserved. Three plays to win to get the full value out of (Gen) AI GenAI in every-day tools Accomplish 10-20% productivity increase by leveraging off-the-shelf GenAI tools and at-scale user training critical functions and processes Reach 50%+ productivity boost with fit-for-purpose tech/data platforms and extensive workforce planning New business models Generate new revenue streams with bespoke systems and multi-functional incubation teams Source: BCG
reserved. Minimize the time spent on low value tasks and increase presence and collaboration within business and IT Reduce time and effort needed to govern architecture and tech at enterprise level Improve quality of analysis using up-to-date IT landscape data Ensure best compliant architecture using guided design (copilot) and automated model generation The Augmented architect could benefit from Gen AI to… Accelerate the transfer of knowledge, training efforts & bridging of skill gaps Source: BCG Platinion
reserved. Source: Xcelerate Make it beautiful xxx xxx Increase Collaboration between IT and Business • Offering a unique one-stop shop for all enterprise architecture assets and their relationships (bus. Capabilities, and process and data and IT components) User Experience (UX) • More personalized, adaptive, and intuitive user experiences but also demands a careful balance to avoid overwhelming users with complex AI-driven interfaces From Static to Dynamic • From a static, one-size-fits-all model to a more dynamic, adaptable framework Data-Centric • Harness the power of AI for metadata and data processing and insights Continuous Learning • Facilitate onboarding and upskilling of architect and community collaboration and exchange 5 Key evolutions in Architectural Design with GenAI
reserved. Source: BCG Platinion EA Control Tower to provide a coherent, always up-to-date unified views of the business and IT current states and enable design of future evolutions using a scenario- based approach The EA control tower to: • Simplify information search and retrieval through a unified User Experience • Offer on-demand insights using plain English • Create architecture scenario and views on demand, compliant to company EA methodology • Leverage all existing multimodal information from existing business and IT landscape and communities • Benefit from live external sources using LLM or APIs EA control tower the new tool for architects
reserved. EA control tower empowers architects with 3 new capabilities • Ingest and leverage existing multimodal facts and knowledge (internally and externally) • Offers holistic views and insights on pre-learned or pre-defined Enterprise architecture concepts (syntax and semantic) • Enable multiple ways to interact • Gen AI understands EA frameworks and (meta)model (or can be trained for) and can generate (meta)models and views on demands • Fine-tuned LLM able to understand natively key architecture concepts could become the embedded core reasoning engine of future EA tool • Gen AI can analyze an architecture and make recommendations • Copilots could assist architects in their day-to-day tasks, either using automated agent-based background tasks (check all incidents of today, then update application description, and generate a report proposing architecture evolutions) or real- time in context support (like GitHub copilot) Connect the dots Offer Polyglotism Assist with copilot Source: BCG Platinion
reserved. To transform the way architects work… Community-Enhanced Solution to cultivate and harness collective wisdom, without language constraints, creating a robust platform for knowledge sharing and organizational learning Offer Polyglotism User-driven environment, that maximizes empowerment, and quick access to in-context relevant information and insights Connect the dots AI Copilot designed to simplify user interactions and to minimize friction, thereby facilitating the fullest expression of creativity and skill. Assist with Copilot Architecture governance Business & IT strategy alignment and roadmap Tech innovation, and standards Operational support & project expertise Tools & Methodology Animate & Train the architect community Connect the dots Assist with Copilot Offer Polyglotism Source: BCG Platinion
reserved. What are EA tool vendors offering so far? • Chat based Enterprise Architecture AI Assistant • See the full picture, find the right pace, execute with confidence • Created an AI Center of Excellence with dedicated resources • “Enterprise Augmented Intelligence" via smart assistant to automate tasks and guide architects in a new redesigned User Interface • Automate, Accelerate, Augment • Provide AI functionalities to ease and guide architect work • Study still being made, no official announcement yet • Azure OpenAI • Not disclosed • GPT-3.5-turbo • Azure Open AI • Azure Open AI and Amazon SageMaker for other LLMs • Internal AI model • Tests done with OpenAI Beta Program Functionalities will be added progressively Available in new version codenamed Aquila Functionalities will be added progressively GenAI implemented in Prolaborate available in Early Access Functionalities will be added progressively GenAI Technologies Status Approach Based on publicly available information subject to change
reserved. What are EA tool vendors offering so far? • Generate RFP criteria based on business capabilities • Generate REST API from data object • Diagram Importer for Tooling Interoperability (e.g., Lucidchart, Archi, or even hand-drawn whiteboard) • Smart Analysis user experience and the user interface have been fully redesigned to provide recommendations for application rationalization and cloud migration • Automated diagram generation through wizards and harnessing a new Intellibar for enhanced guidance throughout the modeling journey • Search results for natural language queries • Visualizations to present discovered data or answer complex business questions • Model Search: Find the specific model insights by searching architectural information using natural language queries. • Documentation Assistant: Generate documentation based on model context, metadata and publicly available information. Can be trained on various documentation formats and variations. • Summary Assistant: produce a clear and concise summary of any conversation thread • GenAI features not yet announced • AI Assistant will check application listings to find five best-of-breed apps that could replace each of these apps • Provides Architecture Recommendations and offer top 5 competitors if required • Show applications updating a particular data object • Research top 5 alternative technologies and link to them • AI Assistant: trained on product documentation and knowledge base • Relation Recommender for Archimate: Simplifies and accelerates modeling work for architects by automating the selection of relationship types when connecting components in architecture models • Smart Analysis: Get automatic recommendations on IT rationalization and cloud migration strategies. • Smart Mapping to connect capabilities to applications, technologies, and data. • Recommendations and supporting narratives for improved decision-making • Identification of trends, patterns, and outliers to inform future outcomes and opportunities • Leverage predictive modeling and analytics to forecast environmental impacts and proactively ESG challenges • Intelligent Chat Agent, named Genie • Understands natively Sparx metamodel (MDG) • Can be trained on existing multimodal documents (PDF, RTF, and Knowledge base), which will be used to answer queries with document-based information • The AI assistant helps survey respondents generate component descriptions automatically. • GenAI features not yet announced • AI Assistant can automatically populate the description field of each application based on Fact Sheet data • Check ISO 270001 or research major known security incidents for tech. providers • Date when vendor will stop supporting the software • Reference Architecture for Generative AI: To support and guide customers in adopting generative AI at scale in their enterprise • AI Bot: Enables natural language queries of the Bizzdesign repository • AI-driven APM with intelligent application detection and automatic capability mapping • Offers in-depth analysis of any list of software products, categorizing each of them as an application or technology • Automatic recommendations regarding the business capabilities supported by the identified applications • Maintenance and reporting tasks • Connections between data in different systems • Correlations between disparate data sets, helping architects understand how components and systems interact • interpret complex models and diagrams to provide all required responses • Architecture Content Generation and validation to ensure the information in your Architecture landscape is accurate • Smart Search: Analyze the context and meaning behind queries and use semantic search to provide a higher level of accuracy. • GenAI features not yet announced Assist with Copilot Connect the dots Offer Polyglotism Based on publicly available information subject to change
reserved. Create a GPT App with your own data Add your Enterprise Architecture playbook and landscape information Provide the context Select the key capabilities Share within your company only Give it a nickname
welkaim
hanhan1978
nenonaninu
mixplace
rmakiyama
ange
champ
tsukuha
shin1x1
fnifni
marsee101
hkoketsu
moneyforward
garrettdimon
eileencodes
jonrohan
addyosmani
kneath
stephaniewalter
akosma
jmmastey
keavy
tammyeverts
