Share
Embed
Production-Ready Agentic AI Building Enterprise-Grade Java Systems with Jakarta EE and MicroProfile
Kenji Kazumura
April 26, 2026
Transcript
30 slides
-
2026/04/22 Kenji Kazumura © 2026 Fujitsu Limited OCX 2026 @kkzr
Production-Ready Agentic AI Building Enterprise-Grade Java Systems with Jakarta EE and MicroProfile -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Who Am
I Member of Jakarta EE Specification Committee Member of JCP Executive Committee Board of Director of Eclipse Foundation Member of Adoptium Steering Committee 3 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Classification of
AI Predictive Generative Artificial Intelligence Machine Learning Deep Learning Predicts the future Ex: Weather forecast Most AI used in practice is this type Expectations are high, but... Emergence Ex: ChatGPT, Stable Diffusion 5 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited AI and
OSS Mainstream AI development is not open source Some surrounding technologies are open source The Linux Foundation has compiled a Landscape, But it contains almost nothing related to Java AI software development is led by data scientists first As shown in the "AI & Data" summary, it's not targeted at application developers 6 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited LF AI
& Data Landscape https://landscapeapp.cncf.io/lfai/ 7 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Java and
AI The pace of AI technology evolution is fast Java's standardization and compatibility strategy, successful in the enterprise, does not align perfectly The success of AI-Infused Applications is key to leverage companies' Java assets and Java engineers. A balanced strategy of compatibility and innovation 8 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited A Balanced
Compatibility and Innovation Strategy Provide a framework to support building AI systems Validate with real-world use cases and systems that support vector DBs and GPUs Provide Java specifications and implementations that enterprises can confidently use, thanks to standardization Step 1 Practical Integration Step 2 Prototype Verification Step 3 AI Standardization 9 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited AI-Infused Application
Requires the same enterprise-grade quality as existing systems: A software program with artificial intelligence capabilities Implements intelligent functionality by leveraging AI models Security Observability Safe Remote Call Transaction Resiliency Stable Data Access ・・・ 10 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited AI-Infused Application
Architecture Application Embedding Model Vector data Model Prompt Prompt Vector Vector Prompt + Similar data Similar data Response 11 -
© 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets
AI Wrap Up 12 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta EE
Meets AI Broadly speaking, AI-Infused App architecture is a distributed component system. This is precisely where Java, especially Jakarta EE, excels. Jakarta EE has a long track record of being used in enterprise systems where high reliability is required. Further, Jakarta EE standardizes specification in a vendor-neutral way, making it safe to use in enterprise systems. Jakarta EE is the best choice for building AI-Infused Application in enterprise systems 13 -
Java X AI Related Technology Landscape 2025 Edition Memory Access/GPU
Control RAG Usage AI Framework Native Wrapper Training MCP / A2A / ACP Usage AI Cloud-Native Enablement AI Remote Access Vector API HAT Babylon Valhalla JCuda TensorFlow for Java FFM Deep Java Library Visual Recognition Jakarta Agentic AI MicroProfile REST Client LangChain4j Jakarta Messaging Quarkus AI Spring AI LangGraph4j Embabel Jakarta Transactions Jakarta Query Jakarta Data Jakarta Security Jakarta Restful Web Services Jakarta RPC MicroProfile Fault Tolerance MicroProfile Telemetry MicroProfile Config Jakarta Websocket Jakarta Config Agentic AI Tornado VM -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited LangChain4j A
toolkit for building AI-Infused Java applications Provides integration with numerous LLMs/SMLs Provides building blocks for common patterns (RAG, function calling) Abstractions for prompts, messages, memory, tokens, etc. Integration of diverse vector stores and document data 15 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited LangChain4j-CDI Enables
CDI-oriented programming for LangChain4j For creating AI-Infused Jakarta EE applications Merits: Declarative service creation Flexible configuration (MP Config) Observability (MP Telemetry) Reliability (MP Fault Tolerance) Portability 16 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta EE:Satisfying
Enterprise-Grade Quality Jakarta Security MicroProfile JWT Authentication Jakarta Restful Web Services MicroProfile RestClient Jakarta Transactions Jakarta CDI MicroProfile Telemetry Authentication/Authorization Observability Safe Remote Call Transaction Resiliency MicroProfile Fault Tolerance Stable Data Access Jakarta Data Jakarta NoSQL 17 (in future?) -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Demo OAuth
Transaction Observability JWT 18 https://github.com/fujitsu/app_blog/tree/master/agent-mcp-ocx2026 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Demo Structure
Supervisor Agent Sub Agent Sub Agent request delegate delegate Tool MCP Server Tool 19 Sub Agent Tool -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Authentication /
Authorization Supervisor Agent Sub Agent Sub Agent request delegate delegate MCP Server Resource Server JWT ID Provider OpenID Connect 20 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited OpenID Connect
@OpenIdAuthenticationMechanismDefinition( providerURI = "https://sample-openid-provider/", clientId = "sample-client-id", clientSecret = "AAAAAAAA") @WebServlet(“/protectedServlet”) public class ProtectedServlet extends HttpServlet { Jakarta Security (@since 3.0 / Jakarta EE 10) 21 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited JSON Web
Token @Inject private OpenIdContext context; ・・・ var token = context.getAccessToken().getToken(); var response = ClientBuilder.newClient() .target(URI) .request() .header("Authorization", "Bearer “ + token) .post(); MicroProfile JWT and Jakarta Security 22 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Transaction Supervisor
Agent Sub Agent Sub Agent request delegate delegate transaction MCP Server SAGA pattern transaction commit / rollback commit / rollback 23 SAGA pattern -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta Transaction
@Resource private UserTransaction utx; ・・・ @Transactional Public void doTransaction() { ・・・ utx.begin(); try { // do something utx.commit(); } catch (Exception e) { utx.rollback(); } 24 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Observability Supervisor
Agent Sub Agent Sub Agent request delegate delegate Visualization Tool Open Telemetry MCP Server Tool 25 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta Agentic
AI Defines common usage patterns and life cycles for AI agents running on Jakarta EE runtimes. The API will include a mechanism to define agent workflows. https://github.com/jakartaee/agentic-ai/blob/main/README.md#scope Defines integrations with other key Jakarta EE APIs such as Validation, REST, JSON Binding, Persistence, Data, Transactions, NoSQL, Concurrency, Security, Messaging, and so on. 26 -
© 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets
AI Wrap Up 27 -
© 2026 Fujitsu Limited © 2026 Fujitsu Limited Wrap-up The
key to Production-Ready AI-Infused Application is Enterprise-Grade Quality. Java and Jakarta EE are first citizens in this new era, building on their proven history in robust enterprise systems. While ensuring solid compatibility, Jakarta EE community actively embracing and advancing AI technologies for enterprise. 28