Production-Ready Agentic AI Building Enterprise-Grade Java Systems with Jakarta EE and MicroProfile

Transcript

1. 2026/04/22 Kenji Kazumura © 2026 Fujitsu Limited OCX 2026 @kkzr Production-Ready Agentic AI Building Enterprise-Grade Java Systems with Jakarta EE and MicroProfile
2. © 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets AI Wrap Up 2
3. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Who Am I Member of Jakarta EE Specification Committee Member of JCP Executive Committee Board of Director of Eclipse Foundation Member of Adoptium Steering Committee 3
4. © 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets AI Wrap Up 4
5. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Classification of AI Predictive Generative Artificial Intelligence Machine Learning Deep Learning Predicts the future Ex: Weather forecast Most AI used in practice is this type Expectations are high, but... Emergence Ex: ChatGPT, Stable Diffusion 5
6. © 2026 Fujitsu Limited © 2026 Fujitsu Limited AI and OSS Mainstream AI development is not open source Some surrounding technologies are open source The Linux Foundation has compiled a Landscape, But it contains almost nothing related to Java AI software development is led by data scientists first As shown in the "AI & Data" summary, it's not targeted at application developers 6
7. © 2026 Fujitsu Limited © 2026 Fujitsu Limited LF AI & Data Landscape https://landscapeapp.cncf.io/lfai/ 7
8. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Java and AI The pace of AI technology evolution is fast Java's standardization and compatibility strategy, successful in the enterprise, does not align perfectly The success of AI-Infused Applications is key to leverage companies' Java assets and Java engineers. A balanced strategy of compatibility and innovation 8
9. © 2026 Fujitsu Limited © 2026 Fujitsu Limited A Balanced Compatibility and Innovation Strategy Provide a framework to support building AI systems Validate with real-world use cases and systems that support vector DBs and GPUs Provide Java specifications and implementations that enterprises can confidently use, thanks to standardization Step 1 Practical Integration Step 2 Prototype Verification Step 3 AI Standardization 9
10. © 2026 Fujitsu Limited © 2026 Fujitsu Limited AI-Infused Application Requires the same enterprise-grade quality as existing systems: A software program with artificial intelligence capabilities Implements intelligent functionality by leveraging AI models Security Observability Safe Remote Call Transaction Resiliency Stable Data Access ・・・ 10
11. © 2026 Fujitsu Limited © 2026 Fujitsu Limited AI-Infused Application Architecture Application Embedding Model Vector data Model Prompt Prompt Vector Vector Prompt + Similar data Similar data Response 11
12. © 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets AI Wrap Up 12
13. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta EE Meets AI Broadly speaking, AI-Infused App architecture is a distributed component system. This is precisely where Java, especially Jakarta EE, excels. Jakarta EE has a long track record of being used in enterprise systems where high reliability is required. Further, Jakarta EE standardizes specification in a vendor-neutral way, making it safe to use in enterprise systems. Jakarta EE is the best choice for building AI-Infused Application in enterprise systems 13
14. Java X AI Related Technology Landscape 2025 Edition Memory Access/GPU Control RAG Usage AI Framework Native Wrapper Training MCP / A2A / ACP Usage AI Cloud-Native Enablement AI Remote Access Vector API HAT Babylon Valhalla JCuda TensorFlow for Java FFM Deep Java Library Visual Recognition Jakarta Agentic AI MicroProfile REST Client LangChain4j Jakarta Messaging Quarkus AI Spring AI LangGraph4j Embabel Jakarta Transactions Jakarta Query Jakarta Data Jakarta Security Jakarta Restful Web Services Jakarta RPC MicroProfile Fault Tolerance MicroProfile Telemetry MicroProfile Config Jakarta Websocket Jakarta Config Agentic AI Tornado VM
15. © 2026 Fujitsu Limited © 2026 Fujitsu Limited LangChain4j A toolkit for building AI-Infused Java applications Provides integration with numerous LLMs/SMLs Provides building blocks for common patterns (RAG, function calling) Abstractions for prompts, messages, memory, tokens, etc. Integration of diverse vector stores and document data 15
16. © 2026 Fujitsu Limited © 2026 Fujitsu Limited LangChain4j-CDI Enables CDI-oriented programming for LangChain4j For creating AI-Infused Jakarta EE applications Merits: Declarative service creation Flexible configuration (MP Config) Observability (MP Telemetry) Reliability (MP Fault Tolerance) Portability 16
17. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta EE:Satisfying Enterprise-Grade Quality Jakarta Security MicroProfile JWT Authentication Jakarta Restful Web Services MicroProfile RestClient Jakarta Transactions Jakarta CDI MicroProfile Telemetry Authentication/Authorization Observability Safe Remote Call Transaction Resiliency MicroProfile Fault Tolerance Stable Data Access Jakarta Data Jakarta NoSQL 17 (in future?)
18. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Demo OAuth Transaction Observability JWT 18 https://github.com/fujitsu/app_blog/tree/master/agent-mcp-ocx2026
19. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Demo Structure Supervisor Agent Sub Agent Sub Agent request delegate delegate Tool MCP Server Tool 19 Sub Agent Tool
20. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Authentication / Authorization Supervisor Agent Sub Agent Sub Agent request delegate delegate MCP Server Resource Server JWT ID Provider OpenID Connect 20
21. © 2026 Fujitsu Limited © 2026 Fujitsu Limited OpenID Connect @OpenIdAuthenticationMechanismDefinition( providerURI = "https://sample-openid-provider/", clientId = "sample-client-id", clientSecret = "AAAAAAAA") @WebServlet(“/protectedServlet”) public class ProtectedServlet extends HttpServlet { Jakarta Security (@since 3.0 / Jakarta EE 10) 21
22. © 2026 Fujitsu Limited © 2026 Fujitsu Limited JSON Web Token @Inject private OpenIdContext context; ・・・ var token = context.getAccessToken().getToken(); var response = ClientBuilder.newClient() .target(URI) .request() .header("Authorization", "Bearer “ + token) .post(); MicroProfile JWT and Jakarta Security 22
23. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Transaction Supervisor Agent Sub Agent Sub Agent request delegate delegate transaction MCP Server SAGA pattern transaction commit / rollback commit / rollback 23 SAGA pattern
24. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta Transaction @Resource private UserTransaction utx; ・・・ @Transactional Public void doTransaction() { ・・・ utx.begin(); try { // do something utx.commit(); } catch (Exception e) { utx.rollback(); } 24
25. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Observability Supervisor Agent Sub Agent Sub Agent request delegate delegate Visualization Tool Open Telemetry MCP Server Tool 25
26. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Jakarta Agentic AI Defines common usage patterns and life cycles for AI agents running on Jakarta EE runtimes. The API will include a mechanism to define agent workflows. https://github.com/jakartaee/agentic-ai/blob/main/README.md#scope Defines integrations with other key Jakarta EE APIs such as Validation, REST, JSON Binding, Persistence, Data, Transactions, NoSQL, Concurrency, Security, Messaging, and so on. 26
27. © 2026 Fujitsu Limited Agenda Java and AI Jakarta Meets AI Wrap Up 27
28. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Wrap-up The key to Production-Ready AI-Infused Application is Enterprise-Grade Quality. Java and Jakarta EE are first citizens in this new era, building on their proven history in robust enterprise systems. While ensuring solid compatibility, Jakarta EE community actively embracing and advancing AI technologies for enterprise. 28
29. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Question ? Question? 29
30. © 2026 Fujitsu Limited © 2026 Fujitsu Limited Fujitsu Restricted Thank You