Spring AI: Where Java Becomes Your GenAI Huckleberry

This talk and guided tour through design and architecture of a showcase application leveraging Spring AI was delivered to a small audience at the Broadcom offices in Bellevue, WA during the December 12, 2024 Seattle Java User Group monthly meetup.

The showcase app repository links are available on Github, here:

* https://github.com/cf-toolsuite/sanford
* https://github.com/cf-toolsuite/sanford-ui

Transcript

1. Spring AI Where Java Becomes Your GenAI Huckleberry Chris Phillipson Copyright 2024
2. No doubt you’ve heard about GenAI And it’s all geared for the Python crowd, right? Not quite. Chris Phillipson Copyright 2024 How to even make sense of the options? New additions almost daily. Source: https://matturck.com
3. 2024 Trends What VCs have reported Chris Phillipson Copyright 2024 • 4.6B spent on GenAI, up 8x from 2023 • Dominant use case is code generation • ~⅓ of buyers looking for easily quantifiable value as primary driver for spend • Healthcare leading charge in spend (est. 500B) • OpenAI losing market share Source: Menlo Ventures
4. How does anyone get started? Chris Phillipson Copyright 2024 • Use a general purpose foundation model • Experiment; no need to build • No need to invest in or provision compute • Typically a subscription Usefulness boundaries How do you enhance a model’s awareness? How do you constrain the context? You might consider building. Or choose to integrate with a commercial offering.
5. So you want to build? Got Spring? You’re at a SeaJUG meetup. Of course we’re going to talk about a Java framework. Chris Phillipson Copyright 2024 Abstractions and implementation you’d expect. Just a great set of “building blocks” with observability “baked in”.
6. What I’m really here to talk about Showcase apps I’m iterating on for an aerospace client Chris Phillipson Copyright 2024 Use cases • Knowledge base accumulation and aggregation • Document search and summarization • Chatbots • Platform hygiene • Portfolio insights, rationalization and refactoring Challenges • Air-gapped delivery • Operations governance and compliance • Cost concerns • GPU allocation • Skill building
7. We’re going to go on a guided tour Ask me anything Chris Phillipson Copyright 2024