Quarkus Insights #187 : Camel with AI

An overview of AI capabilities in Apache Camel (nov 2024 edition)

Transcript

1. Camel with AI @Quarkus Insights
2. Agenda • Intro • Data Ingestion • Demos ◦ RAG ◦ Tools • What else? • Closing comments • Q&A
3. What is Apache Camel? … that your system is not alone! My System
4. Data Ingestion
5. Example RAG Architecture
6. Example RAG Architecture With Camel
7. Data Ingestion • Vector DB components • Embeddings • Chunking DSL
8. Chunking DSL Example from("source-route") .tokenize(tokenizer() .byParagraph() .maxTokens(1024) .maxOverlap(10) .using(LangChain4jTokenizerDefinition.TokenizerType.OPEN_AI).end()) .split().body() .to("destination-route");
9. Demos
10. Demos • Vector databases with Apache Camel ◦ Overview • RAG with Apache Camel • Function calling with Apache Camel
11. Other things • DJL (Deep Java Library) ◦ Computer vision • Torchserve ◦ Invoke the REST API • Unstructured data extraction ◦ Avoiding model lock in
12. Closing comments Scan me!