AI Agent Practical Intensive Course AI Agent Lightning Talks June 7, 2025 

How to build, deploy a RAG application using langgraph (on Cloud Run with Streamlit) Yuta Tokia 

Objective ・Learn concepts, related components, and tips for building, deploying a RAG application on VertexAI. 

Module agenda ● How combine your data with the LLMs ● Use case : Proposal system ● Tips1 : Metadata Filtering ● Tips2 : Store vector store in GCS ● Explore demo! 

How combine your data with the LLMs? RAG 1. R(Retrieval) : search for relevant data from vector databases 2. A(Augmented) : add it to the prompt context 3. G(Generation) : for use in Gen AI Add external data to the LLMs! Can answer questions about specific source information. 

Use Case : Proposal System AI Branch Head office Person in charge Departments ①Propose ideas for works ②Checking , Allocating ③Answer Use AI agent Staff 

Use Case : Proposal System AI Tasks 1. Is this one a duplicate? 2. Which department should handle it? Use Langgraph for orchestration! 

class GraphState(BaseModel): query : str = Field(..., description = "ユーザーからのクエリー") category : str = Field(..., description = "提案、要望のカテゴリー") generation: Optional[str] = None documents: List[str] = Field(default_factory=list) duplicate_NO: Optional[int] = None duplicate_documents: Optional[str] = None duplicate_reason: List[str] = Field(default_factory=list) responsible_departments: List[str] = Field(default_factory=list) responsible_reason: List[str] = Field(default_factory=list) referenced_No: Optional[int] = None Using Langgraph… Can build fully customizable agent workflows 

Tips1 Applying Metadata Filtering(Chroma) ・Chroma supports filtering queries by metadata. def _retrieve(self, state : GraphState) -> dict[str, Any]: documents = retriever.invoke(state.query, filter = {“カテゴリー ” : {“$eq” : state.category}} ) Return {“documents” : format_docs(documents)} 

Tips2 : Store vector store in GCS Keep the vector store up-to-date! Easy to operate! Container(CI/CD)? blob? or 

Let’s explore demo! 

Thank you so much!