Building and Deploying Agentic Workflows with Haystack

Bilge Yucel Hello 👋 • DevRel Engineer at deepset • Open source LLM orchestration framework Haystack • Istanbul, Turkey bilgeyucel in/bilge-yucel @bilgeyucl

Agenda • Introduction to Haystack • Building an Agent • Deploying an Agent • Q&A

AI Agents Overview of a LLM-powered autonomous agent system Source: https://lilianweng.github.io/posts/20230623-agent/

• Open-source LLM orchestration framework by deepset • Provides the tools that Python developers need to build real world, agentic AI systems • Building blocks: Components & Pipelines

Directed (cyclic) Graphs → Flexible, modular, customizable

Custom Components

Building an Agent with Haystack

“Agent involves a lot more work than expected and 90% of it is pure engineering. Nothing really to do with LLM, but it is how to blend LLM into an agentic workflow that makes senseˮ - a community member

Github Issue Resolver Agent ● Takes a Github issue URL ● Comments on the issue with instructions on how to solve it ● Navigates through the repo and understand code

Github Issue Resolver Agent

Deploying an Agent with Haystack

Hayhooks • Tool to deploy and serve Haystack pipelines as REST APIs • Wrap Pipelines with custom logic and expose them via HTTP endpoints • OpenAI-compatible chat completion endpoints→ Open WebUI

Development Environment for Haystack ● Drag, drop, and construct Haystack pipelines ● Ready-made pipelines ● Bring your own files or connect to your database ● Deploy on Studio or export pipelines ● Test, debug, and share your prototype ● Free and open to everyone deepset Studio

Build a Pipeline Deploy to Development Environment

Build a Pipeline Playground

Build a Pipeline Export Pipeline

Thank You! Any Questions? bilgeyucel in/bilge-yucel @bilgeyucl github.com/deepset-ai/github-agent haystack.deepset.ai