Slide 1

Slide 1 text

Building and Deploying Agentic Workflows with Haystack

Slide 2

Slide 2 text

Bilge Yucel Hello 👋 • DevRel Engineer at deepset • Open source LLM orchestration framework Haystack • Istanbul, Turkey bilgeyucel in/bilge-yucel @bilgeyucl

Slide 3

Slide 3 text

Agenda • Introduction to Haystack • Building an Agent • Deploying an Agent • Q&A

Slide 4

Slide 4 text

AI Agents Overview of a LLM-powered autonomous agent system Source: https://lilianweng.github.io/posts/20230623-agent/

Slide 5

Slide 5 text

• Open-source LLM orchestration framework by deepset • Provides the tools that Python developers need to build real world, agentic AI systems • Building blocks: Components & Pipelines

Slide 6

Slide 6 text

Directed (cyclic) Graphs → Flexible, modular, customizable

Slide 7

Slide 7 text

Custom Components

Slide 8

Slide 8 text

Building an Agent with Haystack

Slide 9

Slide 9 text

“Agent involves a lot more work than expected and 90% of it is pure engineering. Nothing really to do with LLM, but it is how to blend LLM into an agentic workflow that makes senseˮ - a community member

Slide 10

Slide 10 text

Github Issue Resolver Agent ● Takes a Github issue URL ● Comments on the issue with instructions on how to solve it ● Navigates through the repo and understand code

Slide 11

Slide 11 text

Github Issue Resolver Agent

Slide 12

Slide 12 text

Deploying an Agent with Haystack

Slide 13

Slide 13 text

Hayhooks • Tool to deploy and serve Haystack pipelines as REST APIs • Wrap Pipelines with custom logic and expose them via HTTP endpoints • OpenAI-compatible chat completion endpoints→ Open WebUI

Slide 14

Slide 14 text

Development Environment for Haystack ● Drag, drop, and construct Haystack pipelines ● Ready-made pipelines ● Bring your own files or connect to your database ● Deploy on Studio or export pipelines ● Test, debug, and share your prototype ● Free and open to everyone deepset Studio

Slide 15

Slide 15 text

Build a Pipeline Deploy to Development Environment

Slide 16

Slide 16 text

Build a Pipeline Playground

Slide 17

Slide 17 text

Build a Pipeline Export Pipeline

Slide 18

Slide 18 text

Thank You! Any Questions? bilgeyucel in/bilge-yucel @bilgeyucl github.com/deepset-ai/github-agent haystack.deepset.ai