Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Everything is a Graph, Including LLM Applicatio...

Tuana Çelik
May 20, 2024
150

Everything is a Graph, Including LLM Applications! (and that's handy)

This was my talk at PyCon 2024 where I talk about our graph approach to building AI applications, especially since the release of Haystack 2.0.

In this talk, I give examples of common language model use cases such as retrieval augmented generation, embedding documents into vector databases, and how they can all be represented as graphs. I also talk about how having branches and loops can be really useful in many use cases, especially to build 'agentic' AU pipelines.

Tuana Çelik

May 20, 2024
Tweet

Transcript

  1. @TUANACELIK /IN/TUANACELIK Question Answering Given the documents, answer the question.

    Documents: {{ documents}} Question: {{ question }} Summarization Summarize the following text. Text: {{ text}} Question Generation Given the following document, generate some questions Document: {{ document}} Question: Translation Translate the following text to French Text: {{ text }} SOMETHING CHANGED IN 2022 An AI applications behaviour - defined by an instruction (prompt)
  2. @TUANACELIK /IN/TUANACELIK Retrieval Augmented Generation Question Answering Given the documents,

    answer the question. Documents: {{ documents}} Question: {{ question }}
  3. @TUANACELIK /IN/TUANACELIK Retrieval Augmented Generation Question Answering Given the documents,

    answer the question. Documents: {{ documents}} Question: {{ question }} Question
  4. @TUANACELIK /IN/TUANACELIK Question Answering Given the documents, answer the question.

    Documents: {{ documents}} Question: {{ question }} Question Retrieval Augmented Generation
  5. @TUANACELIK /IN/TUANACELIK Question Answering Given the documents, answer the question.

    Documents: Question: {{ question }} Question Retrieval Augmented Generation
  6. Fully open-source framework built in Python for custom LLM applications

    Provides tools that developers need to build state-of-the-art NLP systems Building blocks: Pipelines & Components Component Component Pipeline @TUANACELIK /IN/TUANACELIK 📚 Announced March 11, 2024
  7. 0.35 0.8 0.1 0.21 0.47 0.62 0.73 0.51 @TUANACELIK /IN/TUANACELIK

    Is Taylor Swift queen of the world? Embedder Retriever PIPELINES
  8. OUTPUT VALIDATION Meeting Notes PromptBuilder Generator Output Validator Valid replies

    Invalid replies & Error Message @TUANACELIK /IN/TUANACELIK 📚 Tutorial
  9. @TUANACELIK /IN/TUANACELIK @HAYSTACK_AI THANK YOU! 🗂️ DOCUMENTATION 📚 TUTORIALS 📍

    July 5th, Amsterdam 🧡 Come find me for a friendship bracelet PIP INSTALL HAYSTACK-AI