Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Improve LLM-based Applications with Fallback Mechanisms

Improve LLM-based Applications with Fallback Mechanisms

Bilge Yücel

June 14, 2024
Tweet

More Decks by Bilge Yücel

Other Decks in Technology

Transcript

  1. About me •🥑 Developer Relations Engineer at deepset •🏗 Open

    source LLM Framework: Haystack •📍 Istanbul, Turkey Bilge Yücel @bilgeycl Bilge Yücel bilgeyucel
  2. • Haystack is an open source Python framework for building

    production-ready LLM applications • Prototyping, evaluation, deployment, monitoring…
  3. • Haystack is an open source Python framework for building

    production-ready LLM applications • Prototyping, evaluation, deployment, monitoring… • Building blocks: Components & Pipelines
  4. RAG PIPELINE When is Taylor Swift’s next concert? The documents

    do not provide any information about Taylor Swift's upcoming concert.
  5. Fallback to Web When is Taylor Swift’s next concert? Taylor

    Swift's next concert is on June 13, 2024, in Liverpool.
  6. Extracting Structured Data Berlin is the capital of Germany. It

    has a population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  7. Extracting Structured Data Berlin is the capital of Germany. It

    has a population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  8. Extracting Structured Data Berlin is the capital of Germany. It

    has a population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  9. Extracting Structured Data Berlin is the capital of Germany. It

    has a population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  10. Looping Berlin is the capital of Germany. It has a

    population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  11. Looping Berlin is the capital of Germany. It has a

    population of 3,850,809. Paris, France's capital, has 2.161 million residents. Lisbon is the capital and the largest city of Portugal with the population of 504,718.
  12. Recap • Fallbacks are handy to make a search in

    alternative sources • Fallback branches can be action triggers • Early routing is also possible if you have defined options • Loops are great for validation and auto-correction
  13. Thank you @bilgeycl Bilge Yücel bilgeyucel haystack.deepset.ai Haystack is open

    source! ⭐ 📖 Documentation 📚 Tutorials 󰳏 Cookbooks 📘 Articles 👾 Join the Community