Build NLP Apps with Python, Even If You're a Total Newbie!

Presentation at Hamburg Python Pizza event: https://hamburg.python.pizza/
Recording: https://www.youtube.com/live/0Fp_lQ1oimE?si=kC0CJOHpfSbC9pxC&t=7941

Transcript

1. Build NLP Apps with Python Even If You're a Total Newbie!
2. • 🥑 Developer Advocate at deepset • 🏗 Open source LLM Framework: Haystack • 🍕 First time at Hamburg Python Pizza • 📍 Istanbul, Turkey • 💃 Latin music Twitter: @bilgeycl Linkedin: Bilge Yucel GitHub: @bilgeyucel Bilge Yücel Developer Advocate 🥑 deepset
3. Agenda • Text Embeddings • Vector Databases • Retrieval • LLMs • Building a Generative QA App
4. Text Embeddings 01
5. Text Embeddings - Vectors • Manageable by computers • Different techniques: ⚬ Sparse: TF-IDF, BM25... ⚬ Dense: Trained models (Sentence Transformers, Cohere, OpenAI...) • Often has 768 dimensions
6. Vector Databases 02
7. Vector Databases • Databases that store high-dimensional vectors • Optimized for vectors: ⚬ Vector search ⚬ CRUD operations ⚬ Metadata filtering
8. Retrieval 03
9. Retrieval • Getting the most relevant information to the query • Used for semantic search, question answering and more Query
10. LLMs 04
11. Large Language Models (LLMs) • Big language models • Human-like output • Text generation: summarization, generative QA, writing code, chat…
12. Building a Generative QA App 05
13. Prompting
14. Retrieval Augmented Generation (RAG)
15. Retrieval Augmented Generation (RAG)
16. @bilgeycl @Haystack_AI Haystack What is Haystack? • Fully open-source framework built in Python for custom LLM applications • Provides tools that developers need to build state-of-the-art NLP systems • Building blocks: Pipelines & Components
17. Generative QA Pipeline (RAG) @bilgeycl @Haystack_AI
18. @bilgeycl @Haystack_AI Retrieval Generative QA Pipeline (RAG)
19. Generative QA Pipeline @bilgeycl @Haystack_AI Retrieval Generation
20. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
21. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
22. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
23. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
24. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
25. @bilgeycl @Haystack_AI Generative QA Pipeline (RAG)
26. @Haystack_AI Thank You 🙌 Bilge Yücel Bilge Yücel