NLP Magic for Newbies: Build Apps with Ease!

Devfest Istanbul 2023 Presentation (Turkish & English)
https://devfest.istanbul/bilge-yucel

✨ Dive into the captivating world of Natural Language Processing as a developer! ✨
We'll explore intriguing NLP concepts like vector databases and word embeddings and have a better understanding of the fascinating realm of large language models and the art of prompting. Through real examples, we'll see how to seamlessly integrate language models into your applications. Whether you're a complete beginner or a seasoned coder, you'll leave this session ready to embark on your NLP journey with confidence. 🗣️🧠

Transcript

1. NLP Magic for Newbies 🪄 Build Apps with Ease Bilge Yücel
2. • 🥑 Developer Advocate at deepset 󰎲 • 🏗 Open source LLM Framework: Haystack • 🎓 Sabancı University B.Sc. • 🧠 KU Leuven M.Sc. • 📍 Istanbul, Turkey Twitter: @bilgeycl Linkedin: Bilge Yucel GitHub: @bilgeyucel Bilge Yücel Developer Advocate 🥑 deepset
3. NLP?
4. NLP? •
5. NLP? •
6. NLP - Natural Language Processing •
7. Özet • Text Embeddings • Vector Databases • Retrieval • Large Language Models (LLMs) • Building a Generative Question Answering Application
8. Text Embeddings 01
9. Text Embeddings - Vectors • Manageable by computers • Different techniques: ⚬ Sparse: TF-IDF, BM25... ⚬ Dense: Trained models (Sentence Transformers, Cohere, OpenAI...) • Often has 768 dimensions
10. Text Embeddings - 2 dimensional
11. Text Embeddings - Semantic Similarity
12. Vector Databases 02
13. Vector Databases • Databases that store high-dimensional vectors • Optimized for vectors: ⚬ Vector search ⚬ CRUD operations ⚬ Metadata filtering
14. Retrieval 03
15. Retrieval • Getting the most relevant information to the query • Used for semantic search, question answering and more Query
16. LLMs 04
17. Large Language Models (LLMs) • Büyük yapay zeka modelleri • Prompt → İnsansı çıktı • Text generation: özet çıkarma, soru cevaplama, kod yazma, chat…
18. Building a Generative QA App 05
19. Prompting
20. Prompting
21. Prompting
22. Prompting
23. Prompting
24. Retrieval Augmented Generation (RAG)
25. Haystack • NLP ve LLM tabanlı uygulamalar için kullanılan açık kaynak Python framework • Geliştiricilerin ihtiyacı olabilecek SOTA toollar • Yapı Blokları: Components & Pipelines
26. Generative QA Pipeline (RAG)
27. Generative QA Pipeline (RAG) Retrieval Generation
28. Generative QA Pipeline (RAG) What is happening at OpenAI?
29. Generative QA Pipeline (RAG)
30. Generative QA Pipeline (RAG)
31. Generative QA Pipeline (RAG)
32. Generative QA Pipeline (RAG)
33. Generative QA Pipeline (RAG)
34. Generative QA Pipeline (RAG)
35. https://haystack.deepset.ai/
36. 36 Follow 👇 Haystack on Twitter Join 👇 Haystack Community on Discord Check out 👇 Haystack @bilgeycl Bilge Yücel Teşekkürler 🙌