Build AI Apps with OpenSource LLM

In this talk, Pratik will walk you through how he is using the open source LLMs to create AI enabled projects. The best part, everything you can replicate on your computer as well without any expensive API. Participants will learn to the AI project development life cycle.

Brief Outline:
What is LLM & How it Works
How to use LLM for your own project
Decide model
Host LLM
Project Walkthrough

Transcript

1. Building AI Apps With Open Source LLMs* Pratik Parmar
2. Pratik Parmar CTO, Stealth Startup Ex. Zyte, Intel, yellow.ai About Myself
3. Outline 01 02 03 Intro to GenAI and LLM Open-Source LLMs AI App components 3 04 LangChain 05 06 07 Superhero Bot Monitoring & Evaluate AI Apps PokeBot 08 Resources
4. What is GenAI
5. 10 Types of Gen AI Models Text-to-Text Text-to- Image Image-to- Text Image-to-3D Image/Video -to-3D - ChatGPT - Bard - LLama (Meta) - PaLM 2 - Claude - … - Midjourney - DALL-E 3 - Stable Diffusion - Muse - Imagen - Bard - ChatGPT - Flamingo - Visualart - Dream Fusion - Magic3D - CSM AI Text-to- Audio Text-to- Code Image-to- Science Text-to- Video Audio-to- Text - AutoLM - Jukebox - Codex - Alphacode - Galatica - Minerva - Runway - Cuebric - Phenaki - Whisper
6. GenAI vs Predictive ML Data Labels Predictive ML Model Learns relationship between data and label Label Output Unstructured Content GenAI Model Learns pattern in unstructured content New Content Output
7. What is LLM LLM Foundation Models
8. Example of GenAI Applications
9. LLM Provider Google Gemini / Vertex AI Hugging Face Inference API Ollama LMStudio MistralAI Inference API Azure Cloud AI API Cloudflare AI Workers
10. Ollama
11. Run Open Source LLMs Locally Using Ollama
12. SuperBot Chat with your favorite fictional character using AI. And I can bet, he won’t admit he’s batman.
15. Connect LLM with LangChain
16. Colab + Ollama HandsOn: FREE LLM API
17. PokeBot Speak to your DB like a pro