Build AI Apps with OpenSource LLM

Slide 1

Slide 1 text

Building AI Apps With Open Source LLMs* Pratik Parmar

Slide 2

Slide 2 text

Pratik Parmar CTO, Stealth Startup Ex. Zyte, Intel, yellow.ai About Myself

Slide 3

Slide 3 text

Outline 01 02 03 Intro to GenAI and LLM Open-Source LLMs AI App components 3 04 LangChain 05 06 07 Superhero Bot Monitoring & Evaluate AI Apps PokeBot 08 Resources

Slide 4

Slide 4 text

What is GenAI

Slide 5

Slide 5 text

10 Types of Gen AI Models Text-to-Text Text-to- Image Image-to- Text Image-to-3D Image/Video -to-3D - ChatGPT - Bard - LLama (Meta) - PaLM 2 - Claude - … - Midjourney - DALL-E 3 - Stable Diffusion - Muse - Imagen - Bard - ChatGPT - Flamingo - Visualart - Dream Fusion - Magic3D - CSM AI Text-to- Audio Text-to- Code Image-to- Science Text-to- Video Audio-to- Text - AutoLM - Jukebox - Codex - Alphacode - Galatica - Minerva - Runway - Cuebric - Phenaki - Whisper

Slide 6

Slide 6 text

GenAI vs Predictive ML Data Labels Predictive ML Model Learns relationship between data and label Label Output Unstructured Content GenAI Model Learns pattern in unstructured content New Content Output

Slide 7

Slide 7 text

What is LLM LLM Foundation Models

Slide 8

Slide 8 text

Example of GenAI Applications

Slide 9

Slide 9 text

LLM Provider Google Gemini / Vertex AI Hugging Face Inference API Ollama LMStudio MistralAI Inference API Azure Cloud AI API Cloudﬂare AI Workers

Slide 10

Slide 10 text

Ollama

Slide 11

Slide 11 text

Run Open Source LLMs Locally Using Ollama

Slide 12

Slide 12 text

SuperBot Chat with your favorite ﬁctional character using AI. And I can bet, he won’t admit he’s batman.