Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Building AI Apps with Cloudflare: Zero to One 🚀

Pratik Parmar
December 07, 2024
7

Building AI Apps with Cloudflare: Zero to One 🚀

Pratik Parmar

December 07, 2024
Tweet

Transcript

  1. • State of AI • From a cool demo to

    production • Hosting model vs API • Monitoring and Evaluations • Building a RAG with Vector DB • Yet another cool demo Follow Along Outline
  2. How do you like your AI model? Factor Host API

    High upfront cost Lower initial cost Performance depends on the local infra Usually faster performance due to managed cloud infra Complete control over the data Provider might use your data to train the model Cost💰 Performance 🚀 Privacy 󰡯
  3. How do you like your AI model? Factor Host API

    Customize or finetune the model however you want Limited customization options Quality of the output depends on the model, finetune can enhance quality Depends on the provider model, prompt drifting is a major concern Requires technical expertise to manage the servers Quick integrations into existing codebase with minimal setup Customization🛠 Quality 📝 Expertise 󰲧
  4. RAG