Fine-tuning LLMs in Vertex AI — DevFest Nairobi 2023

Fine-tuning LLMs in Vertex AI — DevFest Nairobi 2023

Transcript

1. #MachineLearning Fine-tuning LLMs in Vertex AI Olayinka Peter Oluwafemi Machine Learning GDE @olayinkapeter_ Nov 2023
2. $whoami • ML Google Developer Expert • Senior ML @ Credit Direct • ❤ TensorFlow, anime & peanut butter • Coordinates 󰗓 coffeewithpeter.com
3. Vertex AI One AI platform, every ML tool you need 🔥🚀
4. Vertex AI Overview Unified development and deployment platform for data science, machine learning, and generative AI
5. Model Garden Generative AI Studio Open Source Models Task Specific AutoML and APIs Foundation Models Tuning Adaptive Layers Prompt Design Data Science Workbench (Colab Enterprise & Workbench Instances) Experiment Train Deploy MLOps ML Platform Vertex AI Platform provides data science, ML, and Gen AI practitioners with tools to customize and build
6. Vertex AI areas of investment 1 Unified Data & AI platform for all users to accelerate time to value 2 End-to-End MLOps to efficiently and responsibly manage and govern AI 3 Open and Scalable AI Infrastructure to flexibly and successfully deploy AI State-of-the-Art AI to drive innovation and improve customer outcomes 4
7. Vertex AI Pre-Trained Models Vision Language Conversation Vision Video Intelligence AutoML Vision AutoML Video Intelligence Translation Natural Language AutoML Natural Language AutoML Translation Speech-to-Text Dialogflow Text-to-Speech Best in class tools allowing customers to leverage Google’s leadership in AI to solve common problems Structured data Fleet Routing API AutoML Tables Vertex AI Forecast Time Series Insights API TabNet Speaker ID
8. Vertex AI Model Garden 01 One stop shop 02 Use Foundation Models directly 03 Tune Foundation Models 04 Customize popular open source models 05 API access to task-specific solutions One place to launch various enterprise user journeys
9. Google Cloud Generative AI Empower enterprises to innovate faster with enterprise-ready generative AI APIs | SDK | Libraries AI Platform AI Notebooks Experiment | Train | Deploy Prompt | Tune | Distill | Extend ML Ops | RAI & Eval Tooling Google Cloud Infrastructure (GPU/TPU) | Google Data Cloud Model Garden Build Your Own Gen AI powered Agents AI Solutions Doc AI Contact Center AI Translation Hub Risk AI User Interfaces: Voice | UI Widgets | Multimodal | … Generative AI Studio Search & Conversation Data Connectors Extensions Orchestrate Grounding Enterprise Readiness NTK Google Models PaLM, Codey, Imagen, Chirp, Embeddings… Open Source Models LLaMA 2, Falcon, Stable Diffusion… Partner Models Claude 2,… Broad Ecosystem of Partners Search Retrieve | Summarize | Generate Conversation Answer | Generate | Transact … Model Garden Vertex AI Data Governance Data Privacy Responsible AI Security & Compliance
10. 01 A simple UI for interacting with models 02 Tune models with your own data 03 Use models in production 04 Multiple modalities Generative AI Studio Simple UI for interfacing, experimenting, and tuning models
11. Let’s dive in Dive in
12. Thank You Olayinka Peter Oluwafemi he/him @olayinkapeter_ Nov 2023