Fine tuning Gemini

Speaker: Roya Kandalan

Transcript

1. Fine tuning Gemini Roya Kandalan Gen AI Research Scientist twitter:roya_kandalan Last updated: May 2024
2. PROFESSIONAL AND PERSONAL BACKGROUND Google Developer Expert ( AI/ML) Women Techmaker Ambassador GDG Cloud Boston Co-Organizer ABOUT ME Roya, means a very sweet dream in Farsi! EDUCATION & EXPERIENCE Degree in EE, supervised by Prof. K. Namuduri Senior Research Scientist at the Cigna Group VOLUNTEER
3. Sponsors
4. Be nice. Be respectful and constructive Be collaborative Participate
5. what is generative ai?
6. What is an LLM? LLMs Explained [...] [...] [...] [...] 0.02 0.03 0.9 0.01 0.0 … Dogs Rain Drops Fish Wind … and cats raining It’s
7. Roses are red, Violets are blue, Sugar is sweet, LLMs Explained
8. Roses are red, Violets are blue, Sugar is sweet, LLMs Explained
9. Classic Natural Language Problems LLMs Explained Entity extraction Classification Summarization Sentiment Analysis Translation …
10. Explain this joke: “I used to be addicted to soap, but I'm clean now.” Model: The joke is a pun on the word "clean". It has two meanings: Model: User: The joke is funny because it is unexpected. The listener expects the speaker to be talking about the first meaning of "clean", but they are actually talking about the second meaning. This creates a surprise and a laugh. To be free of dirt or other unwanted substances. To be free of addiction. LLMs Explained
11. Model: 1. **Build a volcano.** This is a classic science fair project that is both fun and educational. You can learn about the science of volcanoes, earthquakes, and plate tectonics. 2. **Make a solar oven.** This is a great project to learn about renewable energy and how to harness the power of the sun. You can use your solar oven to cook food, dry fruit, or even melt chocolate. 3. **Create a 3D printer.** This is a more challenging project, but it is also very rewarding. You can learn about 3D printing technology and design your own custom objects. 4. **Build a robot.** This is a great project for those who are interested in engineering and robotics. You can learn about basic electronics, mechanics, and programming. 5. **Design a water filtration system.** This is a project that can help you learn about the importance of clean water and how to filter it. You can use your water filtration system to clean water from a stream or river. LLMs Explained Give me five neat ideas for science fair projects. User:
12. Why are large language models different? LLMs are characterized by emergent abilities, or the ability to perform tasks that were not present in smaller models. LLMs contextual understanding of human language changes how we interact with data and intelligent systems. LLMs can find patterns and connections in massive, disparate data corpora. Search Conversation Content generation
13. Multimodality
15. Gemini is the most capable and general model we’ve ever built, and is the result of a large-scale collaborative effort by NEEDS ART The next chapter of Generative AI innovation
16. Gemini marks the next phase on our journey to making AI more helpful for everyone State-of-the-art, natively multimodal reasoning capabilities Highly optimized while preserving choice Built with responsibility and safety at the core
17. (Android AICore)
18. The Gemini Ecosystem The most advanced AI from Google For Developers For Consumers For Business and Enterprise Models Gemini API (in Google AI Studio + ai.google.dev) Gemini for Google Workspace Gemini for Google Cloud Gemini in Vertex AI Gemini | app and web Gemini in the Google App Gemini in Gmails, Docs… this deck is about
19. Getting started with the Gemini API Train the Trainer in AI
20. AI Studio aistudio.google.com • Create, test, and save prompts • Customize models in minutes
21. AI Studio aistudio.google.com
22. AI Studio aistudio.google.com
23. AI Studio aistudio.google.com
24. AI Studio aistudio.google.com
25. Vertex AI Enterprise grade support. Full MLOps (Examples: Model evaluation, monitoring, registry) Vertex AI Check it out when you're ready for production Gemini API and Vertex AI Both give access Gemini family models. Vertex AI Cloud Production ai.google.dev/docs/migrate_to_cloud PlatfoEndpoints rms Platforms Platforms
26. Basic prompting Train the Trainer in AI
27. Write a poem about a magic backpack. In a world of wonder, behold, A backpack with tales yet untold. Its fabric shimmers, alive with might, A portal to realms, day and night. aistudio.google.com
28. Write a poem about a magic backpack. In a world of wonder, behold, A backpack with tales yet untold. Its fabric shimmers, alive with might, A portal to realms, day and night. ... aistudio.google.com
29. Your Turn!
30. To get the credit please follow this link https://trygcp.dev/e/build-ai-PH01
31. trygcp.dev/e/<event-id> Click here
32. 1. Click here
33. Last step to apply credit! Set your project’s billing account to Google Cloud Platform Trial Billing Account
34. Issues When attempting to redeem credits It may be unclear where the credits land. If you users are confused, have them navigate to the Credits tab on the page on of the console That is where they will see the credits
35. Issues if the user ALREADY has a existing billing account make sure they one Click on the 3 Dot menu on the project, and select “Change Billing,” from the drop down select that Google Cloud Platform Trial Billing
36. Search and Information Synthesis Train the Trainer in AI
37. • Models have knowledge cut-offs • LLMs are not fact engines • No exposure to private data BYO Data Search & IR
38. • Instructions + Context + Question all in the prompt • Easy to implement ◦ No extra code, just ask. Use the prompt's context window Search & IR
39. Use the prompt's context window Learning more • Limited by the model's context length ◦ gemini-1.0-pro: 30K tokens. Search & IR
40. 2M
41. ATTENTION Disclaimer: The presentation about Attention is based on Serrano.Academy
42. ATTENTION Where to put cherry? android? apple? What about this apple? This is what we want Embedding doesn’t know where to put them Disclaimer: The presentation about Attention is based on Serrano.Academy
43. ATTENTION Disclaimer: The presentation about Attention is based on Serrano.Academy Please buy an apple and an orange Apple released a new phone
44. ATTENTION Disclaimer: The presentation about Attention is based on Serrano.Academy
45. Your Turn!
46. Train the Trainer in AI Image understanding
53. Your Turn!
54. Responsible AI Train the Trainer in AI
55. Responsible AI
56. Your Turn! https://tinyurl.com/3me7dch2
57. Tuning Train the Trainer in AI
58. Tuning • In AI Studio Tuning
63. How to choose a model - Prototype with Pro - Decide what matters the most - Quality - Speed - Cost - Control - Pro → Finetune - Nano - Flash - Gemma
64. ai.google.dev Learning more https://ai.google.dev/docs/discord More on fine tuning: https://tinyurl.com/4dfmx5jp Connect with me →
65. Thank you! Roya Gen AI Research Scientist Twitter: Roya_kandalan