Hands-on Gemini with Vertex AI and LangChain4j Mete Atamel Valentin Deleplace Guillaume Laforge Developer Advocates

Google Cloud Introduction

Google Cloud Artificial Intelligence NLP AI Landscape Data Science Machine Learning — Unsupervised, Supervised, Reinforcement Learning Deep Learning — Artificial, Convolution, Recurrent Neural Networks Generative AI — GAN, VAE, Transformers LLMs — Transformers Image Gen — GAN, VAE

Google Cloud Google invented the Transformer architecture Responsible AI at the foundation Google invents Transformer kickstarting LLM revolution Google’s groundbreaking large language model, BERT AlphaFold predicts 3D models of protein structures Text-to-Text Transfer Transformer LLM 10B P model open sourced Google LaMDA model trained to converse Google PaLM single model to generalize across domains Google PaLM 2 model is the SOTA LLM PaLM 2

Google Cloud What are Large Language Models (LLM)? ● Transformer-based neural network architecture that can recognize, predict, and generate human language ● Trained on huge corpuses of text in various languages and domains ○ PaLM 2 learned 340 billion parameters, and trained over 3.6 trillions of tokens ● Learns the statistical relationships between words and phrases, as well as the patterns of human language ● Can be fine-tuned for specific tasks or domain knowledge

Google Cloud LLM sizes

Google Cloud With larger models emerge new capabilities https://blog.research.google/2022/04/pathways-language-model-palm-scaling-to.html

Google Cloud What does Google (Cloud) offer?

Google Cloud Gemini (brand) previously Bard, Duet AI, … Google (Cloud) Landscape Vertex AI Google AI Studio Model Garden Codey Imagen Llama 2, Claude 2, Falcon, Vicuna, Stable Diffusion … Search & Conversation Vector Search Notebooks Pipelines AutoML PaLM Gemini (model) … Vision, Video, TTS / STT, NL APIs

Google Cloud Duet AI Bard Gemini PaLM MakerSuite Google AI Studio

Google Cloud What is Gemini (brand)? Gemini is an umbrella brand used in Google products that utilize the Gemini model ● Bard (consumer chat interface) ⇒ Gemini app ● Duet AI (Google Cloud developer assistance) ⇒ Gemini Cloud Assist ● Duet AI for developers ⇒ Gemini Code Assist ● …

Google Cloud What is Gemini (model)? Gemini is Google Deep Mind’s most capable LLM ● It’s a multimodal LLM: text, images, videos as inputs ● Comes in 3 sizes: Nano, Pro, and Ultra ● Supports function calling ● Ranks at the top of the various LLM benchmarks (general knowledge, translation, image understanding, reasoning, math, coding, and more…)

Gemini 1.5

Open-weights model derived from Gemini

Google Cloud SDKs and libraries

Google Cloud Google AI Studio vs. Vertex AI You can use Gemini from Google AI Studio or Vertex AI in Google Cloud They’re separate products with separate libraries and language coverage In this workshop, we’ll be using Vertex AI in Google Cloud

Google Cloud 17 Python is the default language in AI… But what about Java developers?

Google Cloud Option 1: Vertex AI Java API for Gemini https://cloud.google.com/java/docs/reference/google-cloud-vertexai/

19 Option 2: LangChain4j In this workshop, we’ll be using LangChain4j

Google Cloud Let’s get started!

Google Cloud Codelab: codelabs.developers.google.com/codelabs/gemini-java-developers Repo: github.com/glaforge/gemini-workshop-for-java-developers/tree/main Google Cloud Console: console.cloud.google.com/ bit.ly/gemini-devoxx-2024

Google Cloud Onramp TODO valentin screenshots, etc. Not using Onramp because of quota issues on step 10 (RAG) Instead, distribute frictionless accounts (email + password) Not using Onramp because of quota issues on step 10 (RAG) Instead, distribute frictionless accounts (email + password)

Thanks! Mete Atamel Valentin Deleplace Guillaume Laforge Developer Advocates