Orchestrate generative AI with Workflows

Transcript

1. Proprietary Orchestrate generative AI with Workflows
2. 02 Google Cloud Next ‘24 Proprietary Mete Atamel Developer Advocate Google Cloud @meteatamel atamel.dev speakerdeck.com/meteatamel github.com/GoogleCloudPlatform/workflows-demos
3. 03 Proprietary 01 Workflows 02 Generative AI 03 Orchestrating generative AI 04 Event-driven generative AI 05 Bonus: AI-assisted authoring Agenda
4. 04 Proprietary Google Cloud Next ‘24 Introduction to Workflows
5. 05 Google Cloud Next ‘24 Proprietary Serverless Compute External API’s Google API’s etc... Workflows - orchestrate & integrate SaaS API’s Private API’s Other Clouds
6. 06 Google Cloud Next ‘24 - processPayment: params: [paymentDetails] call: http.post args: url: https://payment-processor.run.app/... body: input: ${paymentDetails} result: processResult - shipItems: call: http.post args: url: https://.../cloudfunctions.net/ship body: input: ${processResult.body} result: shipResult - notifyUser: call: http.post ... Payment Processor Cloud Run Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items YAML or JSON syntax
7. 07 Google Cloud Next ‘24 Proprietary Payment Processor Cloud Run Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items MAX: 5 times BACKOFF Payment Processor Cloud Run Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items Pager Cloud Run Escalate to support SUCCESS ERROR Configurable retries Configurable exception handling Errors and retries
8. 08 Google Cloud Next ‘24 Proprietary Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items Pager Cloud Run Escalate to support SUCCESS ERROR Out of Stock? No Request from the supplier Yes Read inventory Inventory DB Update inventory Inventory DB Supplier API Demo Conditionals and 3rd party calls
9. 09 Proprietary Google Cloud Next ‘24 Introduction to generative AI
10. 010 Google Cloud Next ‘24 Proprietary PaLM 2 Gemini Demo Imagen
11. 011 Proprietary Google Cloud Next ‘24 Orchestrating generative AI
12. 012 Google Cloud Next ‘24 Proprietary Can you tell me the history of ‘Cyprus’? Demo Let’s use PaLM 2 to get the history of a country
13. 013 Google Cloud Next ‘24 Can you tell me the history of ‘Argentina’, ‘Brazil’, ‘Cyprus’? Can you tell me the history of ‘Argentina’? Can you tell me the history of ‘Brazil’? Can you tell me the history of ‘Cyprus’? What about of a list of countries? Demo
14. 014 Google Cloud Next ‘24 Proprietary What about Gemini? Demo
15. 015 Google Cloud Next ‘24 Can you describe this picture? What about multi-modal Gemini? Demo
16. 016 Proprietary Google Cloud Next ‘24 Event-driven orchestration of generative AI
17. 017 Proprietary Google Cloud Next ‘24 Let’s summarize a large document
18. 018 Proprietary
19. 019 Google Cloud Next ‘24 Users Bucket Cloud Storage final_summary Cloud Storage Trigger Eventarc parallel-summaries Workflows Branch #1 Read from bucket Call Gemini Branch #2 Read from bucket Call Gemini Branch #3 Read from bucket Call Gemini large_document.txt Demo
20. 020 Proprietary Google Cloud Next ‘24 AI-assisted orchestration authoring
21. 021 Google Cloud Next ‘24 Proprietary Authoring YAML/JSON for orchestration is hard AI can help! Demo
22. 022 Google Cloud Next ‘24 Proprietary 1. Explain and Summarize Workflows using Gemini 2. Quick Help: Assistive authoring experience using documentation and samples 3. Vertex AI connector to call Gemini from Workflows Join our Workflows Insiders Group to keep up to date on new and upcoming launches: https://groups.google.com/g/workflows-insiders Coming Soon to Preview!
23. Share your thoughts on how Google Cloud can support your orchestration needs and use cases. Complete the survey to connect with the Google Cloud Orchestration team: https://bit.ly/3J4vH7q
24. Thank you 024 Proprietary @meteatamel atamel.dev speakerdeck.com/meteatamel github.com/GoogleCloudPlatform/workflows-demos