Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Orchestrate generative AI with Workflows

Orchestrate generative AI with Workflows

Mete Atamel

April 12, 2024
Tweet

More Decks by Mete Atamel

Other Decks in Technology

Transcript

  1. 02 Google Cloud Next ‘24 Proprietary Mete Atamel Developer Advocate

    Google Cloud @meteatamel atamel.dev speakerdeck.com/meteatamel github.com/GoogleCloudPlatform/workflows-demos
  2. 03 Proprietary 01 Workflows 02 Generative AI 03 Orchestrating generative

    AI 04 Event-driven generative AI 05 Bonus: AI-assisted authoring Agenda
  3. 05 Google Cloud Next ‘24 Proprietary Serverless Compute External API’s

    Google API’s etc... Workflows - orchestrate & integrate SaaS API’s Private API’s Other Clouds
  4. 06 Google Cloud Next ‘24 - processPayment: params: [paymentDetails] call:

    http.post args: url: https://payment-processor.run.app/... body: input: ${paymentDetails} result: processResult - shipItems: call: http.post args: url: https://.../cloudfunctions.net/ship body: input: ${processResult.body} result: shipResult - notifyUser: call: http.post ... Payment Processor Cloud Run Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items YAML or JSON syntax
  5. 07 Google Cloud Next ‘24 Proprietary Payment Processor Cloud Run

    Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items MAX: 5 times BACKOFF Payment Processor Cloud Run Authorize & charge CC Notifier Cloud Run Notify user Shipper Cloud Functions Prepare & ship items Pager Cloud Run Escalate to support SUCCESS ERROR Configurable retries Configurable exception handling Errors and retries
  6. 08 Google Cloud Next ‘24 Proprietary Notifier Cloud Run Notify

    user Shipper Cloud Functions Prepare & ship items Pager Cloud Run Escalate to support SUCCESS ERROR Out of Stock? No Request from the supplier Yes Read inventory Inventory DB Update inventory Inventory DB Supplier API Demo Conditionals and 3rd party calls
  7. 012 Google Cloud Next ‘24 Proprietary Can you tell me

    the history of ‘Cyprus’? Demo Let’s use PaLM 2 to get the history of a country
  8. 013 Google Cloud Next ‘24 Can you tell me the

    history of ‘Argentina’, ‘Brazil’, ‘Cyprus’? Can you tell me the history of ‘Argentina’? Can you tell me the history of ‘Brazil’? Can you tell me the history of ‘Cyprus’? What about of a list of countries? Demo
  9. 019 Google Cloud Next ‘24 Users Bucket Cloud Storage final_summary

    Cloud Storage Trigger Eventarc parallel-summaries Workflows Branch #1 Read from bucket Call Gemini Branch #2 Read from bucket Call Gemini Branch #3 Read from bucket Call Gemini large_document.txt Demo
  10. 022 Google Cloud Next ‘24 Proprietary 1. Explain and Summarize

    Workflows using Gemini 2. Quick Help: Assistive authoring experience using documentation and samples 3. Vertex AI connector to call Gemini from Workflows Join our Workflows Insiders Group to keep up to date on new and upcoming launches: https://groups.google.com/g/workflows-insiders Coming Soon to Preview!
  11. Share your thoughts on how Google Cloud can support your

    orchestration needs and use cases. Complete the survey to connect with the Google Cloud Orchestration team: https://bit.ly/3J4vH7q