An overview of Google Cloud serverless compute and orchestration

After a brief introduction to the characteristics of serverless solutions, and a panorama of the existing serverless compute products of Google Cloud (with a focus on Cloud Run and Cloud Functions), we’ll have a closer look at serverless orchestration, thanks to Google Cloud Workflows. With Workflows, developers and architects can orchestrate existing APIs and microservices, crystallise and version the business process of the enterprise, and bring more coherence in the chaos of microservices.

Transcript

1. Proprietary + Confidential
   An overview of serverless
   compute & orchestration
   on Google Cloud
   Guillaume Laforge
   Cloud Developer Advocate
   @glaforge
   

   View Slide

2. Serverless
   Compute
   

   View Slide

3. 3
   Serverless
   Compute
   Develop, deploy and scale applications
   fast and securely in a fully managed
   environment
   Fully Managed Speed to
   Market
   Auto-scaling
   

   View Slide

4. Proprietary + Confidential
   What is the benefit of Serverless?
   Cloud
   Physical
   Servers
   Network
   Hardware
   Physical
   Security
   Internet
   Connectivity On Prem
   Application
   Development
   Performance
   Monitoring Serverless
   Scaling
   VM
   Provisioning
   Ops & Security
   Management
   

   View Slide

5. 5
   Proprietary + Confidential
   Are you looking for a custom house or move-in ready?
   Custom House = On-Prem
   Control and selection of
   ● Site plan
   ● Floorplan
   ● Appliance and Fixture
   locations
   ● Appliances, fixtures,
   finishes
   ● Furniture and Small
   appliances
   ● What to cook for dinner
   and watch on TV
   Fully Furnished = Serverless
   Control and selection of:
   ● Site plan
   ● Floorplan
   ● Appliance and Fixture
   locations
   ● Appliances, fixtures,
   finishes
   ● Furniture and Small
   appliances
   ● What to cook for dinner
   and watch on TV
   

   View Slide

6. Fully Managed Infrastructure
   Rapid Auto-scaling
   Fault-tolerant (N+1)
   Self-healing
   Built-in services (APM, identity & security)
   Pre-provisioned
   Abstraction (Dev. Experience) Connectivity
   HTTPS / gRPC
   Events
   VPC
   App
   2008
   Function
   2017
   Container
   2019
   Serverless Compute
   

   View Slide

7. View Slide

8. Proprietary + Confidential
   Serverless Use Cases App Engine Cloud Run
   Cloud
   Functions
   Build a web or mobile app
   — HTTP web app ✅ ✅
   Developing APIs
   — Web & mobile backends ✅ ✅
   — Internal APIs and services ✅ ✅
   Data Processing ✅
   Automation
   — Event driven reactive automation ✅ ✅
   Application Integration Services ✅ ✅
   Common use cases for Serverless compute products
   

   View Slide

9. Cloud Run
   Cloud Functions
   Serverless applications & containers
   Serverless functions
   https://cloud.run
   https://cloud.google.com/functions
   

   View Slide

10. Focus:
    Cloud Functions
    

    View Slide

11. Proprietary + Confidential
    Why choose...
    Cloud Functions
    Connect and extend GCP services
    Single-purpose, reusable code
    Triggered by an event
    Retries
    Node.js, Python, Go, Java, PHP, Ruby, .NET
    

    View Slide

12. Cloud Functions as Cloud Glue!
    Access Google
    services
    Cloud Storage
    Cloud Pub/Sub
    HTTPS
    Firebase
    Cloud Scheduler
    Cloud Tasks
    

    View Slide

13. Container
    Managed by Google
    Serverless container infrastructure
    Managed by you
    Function code & dependencies
    Functions Framework
    Runtime (Node.js)
    Operating System (Ubuntu)
    index.js
    exports.helloWorld = (req, res) => {
    res.send("Hello, Cloud Next!");
    }
    package.json
    ...
    Manages your function's
    lifecycle
    What is a Function?
    

    View Slide

14. Functions Framework
    Curated by Google
    Local Development
    Managed by you
    Function code & dependencies
    7
    Languages
    Functions Frameworks
    

    View Slide

15. Languages and versions supported
    ● Node.js — 10, 12, 14, 16
    ● Python — 3.7, 3.8, 3.9
    ● Go — 1.13, 1.16
    ● Java — 11, 17 preview
    ● .NET Core — 3.1
    ● PHP — 7.4, 8.1 preview
    ● Ruby — 2.6, 2.7, 3.0
    

    View Slide

16. What’s new?
    Developer Experience
    ● Develop and run locally
    Expand supported workloads
    ● Minimum instances
    ● Private pools
    Security
    ● Secret Manager integration
    ● Customer Managed Encryption Keys
    Networking
    ● VPC connectors: Shared VPC support
    ● VPC-SC
    New
    

    View Slide

17. Developer Experience
    ● Develop and run locally
    Security
    ● Secret Manager integration
    ● Customer Managed Encryption Keys
    ● Binary Authorization
    Networking
    ● VPC connectors: Shared VPC support
    ● VPC-SC
    Cloud Functions 2nd generation
    Expand supported workloads
    ● Larger instances
    ● Concurrency > 1
    ● BigQuery remote functions
    ● Traffic splitting
    ● Longer processing time
    ● 90+ event sources via Eventarc
    New
    

    View Slide

18. Focus:
    Cloud Run
    

    View Slide

19. Proprietary + Confidential
    Why choose...
    Cloud Run
    Run your code and deploy in seconds to a
    container
    Automatic HTTPS/SSL, Custom domains
    Any language, any library
    Portability
    No cluster management
    

    View Slide

20. Any language
    Any library
    Any binary
    Ecosystem of
    base images
    .js .rb .go
    .py .sh …
    0 1 0
    1 0 0
    1 1 1
    Containers
    

    View Slide

21. Containers
    Flexibility
    Serverless
    Velocity
    

    View Slide

22. Cloud Run
    Fully managed, deploy your
    workloads and don’t see the
    cluster.
    Cloud Run on Anthos
    Deploy into Anthos, run
    serverless side-by-side with
    your existing workloads.
    Knative Everywhere
    Use the same APIs and
    tooling anywhere you run
    Kubernetes with Knative.
    Serverless Containers with Knative and Anthos
    

    View Slide

23. Container to
    production
    in seconds
    Natively
    Serverless
    One experience,
    where you want it
    Cloud Run
    Bringing serverless to containers
    

    View Slide

24. Public
    • Website
    • API endpoint
    Private
    • Internal services
    • Async tasks
    • Mobile backend
    • Webhook
    HTTPS endpoint
    

    View Slide

25. Listen on 0.0.0.0 on port $PORT (default 8080)
    HTTP server must start < 4 min (timeout → 504)
    Request time < 60 min (default → 5 min)
    Stateless (in-memory file system, doesn’t persist)
    Computation only within request (No background activity)
    Container contract
    

    View Slide

26. 1 vCPU per container instance (configurable to 8 vCPU)
    512 MiB of memory up to a max of 8 GiB (256MB-32GB preview)
    80 concurrent requests per container (configurable 1-1000)
    100 max containers by default (configurable 1-1000)
    Sandboxed by gVisor
    Container resources
    

    View Slide

27. Pay per use
    CPU / Memory / Requests 100ms
    

    View Slide

28. Billable time
    Instance
    Billable Time
    Request 1 Start Request 1 End
    Request 2 Start Request 2 End
    Instance Time
    Billable
    Non-billable
    

    View Slide

29. Concurrency: 1 to 1000!
    concurrency = 1
    concurrency = 80 (default) - 1000 (max)
    

    View Slide

30. What’s new?
    Developer Experience
    ● Develop and run locally
    ● Deploy from local source
    (no Dockerfile needed)
    Expand supported workloads
    ● CPU allocation (always allocated)
    ● Better performance and file system support
    ● gRPC streaming, WebSockets, HTTP/2
    ● 60min request timeout
    Security
    ● Secret Manager integration
    ● Customer Managed Encryption Keys
    ● Binary Authorization
    Networking
    ● VPC connectors: Shared VPC support
    ● VPC-SC
    Committed use discounts
    New
    

    View Slide

31. Beyond
    Compute
    

    View Slide

32. Cloud Workflows
    Declarative service orchestration
    Cloud Tasks
    Asynchronous task execution
    Eventarc
    Asynchronous event delivery
    Cloud Build
    Serverless CI/CD
    Cloud Pub/Sub
    Serverless messaging
    Cloud Scheduler
    Cron in the cloud
    API Gateway
    Declarative API management
    VPC Access
    Serverless networking
    Build and persist Orchestrate
    Connect
    Cloud Firestore
    Serverless NoSQL database
    AI Platform
    Serverless data science and ML
    BigQuery
    Serverless data warehouse
    Portfolio of Serverless capabilities on Google Cloud
    

    View Slide

33. View Slide

34. View Slide

35. View Slide

36. View Slide

37. View Slide

38. Focus:
    Workflows
    

    View Slide

39. Workflows at a glance
    ● Easiest way to connect
    ● Zero maintenance
    ● Durable and reliable
    ● Observable
    ● Self documenting
    ● Event & scheduled triggers
    ● Long-running operations
    ● Callbacks
    ● Connectors
    ● Low-latency, fast deploys
    ● Scale from 0 → ∞
    Compute External
    API’s
    Cloud
    Services
    etc...
    SaaS
    API’s
    Private
    API’s
    Other
    Clouds
    Triggers
    Workflows - orchestrate & integrate
    

    View Slide

40. The Workflow definition
    Workflow sources
    specify the steps to
    take, and the state
    (variables) to save.
    

    View Slide

41. The Workflow definition
    The syntax is in YAML or
    JSON, and is automatically
    visualized as a flow chart.
    

    View Slide

42. Use cases
    ● Service orchestration
    ● Batch jobs
    ● Business processes
    ● Data and ML pipelines
    ● Infrastructure automation
    

    View Slide

43. Parallel steps!
    What’s new? Preview
    - :
    parallel:
    …
    for:
    value:
    …
    steps:
    ...
    - :
    parallel:
    ...
    branches:
    - :
    steps:
    ...
    ...
    - :
    steps:
    ...
    

    View Slide

44. Let’s finish
    with a demo!
    pixxearch.appspot.com
    github.com/glaforge/pixxearch
    g.co/codelabs/serverless-workshop
    

    View Slide

45. 󰚦 Thank you!
    󰢨 Questions?
    

    View Slide