Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Serverless on your own terms using Knative at Knative Meetup by AT&T in LAX

Serverless on your own terms using Knative at Knative Meetup by AT&T in LAX

My "Serverless on your own terms" preso from the Knative meetup in LAX hosted by AT&T - Knative Meetup: Intersection of Kubernetes and Serverless; Present and Future.


Mark Chmarny

April 18, 2019

More Decks by Mark Chmarny

Other Decks in Technology


  1. Serverless on your own terms using Knative Mark Chmarny Serverless

    at Google @mchmarny
  2. Knative open source building blocks for serverless on Kubernetes [kay-native]

    Kubernetes de facto standard for container orchestration
  3. Serverless > Function

  4. Serverless Models Operational Model No Infra Management Pay only for

    usage Programming Model Service-based Event-driven
  5. Serverless Models Operational Model No Infra Management Pay only for

    usage Programming Model Service-based Event-driven Function Only? Not for Applications? What about Container?
  6. Serverless + Portability

  7. • Skills (idiomatic) • Tooling (dev & ops) • Investment

    (“future-proofing”) Serverless Portability
  8. Knative open source building blocks for serverless on Kubernetes [kay-native]

  9. Products Google Cloud Run Red Hat OpenShift SAP Kyma Google

    Cloud Run on GKE IBM Cloud Kubernetes Service TriggerMesh Build Serving Kubernetes Platform Primitives Events ... Knative-based products
  10. Infrastructure Primitives Knative Kubernetes Knative-based Products Optimized Experience Knative usage

  11. 20% MoM Participation Growth >50 Companies contributing 3.7K Pull Requests

    400+ Contributors 9 Working Groups v0.5 Released last week! Knative Community
  12. Knative open source building blocks for serverless on Kubernetes [kay-native]

  13. Knative Serving Benefits • Activates and scales based on request

    (up/down to 0) • Manages code/config revisions • Integrates service mesh (request path/services access control) • Supports custom domains and certificate management Pluggable • Connect with other GCP services like Cloud Build and Stackdriver • Extend with partner integrations like GitLab and Datadog
  14. Knative Deploy (CLI & UI) knctl deploy -s maxprime \

    -i gcr.io/knative-samples/maxprime:latest gcloud beta run deploy maxprime \ --image=gcr.io/knative-samples/klogo:@sha256:a8e… kubectl… kn… os… ibmcloud… … https://maxprime.demo.knative.tech
  15. # Load (from maxprime src dir) go run load/main.go --count

    300 --prime 99999 \ --url https://maxprime.demo.knative.tech # Pods watch kubectl get pods -n demo -l serving.knative.dev/service=maxprime # Proxy (monitoring) kubectl port-forward -n knative-monitoring $(kubectl get pods -n knative-monitoring --selector=app=grafana --output=jsonpath="{.items..metadata.name}") 3000 # Monitor (in browser localhost:3000) http://localhost:3000/d/im_gFbWik/knative-serving-revision-http-requests?refresh=5s&org Id=1&var-namespace=demo&var-configuration=maxprime&var-revision=All Knative Scaling Demo
  16. Knative Autoscaling

  17. # List current revisions in demo namespace (filter on service

    name) kubectl get revisions -n demo -l serving.knative.dev/service=mysrv NAME SERVICE NAME GENERATION READY REASON mysrv-qtz5p mysrv-qtz5p-service 2 True mysrv-vq25k mysrv-vq25k-service 3 True # List routes for specific service kubectl get routes -n demo -l serving.knative.dev/service=mysrv NAME DOMAIN READY REASON mysrv mysrv.demo.knative.tech True # Edit service route to point to specific revision # (status/traffic[n]/revisionName) kubectl edit route mysrv -n demo Knative Revision Demo Revision 1 Revision 2 Revision 3 Configuration Route Service
  18. # github.com/mchmarny/klogo # see service.yaml#L6 apiVersion: serving.knative.dev/v1alpha1 kind: Service metadata:

    name: klogo labels: serving.knative.dev/visibility: cluster-local ... # Demo before and after using Curl curl -H "Content-Type: application/json" \ -d '{"id":"test","url":"https://storage.googleapis.com/kdemo-logos/k8s.png"}' \ -X POST https://klogo.demo.knative.tech/ | jq "." Knative Request Path Demo K8s Knative Frontend UI (External) Microservice A (klogo - Internal) Microservice B (kuser - Internal) GRPC HTTP
  19. 2 1 3 Knative Traffic Splitting Demo • Deploy new

    revision • Create named route to new revision • Continue sending all traffic to original revision • Send progressively larger % of traffic to new revision • Monitor metrics/logs • Migrate all traffic to new revision • Create named route to previous revision Full demo walk-through: https://github.com/mchmarny/knative-demos/tree/master/blue-green-deploy Significant changes in v4 & v5, new/better approach coming: https://github.com/knative/serving/pull/3562
  20. Knative Eventing Loosely coupled • Use existing event sources available

    or build your own • Plugable channel implementation (e.g. PubSub. Kafka, In-Memory) Benefits • Orchestrates on/off cluster event sources • Binds declaratively event sources, triggers, and services • Scales from just few events to live streaming pipelines • Uses standard CloudEvents
  21. Name Description Apache Camel Allows to use Apache Camel components

    for pushing events into Knative Apache Kafka Brings Apache Kafka messages into Knative AWS SQS Brings AWS Simple Queue Service messages into Knative Cron Job Uses an in-memory timer to produce events on the specified Cron schedule. GCP PubSub Brings GCP PubSub messages into Knative GitHub Brings GitHub organization/repository events into Knative GitLab Brings GitLab repository events into Knative. Google Cloud Scheduler Google Cloud Scheduler events in Knative when jobs are triggered Google Cloud Storage Brings Google Cloud Storage bucket/object events into Knative Kubernetes Brings Kubernetes cluster/infrastructure events into Knative Full lists: https://github.com/knative/docs/tree/master/docs/eventing/sources Knative Event Sources
  22. Namespace subscribe Trigger Service (Callable) Broker Trigger Service (Callable) subscribe

    filter= filter= Source Events Source Events ingress ingress publish ✓ ✓ ✓ Knative Eventing Objects
  23. Knative Events { "specversion": "0.2", "type": "com.github.pull.create", "source": "https://github.com/cloudevents/spec/pull/123", "id":

    "A234-1234-1234", "time": "2019-04-08T17:31:00Z", "datacontenttype": "application/json", "data": "{ GitHub Payload... }" } FTP GitHub GCS Broker FTP Receive Adapter GitHub Receive Adapter GCS Receive Adapter CloudEvent
  24. Knative Event Trigger apiVersion: eventing.knative.dev/v1alpha1 kind: Trigger metadata: name: build-status-slack-notifier

    spec: filter: sourceAndType: type: com.slack subscriber: ref: apiVersion: serving.knative.dev/v1alpha1 kind: Service name: slack-sender Simple Trigger - Uses CloudEvents - Supports Filtering - Can produce new events Build status Slack notifications demo: https://github.com/mchmarny/knative-build-status-notifs
  25. Knative Event Broker apiVersion: eventing.knative.dev/v1alpha1 kind: Broker metadata: name: b1

    namespace: demo spec: {} status: address: hostname: b1-broker.demo.svc.cluster.local Simple Broker - One per NS by default - Discoverable endpoint - Manages • Channels • Ingress filter/policy Twitter hashtag demo: https://github.com/mchmarny/knative-build-status-notifs
  26. Knative Eventing Demo # Twitter event source, trigger wired to

    Knative service https://github.com/mchmarny/next19/blob/master/SVR305/DEMO-2.md # Source (config/source.yaml, query=KnativeDemo) kubectl apply -f source.yaml -n demo kubectl get sources -n demo # Trigger (config/trigger.yaml) kubectl apply -f trigger.yaml -n demo kubectl get triggers -n demo # UI app to display tweets github.com/mchmarny/tevents Twitter Viewer App Knative view Broker Trigger Twitter Event Source search ingress targetable
  27. # Cron job source to wire up functions github.com/knative/docs/tree/master/docs/eventing/samples/cronjob-source #

    Process IoT Core events (through PubSub) https://github.com/knative/docs/tree/master/docs/eventing/samples/iot-core # GCP PubSub event source (connector to many other sources) github.com/knative/docs/tree/master/docs/eventing/samples/gcp-pubsub-source Knative Eventing Demos
  28. Knative Build Benefits • Reproducible builds • Enables source to

    serving URL templates • No cross-compiling toil or need for Docker locally • Cloud caching, elasticity of build resources Loosely coupled • Supports decoupled CI/CD (e.g. Cloud Build or Jenkins X) • Ecosystem for enterprise tooling to manage policy and audit builds
  29. # On-cluster Build (Build Templates or github.com/tektoncd/pipeline) kubectl apply -f

    build.yaml # GitOps (Cloud Build or your CI/CD platform like Jenkins X) git commit # on branch triggers build for test deployment git tag/release # triggers deployment pipeline to active service # Local Build & Deploy docker build/tag/publish # uses Dockerfile Kubectl/knctl deploy --image… # github.com/cppforlife/knctl # ko for quick iteration, no Dockerfile, golang only github.com/google/ko ko apply -f config.yaml Knative Build Options
  30. # On-cluster build using Service using kaniko template # github.com/mchmarny/maxprime/blob/master/deployments/clusterbuild.yaml

    kubectl apply -f deployments/clusterbuild.yaml -n demo # Cloud Build triggered by revision tag with image deploy # Configuration file # github.com/mchmarny/maxprime/blob/master/deployments/cloudbuild.yaml # Demo by creating new release to trigger (release-v0.1.n+1) # github.com/mchmarny/maxprime/releases/new # On-cluster build, image deploy using JIB (dependency caching) # github.com/mchmarny/knative-demos/tree/master/jib-build kubectl apply -f deployments/clusterbuild.yaml -n demo Knative Build Demos
  31. Knative de facto platform for serverless on Kubernetes [kay-native]

  32. Knative Events - IRL, not eventing ;) Google Cloud Next

    (Last Week, videos available) Knative a Year Later: Serverless, Kubernetes and You bit.ly/kn-1yl Generating Events from Your Internal Systems with Knative bit.ly/kn-events KubeCon Barcelona (May 20, 2019) Serverless Practitioners Summit bit.ly/kn-barcelona
  33. Docs & Community knative.dev Quick Start bit.ly/cr-gke Source & Samples

    github.com/knative Have questions? knative.slack.com Anything else? @mchmarny