Beyond Kubernetes - Knative, riff, and Spring Cloud Function

Beyond Kubernetes
Managing Applications and Functions with Knative,
riff, and Spring Cloud Functions
Eric Bottard
@ebottard
Pivotal
Ray Tsang
@saturnism
Google

View Slide

@saturnism @gcpcloud / @ebottard @pivotal / @projectriff @knativeproject @kubernetesio
Ray Tsang
Developer Advocate
Google Cloud Platform
Spring Cloud GCP
cloud.spring.io/spring-cloud-gcp/
JHipster, JDeferred
Java Champion
@saturnism | saturnism.me

View Slide

Eric Bottard
Sr Software Engineer
Pivotal
Spring Cloud DataFlow
cloud.spring.io/spring-cloud-dataflow/
Project riff
https://projectriff.io/
@ebottard

View Slide

Kubernetes - Looking under the hood
Knative - Why and How
riff - A FaaS on top of Knative
Serving - via a manual deployment
Build - via riff function create
Eventing - via riff function chaining
Spring Cloud Function - platform agnostic functions
End to End - everything we've learned
Things We'll Cover

View Slide

apiVersion: app/v1
kind: Deployment
metadata:
name: helloworld
...
spec:
replicas: 2
template:
...
spec:
containers:
- name: helloworld
image: saturnism/helloworld:v1

View Slide

web browsers
Scheduler
kubectl web browsers
scheduler
Kubelet Kubelet Kubelet Kubelet
Config
file
Kubernetes Master
Container
Image

View Slide

Let's See It

View Slide

Deployment

View Slide

ReplicaSet
Deployment

View Slide

Pod
ReplicaSet
Deployment
Pod

View Slide

Deployment
apiVersion: app/v1
kind: Deployment
metdatdata:
name: nginx
spec:
replicas: 2
template:
...
spec:
containers:
- name: nginx
image: nginx

View Slide

Deployment
Deployment Controller
apiVersion: app/v1
kind: Deployment
metdatdata:
name: nginx
spec:
replicas: 2
template:
...
spec:
containers:
- name: nginx
image: nginx

View Slide

ReplicaSet
Deployment
Deployment Controller Create
apiVersion: app/v1
kind: ReplicaSet
metadata:
name: nginx-1234
spec:
replicas: 2
template:
...
spec:
containers:
- name: nginx
image: nginx

View Slide

ReplicaSet
Deployment
Replication Controller
Create
apiVersion: app/v1
kind: ReplicaSet
metadata:
name: nginx-1234
spec:
replicas: 2
template:
...
spec:
containers:
- name: nginx
image: nginx

View Slide

Pod
ReplicaSet
Deployment
apiVersion: app/v1
kind: Pod
metadata:
name: nginx-1234-k5jv
spec:
...
containers:
- name: nginx
image: nginx
Create
Create
Pod
apiVersion: app/v1
kind: Pod
metadata:
name: nginx-1234-q7jd
spec:
...
containers:
- name: nginx
image: nginx

View Slide

Pod
ReplicaSet
Deployment
Create
Create
Scheduler
Pod
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx

View Slide

Pod
ReplicaSet
Deployment
Create
Create
Scheduler Assign to Node
Pod
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-1
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-2

View Slide

Pod
ReplicaSet
Deployment
Create
Create
Pod
Kubelet
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-1
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-2

View Slide

Pod
ReplicaSet
Deployment
Create
Create
Pod
Kubelet
Start the container!
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-1
status:
...
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-2
status:
...

View Slide

Pod
ReplicaSet
Deployment
Create
Create
Pod
Kubelet
Update Status
Start the container!
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-1
status:
...
apiVersion: app/v1
kind: Pod
metadata:
spec:
...
containers:
- name: nginx
image: nginx
nodeName: node-2
status:
...

View Slide

Pod
ReplicaSet
Deployment
Pod

View Slide

You can write your own
Resource & Controller!

View Slide

apiVersion: apiextensions.k8s.io/v1beta1
kind: CustomResourceDefinition
metadata:
name: gameservers.stable.agones.dev
spec:
group: stable.agones.dev
version: v1alpha1
scope: Namespaced
names:
kind: GameServer
plural: gameservers
shortNames:
- gs
singular: gameserver
Custom Resource Definition
https://github.com/GoogleCloudPlatform/agones

View Slide

metadata:
spec:
version: v1alpha1
scope: Namespaced
names:
kind: GameServer
plural: gameservers
shortNames:
- gs
singular: gameserver
Custom Resource Definition
metadata:
spec:
version: v1alpha1
scope: Namespaced
names:
...
validation:
openAPIV3Schema:
required:
- spec
properties:
spec:
required:
- template
...
With Validation

View Slide

apiVersion: "stable.agones.dev/v1alpha1"
kind: GameServer
metadata:
name: "simple-udp"
spec:
ports:
- name: default
portPolicy: "dynamic"
containerPort: 7654
template:
spec:
containers:
- name: simple-udp
image: gcr.io/agones-images/udp-server:0.4
Custom Resource

View Slide

kind: GameServer
metadata:
name: "simple-udp"
spec:
ports:
- name: default
containerPort: 7654
template:
spec:
containers:
- name: simple-udp
Custom Resource Controller
Game Server Controller

View Slide

kind: GameServer
metadata:
name: "simple-udp"
spec:
ports:
- name: default
containerPort: 7654
template:
spec:
containers:
- name: simple-udp
Deployment
Create

View Slide

kind: GameServer
metadata:
name: "simple-udp"
spec:
ports:
- name: default
containerPort: 7654
template:
spec:
containers:
- name: simple-udp
ReplicaSet
Deployment
Create

View Slide

kind: GameServer
metadata:
name: "simple-udp"
spec:
ports:
- name: default
containerPort: 7654
template:
spec:
containers:
- name: simple-udp
Pod
ReplicaSet
Deployment
Pod
Create

View Slide

Knative

View Slide

Zero to Kubernetes
Kubernetes
Write code
Build docker image
Upload image to registry
Deploy with Deployment
Expose to the internet
HTTP Load Balancing
Scale workload

View Slide

Higher Level Abstraction
Kubernetes
Write code
Build docker image
Upload image to registry
Deploy with Deployment
Expose to the internet
HTTP Load Balancing
Scale workload
Would Be Nice...
Write code :D
Deploy!

View Slide

Building higher level abstraction

View Slide

Introducing Knative
Kubernetes-based
building blocks for
serverless workloads

View Slide

● Set of primitives (Build, Events, Serving)
● Solves for modern development patterns
● Implements learnings from Google, partners
● Ingredient or platform for OSS FaaS frameworks
github.com/knative
Introducing Knative
Kubernetes-based
building blocks for
serverless workloads

View Slide

The Knative stack
Kubernetes
Platform

View Slide

The Knative stack
Kubernetes
Platform
Istio
Service Mesh

View Slide

The Knative stack
Kubernetes
Platform
Istio
Service Mesh
Build
Primitives Serving Events

View Slide

Knative is ... native

View Slide

riff

View Slide

Event driven Function as a Service
Opinionated experience built atop Knative, Kubernetes and Istio
Functions practice Inversion of Control
No servers, ports or HTTP, just your logic
Pick your language runtime:
Java/Spring
JavaScript/Node
executable commands
more from the community
riff is for functions

View Slide

riff on Knative
Community-driven
ecosystem of
Sources,
Channels,
Functions,
Invokers,
BuildTemplates,
etc.
Kubernetes
BuildTemplates
Channels
CLI
Invokers
CLI
Invokers
Build
Topics

View Slide

Target Audience(s)

View Slide

Knative Serving

View Slide

The Knative Serving project provides middleware primitives that enable:
Automatic scaling up and down to zero
Routing and network programming for Istio components
Point-in-time snapshots of deployed code and configurations
Knative Serving

View Slide

Knative Serving defines principled objects
Knative defines primitives with clear separation of concerns
So far, we used Service, a lite version of Knative objects
spec:
container:
image: gcr.io/knative-samples/simple-app:latest
env:
- name: SIMPLE_MSG
value: "Hello GCP Next 2018!"
Service

View Slide

Configuration
Current/desired state for your application
Code & configuration (separated, ala 12 factor)
Configuration
Service

View Slide

Configuration
Revision
Point in time snapshots for your code and configuration
Revision
Configuration
Service

View Slide

Revision
Configuration
Revision
Point in time snapshots for your code and configuration
Route
Maps traffic to a revisions
Supports fractional, named routing
Route
Configuration
Service

View Slide

Revision
Route
Configuration
Knative
Service

View Slide

Revision
Route
Configuration
Knative
Service
Deployment
Kubernetes
Service

View Slide

Revision
Route
Configuration
Knative
Service
ReplicaSet
Deployment
Kubernetes
Service

View Slide

Revision
Route
Configuration
Knative
Service
Pod
ReplicaSet
Deployment
Pod
Kubernetes
Service

View Slide

Revision
Route
Configuration
Knative
Service
Pod
ReplicaSet
Deployment
Pod
Istio Virtual
Service
Kubernetes
Service

View Slide

ServiceCRD - creates route and
configuration, for either latest or pinned
revision
RouteCRD - maps a network endpoint to
one or more revisions, enabling traffic
policy management across revisions
ConfigurationCRD - mutable desired state
for your deployment, with each
modification creating a new revision
RevisionCRD - immutable point-in-time
snapshot for each modification made to the
workload code/config
Knative Serving CRDs

View Slide

Demo: Deploying and updating live service
Blue-green deployment model
Route
100%
Revision
0001
Configuration
kind: Route
...
spec:
traffic:
- revisionName: blue-green-00001
percent: 100

View Slide

kind: Route
...
spec:
traffic:
percent: 100
percent: 0
name: v2
Deploy updated version of the service
● Blue continues to take 100% of traffic
● Named route (v2) to green version
Revision
00002
Route
100%
Revision
00001
0%
v2
Configuration
Configuration

View Slide

Update service configuration
● Send % of traffic to green
● Still have explicit v2 route
kind: Route
...
spec:
traffic:
percent: 50
percent: 50
name: v2
Revision
00002
Route
98%
Revision
00001
2% (Experiment)
Configuration
Configuration

View Slide

Update service configuration
● Incrementally add %, until all traffic is on green
● Keep explicit named route to blue
Secured with RBAC-based ACL
kind: Route
...
spec:
traffic:
percent: 0
name: v1
percent: 100
Revision
00002
Route
0%
v1
Revision
00001
100%
Configuration
Configuration

View Slide

Knative Build

View Slide

A Build is a custom resource in Knative that allows you to define a process that runs to completion and
can provide status. For example, fetch, build, and package your code by using a Knative Build that
communicates whether the process succeeds.
A Knative Build runs on-cluster [...] to build the source code of your apps into container images, which
you can then run on Knative serving.
Knative Build
https://github.com/knative/docs/tree/master/build

View Slide

a BuildCRD = specific instance of a process
made of steps
runs a sequence of images, aka Builders
a BuildTemplateCRD = a recipe for instantiating BuildsCRD.
accepts parameters
runs under a given ServiceAccount
can hold credentials
Key Concepts of Knative Build

View Slide

Knative Build - Plenty to Choose From

View Slide

DEMO

View Slide

Square.js
module.exports = x => x ** 2;

View Slide

W A I T
⏯ ⏪

View Slide

Knative Eventing

View Slide

Knative Events is a system which is designed to address a common need for cloud native development:
1. Services are loosely coupled during development and deployed independently on a variety of
platforms (Kubernetes, VMs, SaaS or FaaS).
2. A producer can generate events before a consumer is listening, and a consumer can express an
interest in an event or class of events that is not yet being produced.
3. Services can be connected to create new applications without modifying producer or consumer.
With the ability to select a specific subset of events from a particular producer
Knative Eventing
https://github.com/knative/docs/tree/master/eventing

View Slide

ChannelCRD is a network endpoint which receives (and optionally persists) events using a
Bus-specific implementation.
SubscriptionCRD connects events received on a Channel to an interested target, represented as a
DNS name. There may be multiple Subscriptions on a single channel.
Bus* defines the adaptation layers needed to implement channels and subscriptions using a
specific persistence strategy (such as delivery of events to a Kafka topic).
Knative Eventing
Also: Sources, Flows
source channel function
flow
subscription

View Slide

A Loosely Coupled Example
square

View Slide

square
correlator
riff service create correlator --image projectriff/correlator:fats

View Slide

numbers square
correlator
riff channel create numbers --cluster-bus stub

View Slide

numbers square
correlator
squares
riff channel create squares --cluster-bus stub

View Slide

riff subscription create --channel numbers --subscriber square
--reply-to squares
numbers square
correlator
squares

View Slide

numbers square
greet
correlator
squares
riff function create command greet \
--image gcr.io/$GCP_PROJECT/riff-sample-greet \
--git-repo
https://github.com/projectriff-samples/command-hello \
--artifact greet.sh \
--verbose

View Slide

numbers square
replies greet
correlator
squares
riff channel create replies --cluster-bus stub

View Slide

riff subscription create -c squares -s greet -r replies
numbers square
replies greet
correlator
squares

View Slide

riff subscription create -c replies -s correlator
numbers square
replies greet
correlator
squares

View Slide

numbers square
replies greet
correlator
squares
/numbers

View Slide

DEMO

View Slide

Kubernetes is extensible
Knative is a platform for platforms
Serving scale to/from zero. Route traffic
Build optionally build from source
Eventing decouple workloads in space / time
riff is a FaaS on top of Knative
Let's Recap

View Slide

Spring Cloud Function

View Slide

Working with Spring Cloud Function
Serverless Functions the Spring way
● Promote the implementation of business logic via functions
● Abstract away the target runtime
○ Supports multiple Function as a Service platform
● Support a uniform programming model across serverless providers
○ Run standalone (locally or in a PaaS).
● Enable Spring Boot features on serverless providers
○ Auto-configuration
○ Dependency injection
○ Metrics

View Slide

A serverless function by itself is ...
● kind of pointless ... we need a way to deploy it and to invoke it
● include the function in an app
● invoke it via a standalone invoker app
● deploy it to a FaaS

View Slide

A function
package com.springdeveloper.demo.functionapp;
import java.util.function.Function;
public class Upper implements Function {
public String apply(String name) {
return name.toUpperCase();
}
}

View Slide

A function invoker
package com.springdeveloper.demo.functionapp;
import java.util.function.Function;
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.context.annotation.Bean;
@SpringBootApplication
public class FunctionAppApplication {
@Bean
public Function uppercase() {
return s -> s.toUpperCase();
}
public static void main(String[] args) {
SpringApplication.run(FunctionAppApplication.class, args);
}
}

View Slide

Let's build something...

View Slide

Spring Cloud GCP
Goals
Provide integration between GCP services and Spring
Meet developers where they are
Cut down on boilerplate code +

View Slide

Feature GCP Service Spring Framework
Authentication Auto credential discovery.
Service Accounts.
Configuration Cloud Runtime Config Spring Cloud Config
Messaging Cloud Pub/Sub Spring Integration
Spring Cloud Stream
Spring Dataflow
Database Cloud SQL
Cloud Spanner
Spring Data
Spring Data Spanner
Storage Cloud Storage Spring Resource
Logging Stackdriver Logging Logback
Trace Stackdriver Trace Spring Cloud Sleuth

View Slide

Vision API
● Analyze what's inside of an image
● Feature detection such as
○ labels (is there a cat?)
○ text extraction
○ facial features and emotion
○ Landmarks
○ Logos
○ safe search
○ ...

View Slide

Kubernetes Basics
Knative - Why and How
riff - A FaaS on top of Knative
Serving - via a manual deployment
Build - via riff function create
Eventing - via riff function chaining
End to End - everything we've learned
Things We Saw

View Slide

Thanks! Give it a try!
Project riff
projectriff.io
Install, Samples, Docs
github.com/knative/docs
Spring Cloud Function, Knative, Riff Code Lab
bit.ly/spring-riff-lab
Want to contribute?
knative/docs/community
Have questions?
knative.slack.com

View Slide

Beyond Kubernetes - Knative, riff, and Spring Cloud Function

Beyond Kubernetes - Knative, riff, and Spring Cloud Function

Ray Tsang

More Decks by Ray Tsang

Other Decks in Technology

Featured

Transcript