Scalable Microservices by Sandeep Dinesh

@sandeepdinesh Scalable Microservices gRPC and Kubernetes and Containers oh my!
@sandeepdinesh Sandeep Dinesh, Cloud Developer Advocate

@sandeepdinesh Have you heard of our lord and savior, Microservices?

@sandeepdinesh Google Trends: Microservices

@sandeepdinesh “Write programs that do one thing, and do it
well. Write programs that work together” - Unix Philosophy UNIX

@sandeepdinesh Why Microservices? Scalability Security Polyglot Development Maintainability Continuous Deployment
Decentralization Robustness

@sandeepdinesh Why Microservices? Scalability Security Polyglot Development Maintainability Continuous Deployment
Decentralization Robustness How?

Everything at Google runs in containers We launch over 2
billion containers per week. • Gmail, Web Search, Maps, ... • MapReduce, batch, ... • GFS, Colossus, ...

@sandeepdinesh Kubernetes Borg Stubby

@sandeepdinesh Kubernetes

@sandeepdinesh App A

@sandeepdinesh Replication Controller App A

@sandeepdinesh Replication Controller App A App A App A App
A

@sandeepdinesh Replication Controller Service A App A App A App
A App A

@sandeepdinesh Microservice A

@sandeepdinesh That’s it!

@sandeepdinesh Microservice A Microservice C Microservice D Microservice B

@sandeepdinesh Microservice A Microservice C Microservice D (2.0) Microservice B

@sandeepdinesh Let’s build

@sandeepdinesh JavaScript var http = require('http'); var server = http.createServer(function
(request, response) { response.writeHead(200, {"Content-Type": "text/plain"}); response.end("Hello World\n"); }); server.listen(3000); App

@sandeepdinesh Bash $ docker build -t gcr.io/<project>/frontend:1.0 $ gcloud docker
push gcr.io/<project>/frontend:1.0 Build the Container

@sandeepdinesh YAML apiVersion: v1 kind: ReplicationController metadata: labels: name: frontend
name: frontend spec: replicas: 2 selector: name: frontend Frontend Replication Controller template: metadata: labels: name: frontend spec: containers: - image: gcr.io/project-id/frontend:1.0 name: frontend ports: - containerPort: 3000 name: http-server

@sandeepdinesh Bash $ kubectl create -f frontend-controller.yaml Launch the Controller

@sandeepdinesh YAML apiVersion: v1 kind: Service metadata: name: frontend labels:
name: frontend spec: type: LoadBalancer Frontend Service ports: - port: 80 targetPort: 3000 protocol: TCP selector: name: frontend

@sandeepdinesh Bash $ kubectl create -f frontend-service.yaml Launch the Service

@sandeepdinesh

@sandeepdinesh What about Communication?

@sandeepdinesh Microservice A Microservice C Microservice D Microservice B

@sandeepdinesh “The biggest issue in changing a monolith into microservices
lies in changing the communication pattern.” - Martin Fowler

O(1010) RPCs per second at Google

@sandeepdinesh

@sandeepdinesh Protocol Buffers

message HelloRequest { string greeting = 1; } message HelloResponse
{ string reply = 1; } service HelloService { rpc SayHello(HelloRequest) returns (HelloResponse); } IDL (Interface definition language) Describe once and generate interfaces for any language. Data Model Structure of the request and response. Binary format for network transmission. Wire Format Protocol Buffers

@sandeepdinesh Protocol Buffers HTTP/2

@sandeepdinesh HTTP/2 HTTP/1.1 http://www.http2demo.io/

Multiplexing Bidirectional Streaming Flow Control HTTP/2 No more polling, sockets,
or clunky SSE Control your congestion Single TCP connection

@sandeepdinesh Protocol Buffers HTTP/2 Multiple Languages

Multiple Languages C/C++

@sandeepdinesh Protocol Buffers HTTP/2 Multiple Languages Mobile First

@sandeepdinesh Let’s upgrade our app

@sandeepdinesh ProtoBuff package geo; service GeoService { rpc DistanceBetween (Points)
returns (Distance) {} } message Point { float lat = 1; float lng = 2; } message Points { Point origin = 1; Point destination = 2; } message Distance { float distance = 1; } .proto

@sandeepdinesh JavaScript var grpc = require('grpc'), proto = grpc.load('interface.proto'), GeoService
= grpc.buildServer([proto.geo.GeoService.service]); Backend Code

@sandeepdinesh JavaScript var server = new GeoService({ 'geo.GeoService': { distanceBetween:
function(call, callback) { callback(null, getDistance(call.request)); } } }); Backend Code

@sandeepdinesh JavaScript function distance(a,b,c,d){//haversine formula stuff} function getDistance(points){ return distance(points.origin.lat,
points.origin.lng, points.destination.lat, points.destination.lng); } Backend Code

@sandeepdinesh JavaScript server.bind('0.0.0.0:50051'); server.listen(); Backend Code

@sandeepdinesh Bash $ docker build -t gcr.io/<project>/backend:1.0 $ gcloud docker
push gcr.io/<project>/backend:1.0 Build the Container

@sandeepdinesh JavaScript var grpc = require('grpc'), proto = grpc.load('interface.proto'), client
= new proto.geo.GeoService('backend:50051'); Frontend Code

@sandeepdinesh JavaScript var request = { origin: { lat: 0,
lng: 0 }, destination: { lat: 15, lng: 15 } } Frontend Code

@sandeepdinesh JavaScript client.distanceBetween(request, function(error, distance) { if (error) { response.end(JSON.stringify(error));
} else { response.end("Distance = " + JSON.stringify(distance) + "\n"); } }); Frontend Code

@sandeepdinesh Bash $ docker build -t gcr.io/<project>/frontend:2.0 $ gcloud docker
push gcr.io/<project>/frontend:2.0 Build the Container

@sandeepdinesh YAML apiVersion: v1 kind: ReplicationController metadata: labels: name: backend
name: backend spec: replicas: 4 selector: name: backend Backend Replication Controller template: metadata: labels: name: backend spec: containers: - image: gcr.io/project-id/backend:1.0 name: backend ports: - containerPort: 50051 name: grpc-server

@sandeepdinesh Bash $ kubectl create -f backend-controller.yaml Launch the Controller

@sandeepdinesh YAML apiVersion: v1 kind: Service metadata: name: backend labels:
name: backend spec: Backend Service ports: - port: 50051 targetPort: 50051 selector: name: backend

@sandeepdinesh Bash $ kubectl create -f backend-service.yaml Launch the Service

@sandeepdinesh Bash $ kubectl rolling-update frontend \ --image=gcr.io/smart-spark-93622/frontend:2.0 \ --update-period="5m"
Upgrade the Frontend

@sandeepdinesh

@sandeepdinesh Kubernetes k8s.io grpc.io

@sandeepdinesh Google Container Engine

Thank you! Thank you! Kubernetes: k8s.io gRPC: grpc.io Code: git.io/v4S8y
Me: @sandeepdinesh Slack: bit.ly/gcp-slack Cloud: cloud.google.com

Scalable Microservices by Sandeep Dinesh

Scalable Microservices by Sandeep Dinesh

More Decks by API Strategy & Practice Conference

Other Decks in Technology

Featured

Transcript