Netflix OSS and Kubernetes Building a Microservice based Cloud platform dimitris@harbur.io @spiddy

Dimitris Kapanidis ● Founder and Senior Consultant at Harbur ● Organizer of Docker BCN Meetup ● Member of Docker Captains

No content

No content

How to Handle Peak Traffic?

What will we cover - Use Docker Containers as deployable units - Use Kubernetes as Orchestration Framework - Use Spring Cloud microservices - Use Spring Cloud Config for config management - Use Netflix Eureka for service discovery - Use Amazon AWS as our Cloud provider

Infrastructure at High Level

Why Docker Containers

Containers vs. VMs …

No content

No content

Programmable Infrastructure vs Manual process Streamlined automation

Important Principles

Pets vs Cattle

Immutable Servers

Fault Tolerant Design

The Twelve-Factor App I. Codebase II. Dependencies III. Config IV. Backing services V. Build, release, run VI. Processes VII. Port binding VIII. Concurrency IX. Disposability X. Dev/prod parity XI. Logs XII. Admin processes

Why Kubernetes

Kubernetes Kubernetes is an open-source platform for automating deployment, scaling, and operations of application containers across clusters of hosts, providing container- centric infrastructure Characteristics - Portable: public, private, hybrid, multi-cloud - Extensible: modular, pluggable, hookable, composable - Self-healing: auto-placement, auto-restart, auto- replication, auto-scaling

Imperative vs Declarative ➜ repeat 5 docker run -d redis bfa241fe07c8b50826e349fbb200392d35ef8b91e0d4a95446e6e2285df6d567 9ffe117f66c542770cdc6bcf80d4131639bd34168f499c25cfa2d1a7a8932656 aef96ffc6521232e980fdbc962432766000c0357f31434329a9b843c68b97079 337424bd5adff427dfe69b979e17c42e7cd99b59cac0b61612a924143fbcc617 59c11b8f24a9bc5b7dcfa0810082205234228e20b3dbee02010b9b0601ec9c28 ➜ kubectl run redis --image=redis --replicas=5 deployment "redis" created

http://es.slideshare.net/SpringCentral/spring-boot-microservices-containers-and-kubernetes-how-to

No content

No content

No content

No content

No content

No content

No content

No content

No content

No content

No content

Infrastructure at High Level

Spring Cloud Netflix Eureka

Spring Cloud Netflix Eureka Spring Cloud Netflix provides Netflix OSS integrations for Spring Boot apps through autoconfiguration and binding to the Spring Environment and other Spring programming model idioms. Characteristics - Service Discovery: Eureka instances can be registered and clients can discover the instances using Spring- managed beans - Service Discovery: an embedded Eureka server can be created with declarative Java configuration

Spring Cloud Netflix Eureka http://start.spring.io/

Spring Cloud Netflix Eureka @SpringBootApplication @EnableEurekaServer public class EurekaApplication { public static void main(String[] args) { SpringApplication.run(EurekaApplication.class.class, args); } } src/main/java/com/example/EurekaApplication.java spring.application.name=eureka eureka.client.serviceUrl.defaultZone=http://eureka:8080/eureka/ src/main/resources/bootstrap.properties

Spring Cloud Netflix Eureka ➜ mvn clean install [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building eureka 0.0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ … ➜ java -jar target/eureka-0.0.1-SNAPSHOT.jar . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v1.3.5.RELEASE) 2016-06-14 11:48:10.562 INFO 45242 --- [ main] com.example.EurekaApplication : No active profile set, falling back to default profiles: default …

Spring Cloud Netflix Eureka http://localhost:8080/

Dockerize ➜ echo "FROM bankmonitor/spring-boot" > Dockerfile ➜ cp target/eureka-0.0.1-SNAPSHOT.jar app.jar ➜ captain build [CAPTAIN] No configuration found captain.yml - inferring values [CAPTAIN] Building image spiddy/eureka:latest Step 1 : FROM bankmonitor/spring-boot # Executing 1 build trigger... Step 1 : COPY app.jar /app/app.jar ---> Using cache ---> 1a3a103d7001 Successfully built 1a3a103d7001 ➜ docker run -d -p 8080:8080 spiddy/eureka 984f68a39e894e1a0a63058a95fb4754548a1bae5649cd44feef142a5f1ba12b ➜ curl -s localhost:8080/eureka/apps 1 %

Deploy to Kubernetes ➜ kubectl run eureka --image=spiddy/eureka \ --overrides='{ "spec":{"template":{"spec": {"containers":[{"name":"demo","image":"spiddy/eureka", "imagePullPolicy":"Never"}]}}}}' deployment "eureka" created ➜ kubectl get pods NAME READY STATUS RESTARTS AGE eureka-4130299362-gqdyi 1/1 Running 0 13m ➜ kubectl scale deployment eureka --replicas=5 deployment "eureka" scaled ➜ kubectl get pods NAME READY STATUS RESTARTS AGE eureka-4130299362-ea8pg 1/1 Running 0 4s eureka-4130299362-gqdyi 1/1 Running 0 14m eureka-4130299362-mzdbs 1/1 Running 0 4s eureka-4130299362-ryflq 1/1 Running 0 14m eureka-4130299362-w0c9y 1/1 Running 0 4s

Expose Kubernetes Service ➜ kubectl expose deployment eureka --port 8080 service "config" exposed ➜ kubectl get services -l run=eureka NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE eureka 10.17.139.244 8080/TCP 59m ➜ curl -s 10.17.139.244:8080/eureka/apps 1 UP_3_ UNKNOWN …

Spring Cloud Netflix Eureka

Infrastructure at High Level

Spring Cloud Config

Spring Cloud Config Spring Cloud Config provides server and client-side support for externalized configuration in a distributed system. Characteristics - HTTP, resource-based API for external configuration (name-value pairs, or equivalent YAML content) - Encrypt and decrypt property values (symmetric or asymmetric) - Embeddable easily in a Spring Boot application using @EnableConfigServer

http://start.spring.io/ Spring Cloud Config

src/main/resources/application.properties spring.cloud.config.server.git.uri: https://github.com/spiddy/config-repo @SpringBootApplication @EnableConfigServer @EnableEurekaClient public class ConfigApplication { public static void main(String[] args) { SpringApplication.run(ConfigApplication.class, args); } } src/main/java/com/example/ConfigApplication.java Spring Cloud Config

Spring Cloud Config ➜ mvn clean install [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building config 0.0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ … ➜ java -jar target/config-0.0.1-SNAPSHOT.jar . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v1.3.5.RELEASE) 2016-06-13 17:26:30.262 INFO 32376 --- [ main] com.example.ConfigApplication : No active profile set, falling back to default profiles: default …

Spring Cloud Config ➜ curl -s localhost:8080/demo/test | jq . { "name": "demo", "profiles": [ "test" ], "label": null, "version": "96fe1fa3f8d8ebb726a83ea6070c02aa9ad3a957", "propertySources": [ { "name": "https://github.com/spiddy/config-repo/demo.properties", "source": { "my.message": "Hello world" } }, …

Dockerize ➜ echo "FROM bankmonitor/spring-boot" > Dockerfile ➜ cp target/config-0.0.1-SNAPSHOT.jar app.jar ➜ captain build ➜ docker run -d -p 8080:8080 spiddy/config f2daa49ea9a5886443cb127184f08252b3bd90b8f0fe914c5b7bdf3b87665a82 ➜ curl -s localhost:8080/demo/test | jq .profiles [ "test" ]

Deploy to Kubernetes ➜ kubectl run config --image=spiddy/config \ --overrides='{ "spec":{"template":{"spec": {"containers":[{"name":"demo","image":"spiddy/config", "imagePullPolicy":"Never"}]}}}}' deployment "config" created ➜ kubectl get pods NAME READY STATUS RESTARTS AGE config-3041615316-abqdl 1/1 Running 0 23s ➜ kubectl scale deployment config --replicas=5 deployment "config" scaled ➜ kubectl get pods NAME READY STATUS RESTARTS AGE config-3041615316-7ccta 1/1 Running 0 9s config-3041615316-abqdl 1/1 Running 0 52s config-3041615316-jp0om 1/1 Running 0 9s config-3041615316-jwrux 1/1 Running 0 9s config-3041615316-owig8 1/1 Running 0 9s

Expose Kubernetes Service ➜ kubectl expose deployment config --port 8080 service "config" exposed ➜ kubectl get services -l run=config NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE config 10.26.208.52 8080/TCP 26s ➜ curl -s 10.26.208.52:8080/demo/test | jq .profiles [ "test" ]

Infrastructure at High Level

Spring Cloud Microservices

Spring Boot Spring Boot makes it easy to create stand-alone, production-grade Spring based Applications that you can "just run". Characteristics - Create stand-alone Spring applications - Embed Tomcat, Jetty or Undertow directly (no need to deploy WAR files) - Provide opinionated 'starter' POMs to simplify your Maven configuration - Automatically configure Spring whenever possible - Provide production-ready features such as metrics, health checks and externalized configuration - Absolutely no code generation and no requirement for XML configuration

Spring Cloud Spring Cloud provides tools for developers to quickly build some of the common patterns in distributed systems (e.g. configuration management, service discovery, circuit breakers, intelligent routing, micro-proxy, control bus, one-time tokens, global locks, leadership election, distributed sessions, cluster state) - Circuit Breakers - Global locks - Leadership election and cluster state - Distributed messaging Characteristics - Distributed/versioned configuration - Service registration and discovery - Routing - Service-to-service calls - Load balancing

Spring Cloud Microservice http://start.spring.io/

Spring Cloud Microservice

Spring Cloud Microservice ➜ mvn clean install [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building demo 0.0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ … ➜ java -jar target/demo-0.0.1-SNAPSHOT.jar . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ … ➜ curl -s localhost:8080 Hello World! [ds-MacBook-Pro.local] src/main/resources/bootstrap.properties spring.application.name=demo spring.cloud.config.uri=http://config:8080

Dockerize ➜ echo "FROM bankmonitor/spring-boot" > Dockerfile ➜ cp target/demo-0.0.1-SNAPSHOT.jar app.jar ➜ captain build [CAPTAIN] No configuration found captain.yml - inferring values [CAPTAIN] Building image spiddy/demo:latest Step 1 : FROM bankmonitor/spring-boot # Executing 1 build trigger... Step 1 : COPY app.jar /app/app.jar ---> Using cache ---> 1a3a103d7001 Successfully built 1a3a103d7001 ➜ docker run -d -p 8080:8080 spiddy/demo 393b2c1d84d4c94ce4115af0bfd6816ca546d7b6eee266306d9ed47e00e45533 ➜ curl localhost:8080 Hello World! [393b2c1d84d4]

Deploy to Kubernetes ➜ kubectl run demo --image=spiddy/demo \ --overrides='{ "spec":{"template":{"spec":{"containers":[{"name":"demo","image":"spiddy/demo", "imagePullPolicy":"Never"}]}}}}' deployment "demo" created ➜ kubectl get pods NAME READY STATUS RESTARTS AGE demo-1703894066-8yixg 1/1 Running 0 27s ➜ kubectl scale deployment demo --replicas=5 deployment "demo" scaled ➜ kubectl get pods NAME READY STATUS RESTARTS AGE demo-1703894066-8yixg 1/1 Running 0 53s demo-1703894066-ethep 1/1 Running 0 53s demo-1703894066-hh7is 1/1 Running 0 3m demo-1703894066-jr059 1/1 Running 0 53s demo-1703894066-nbk4l 1/1 Running 0 53s

Expose Kubernetes Service ➜ kubectl expose deployment demo --port 8080 service "demo" exposed ➜ kubectl get services NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE demo 10.22.67.197 8080/TCP 2m kubernetes 10.16.0.1 443/TCP 1h ➜ repeat 10 curl -s 10.22.67.197:8080 Hello World! [demo-1703894066-ethep] Hello World! [demo-1703894066-nbk4l] Hello World! [demo-1703894066-hh7is] Hello World! [demo-1703894066-hh7is] Hello World! [demo-1703894066-hh7is] Hello World! [demo-1703894066-jr059] Hello World! [demo-1703894066-hh7is] Hello World! [demo-1703894066-ethep] Hello World! [demo-1703894066-ethep] Hello World! [demo-1703894066-jr059]

Infrastructure at High Level

What we do We help modernize enterprise development workflows focusing on containers as first-class citizens 1 ½ years running Docker Containers in Production Services - Consulting - Training

What we do Onebox 30% Cost Reduction on AWS servers Bpulse Cloud-Native Infrastructure (AWS,GCP,On-Prem,Azure) Tourism Sector Infrastructure for 22M daily hits

What we do

dimitris@harbur.io @spiddy Thank You!