Taming the public and private clouds with Nomad

Transcript

1. HASHICORP Taming the modern public and private clouds with Nomad Diptanu Gon Choudhury @diptanu PhillyETE 2016
2. HASHICORP Evolution of compute infrastructure 1995 2000 2015
3. HASHICORP Evolution of compute infrastructure
4. HASHICORP Evolution of compute infrastructure Global Public Cloud AWS - US-West-2 AWS - US-East-1 GCP - US-Central-1 Private Clouds Private Clouds
5. HASHICORP Challenges of the modern cloud 10s of 1000s of compute nodes to manage Compute clusters are spread across the globe Static and offline partitioning of clusters are no longer efficient
6. HASHICORP Challenges of the modern cloud Heterogenous API for accessing compute infrastructure Heterogenous primitives for managing network, secrets, etc
7. HASHICORP Evolution of application architecture SOA and Micro Services are replacing monoliths Distributed Systems are the new normal
8. HASHICORP Challenges in running modern services Orchestrated deployment and rollback strategies More modes of failures
9. HASHICORP Cluster Schedulers to the rescue Decouple Work from Resources Better Quality of Service Higher Resource Utilization
10. Nomad HASHICORP Multi-Datacenter Multi-Region Flexible Workloads Job Priorities Bin Packing Large Scale Operationally Simple
11. HASHICORP Nomad as Cluster Scheduler Bin Packing Job Queueing Over-Subscription Higher Resource Utilization Decouple Work from Resources Better Quality of Service
12. HASHICORP Nomad as the Cluster Scheduler Abstraction API Contracts Standardization Higher Resource Utilization Decouple Work from Resources Better Quality of Service
13. HASHICORP Nomad as the Cluster Scheduler Priorities Resource Isolation Pre-emption Higher Resource Utilization Decouple Work from Resources Better Quality of Service
14. HASHICORP Job Specification Declares what to run
15. HASHICORP example.nomad # Define our simple redis job job "redis" { # Run only in us-east-1 datacenters = ["us-east-1"] # Define the single redis task using Docker task "redis" { driver = "docker" config { image = "redis:latest" } resources { cpu = 500 # Mhz memory = 256 # MB network { mbits = 10 dynamic_ports = ["redis"] } } } }
16. HASHICORP Job Specification Nomad determines where and manages how to run
17. HASHICORP Job Specification Abstract work from resources
18. HASHICORP Supports multiple Clouds, DCs and Regions Resources across DCs are presented as single pool Developers can target multiple datacenter in the same job file Unified interface for developers across clouds
19. HASHICORP Unified interface across hybrid clouds AWS GCP Azure On-Prem DC Nomad Job Spec
20. HASHICORP Single Region Architecture SERVER SERVER SERVER CLIENT CLIENT CLIENT DC1 DC2 DC3 FOLLOWER LEADER FOLLOWER REPLICATION FORWARDING REPLICATION FORWARDING RPC RPC RPC
21. HASHICORP Multi Region Architecture SERVER SERVER SERVER FOLLOWER LEADER FOLLOWER REPLICATION FORWARDING REPLICATION REGION B GOSSIP REPLICATION REPLICATION FORWARDING REGION FORWARDING REGION A SERVER FOLLOWER SERVER SERVER LEADER FOLLOWER
22. Nomad HASHICORP Region is Isolation Domain 1-N Datacenters Per Region Flexibility to do 1:1 (Consul) Scheduling Boundary
23. HASHICORP Data Model
24. HASHICORP Evaluations ~= State Change Event
25. HASHICORP Create / Update / Delete Job Node Up / Node Down Allocation Failed
26. HASHICORP External Event Evaluation Creation Evaluation Queuing Evaluation Processing Optimistic Coordination State Updates
27. HASHICORP Scheduler Architecture Concurrent and optimistic scheduling Event Driven invocation of schedulers No head of line blocking for different type of workloads
28. HASHICORP Client Architecture Broad OS Support Host Fingerprinting Pluggable Drivers
29. HASHICORP Drivers Execute Tasks Provide Resource Isolation
30. HASHICORP Containerized Virtualized Standalone Docker Qemu / KVM Java Jar Static Binaries Rocket
31. HASHICORP Containerized Virtualized Standalone Docker Rocket Windows Server Containers Qemu / KVM Hyper-V Xen Java Jar Static Binaries C#
32. HASHICORP Maintainance Primitives First class support for doing maintenance on nodes Drain allocations running on a node nomad node-drain -enable 149cc920 Are you sure you want to enable drain mode for node "149cc920"? [y/N]
33. HASHICORP Service Discovery Aware Allows developers to define services exposed by a job Keep services and checks synced
34. HASHICORP example.nomad job "redis" { task "redis" { ……… service { name = “binstore” tags = [“env:staging”, “stack:beta”] port = “http” check { name = “binstore-http” type = “http” path = “/status” interval = “30s” timeout = “2s” } } ………… } }
35. HASHICORP System Job Scheduler Runs a job on every node on the cluster Great for running monitoring, logging, auditing software
36. HASHICORP Log Management Takes care of rotating logs of services Log forwarding coming soon
37. HASHICORP Thanks! https://github.com/hashicorp/nomad https://www.nomadproject.io/