NOMAD Mans Matulewicz

Infrastructure Developer @ Ordina Twitter: @Mans_M Github: @MansM [email protected]

What is Nomad? § Distributed § Optimistically concurrent § Scheduler

What is a scheduler? In short: A scheduler maps sets of work to a set of resources

Schedulers around us

Why do you want a scheduler? § Higher resource utilization − Bin packing − Over-subscription − Job queueing

Scheduling § You decide what to run § Nomad decides where and how to run − But you can force Nomad’s hands by using constraints (examples coming up)

Workloads Nomad can schedule § Docker containers § Rkt containers § Java § Isolated exec (chroot) § Raw exec § Qemu VM’s

Job types § Service § Batch § System

Jobs § nomad run jobfile.nomad job “name” { group “name” { task “name” { driver resources } } }

Jobs Note: for a single task, you don’t need to create a taskgroup, as the group is created implicitly.

Jobs - Constraints § Force Nomad’s hand on a scheduling location § Can be on job, taskgroup and/or task level § Hostname, kernel.version, os.name, os.version, platform.aws.ami-id, platform.aws.instance-type, arch, driver.docker.version, etc

Jobs - Service Discovery • Consul needs to be installed on client machines • No need for in-container Consul agents • Nomad will register and deregister nodes/services

Service Discovery § Container provides a service § Container runs service on unknown port § Consul-template queries Consul server for values and reloads nginx with new config file

Jobs - Restart container

Jobs - Restarts § Sorry Bryan § Note: batch jobs have slightly different defaults!

Jobs - Scaling

Jobs - Updates

Jobs - Periodic

Local development § Make sure docker env vars are set if you want docker driver active § Fingerprinter of Mac instead of Docker host

Resources (Docker) § CPU − Based on shares − Will only kick in when Nomad client machine is under load § Memory − Based on total virtual memory, no swapping − Hard limit, app can crash or terminate when using more than specified! § Diskspace − Amount of GB’s that is required (including logs) § IO (Network planned for later releases)

How to install Nomad § Install Nomad servers § Connect the Nomad servers to each other § Install the Nomad clients and connect them to the servers § Run the workloads!

Unofficial roadmap § 0.4 − Persistent volumes − Multiple network cards − Enhancements to logging (Source: 0.3.0 release notes (current)) − ACL’s (Source: GitHub issue #589) § 0.5 − Vault (Source: Jim Benson ( Hashicorp solution eng @ Hashicorp meetup AMS March) § Hashicorp has not released an official roadmap

What I don’t like about Nomad § No UI

Demo setup

Demo

Questions § I might even have some answers § (and otherwise the guys after me)