CoreOS @Railscamp

CoreOS tools and concepts

Transcript

1. Timo Derstappen Co-Founder giantswarm.io @teemow
2. • Minimal Linux to run your containers • Automatic Updates • Cluster Management • Service Discovery What is CoreOS?
3. Linux Basis • Based on Gentoo • Images for PXE, OpenStack, AWS, GCE, Vagrant • Systemd, btrfs • Read-only rootfs (writable overlay)
4. CoreOS own tools • Etcd • Fleet • Locksmith • Cloud-config • Flannel github.com/coreos
5. Etcd • Key/Value store • Basis for ◦ Configuration management ◦ Service Discovery • Raft consensus algorithm • REST Interface
6. Discovery API > curl https://discovery.etcd.io/new https://discovery.etcd. io/463c1435f9f63c952e0899b1f459c0fe
7. Cloud Config • Initialization of your instances • Configure etcd, fleet, locksmith • YAML file • eg. EC2 user data
8. Configure your cluster #cloud-config coreos: etcd: discovery: https://discovery.etcd.io/<token> addr: $private_ipv4:4001 peer-addr: $private_ipv4:7001
9. Locksmith • Reboot strategies for CoreOS updates • Uses etcd for distributed locks • Alpha, Beta, Stable channels
10. Flannel • Overlay networks backed by etcd • Encapsulate packets in UDP • VXLAN implementation coming
11. Fleet • Fleet is systemd for the cluster • Uses etcd • CLI and API to start your containers
12. Fleet Scheduler • Simple (eg. based on Metadata) • But resolves service dependencies! • More to come (eg. based on available resources)
13. Unit file [Unit] Description=A Redis Server [Service] TimeoutStartSec=0 EnvironmentFile=/etc/environment Environment="IMAGE=teemow/redis" ExecStartPre=/usr/bin/docker pull $IMAGE ExecStart=/bin/bash -c "exec /usr/bin/docker run --rm -p $COREOS_PRIVATE_IPV4::6379 --name %n $IMAGE" ExecStop=/usr/bin/docker stop %n
14. Manage a service fleetctl start redis.service fleetctl list-units fleetctl status redis.service fleetctl journal redis.service fleetctl stop redis.service fleetctl destroy redis.service
15. Release it! • Load Balancer • App • Database
16. Sidekick • Keep configuration out of your app
17. Ambassador • Reverse proxy for your service • Keep service discovery out of your app
18. CoreOS • Great foundation to create flexible distributed infrastructures • Unix philosophy
19. Kubernetes • Google Container Orchestration • Runs on top of CoreOS
20. Kubernetes Master kubecfg Minion 1 Minion 2
21. Kubernetes Minion Internet Master kubelet service Etcd
22. cAdvisor • Monitoring for your containers • Collects, aggregates and processes metrics • InfluxDB Backend • Monitoring of clusters with Heapster
23. Deis • Open Source PaaS • used Heroku build packs • now recommends Docker-native builds
24. Panamax • Web interface to start multi container apps • App Templates on Github • Open Source project from CenturyLink Labs
25. • Simple Service Orchestration • Based in Cologne, Germany • Built on top of CoreOS http://giantswarm.io Giant Swarm
26. Timo Derstappen @teemow http://giantswarm.io Thanks for listening!