fleet: systemd for clusters @ LinuxCon Europe 2014

Transcript

1. fleet systemd for clusters @coreoslinux
2. About Me CTO/CO-FOUNDER systems engineer @brandonphilips github.com/philips
3. Mistakes will be made. Please speak up.
4. what are we all doing? clusters
5. systemd configure, execute, monitor
6. # cat myservice.service [Service] ExecStart=/usr/bin/myservice # systemctl start myservice.service
7. # cat myservice.service [Service] ExecStart=/usr/bin/myservice
8. # cat myservice.service [Service] Environment=”PASSWORD=123” ExecStart=/usr/bin/myservice
9. # cat myservice.service [Service] Environment=”PASSWORD=123” ExecStart=/usr/bin/myservice CPUShares=512 MemoryLimit=1G
10. # cat myservice.service [Unit] Description=My Awesome Service [Service] Environment=”PASSWORD=123” ExecStart=/usr/bin/myservice CPUShares=512 MemoryLimit=1G
11. configuration env variables current working directory users and groups cgroups namespaces CPU affinity dependencies seccomp filters resources limits
12. whats the process doing? monitoring
13. github.com/coreos/go-systemd
14. cluster schedulers how do they work?
15. Warning: advanced graphics ahead
16. SCHEDULE - Task 1 - Task 2 - Task 3 Scheduler API
17. Machine A Machine B Machine C Task 1 SCHEDULE - Task 1 - Task 2 - Task 3 Scheduler
18. Machine A Machine B SCHEDULE - Task 1 - Task 2 - Task 3 Scheduler
19. Machine A Machine B Task 1 SCHEDULE - Task 1 - Task 2 - Task 3 Scheduler
20. Scheduler Agent Machine C Task 1 systemd
21. etcd holder of global state
22. etcd
23. /etc distributed
24. open source software highly available and reliable sequentially consistent watchable exposed via HTTP runtime reconfigurable
25. -X GET Get Wait -X PUT Put Create CAS -X DELETE Delete CAD
26. Available
27. Available
28. Available
29. Unavailable
30. demo!
31. don’t lose stuff conclusion
32. make atomic changes conclusion
33. fleet scheduler & agent
34. # cat myservice.service [Service] ExecStart=/usr/bin/myservice # systemctl start myservice.service
35. # cat myservice.service [Service] ExecStart=/usr/bin/myservice # fleetctl start myservice.service
36. demo!
37. fleet engine take global state & schedule
38. Machine A Machine B Machine C Task 1 SCHEDULE - Task 1 - Task 2 - Task 3 Scheduler
39. machine with this tag require
40. same machine as this require
41. this specific machine require
42. # cat myservice.service [Service] ExecStart=/usr/bin/myservice [X-Fleet] X-Conflicts=notmyservice.service # fleetctl start myservice.service
43. fleet agent run schedule & report state
44. Scheduler Agent Machine C Task 1 systemd
45. demo!
46. service discovery where is this stuff running?
47. do it yourself registration
48. get some help registration
51. fleetctl and API control remotely
52. demo!
53. future work