Choosing your scheduler wisely

Presentation from the Docker Meetup in Budapest. Part of CraftConf Apr 26, 2017

Transcript

1. CHOOSING YOUR SCHEDULER WISELY magnus.bengtsson@bonniernews.se @cldmnky
2. Scheduler
3. CHOOSING YOUR SCHEDULER WISELY magnus.bengtsson@bonniernews.se @cldmnky
4. Magnus Bengtsson @cldmnky magnus.bengtsson@bonniernews.se
5. agenda Image: https://www.flickr.com/photos/jk-foto/
6. sweden’s bravest development department Image: https://www.flickr.com/photos/usgeologicalsurvey/
7. ~ 350 applications ~ 600 deploys/week ~ 120 developers ~ 1000 containers
8. printed news
9. more print
10. digitalize!
11. the monolith
12. Image: https://www.flickr.com/phot microservices
13. microservices growth
14. containers Image: https://www.flickr.com/phot
15. how to orchestrate containers? Image: https://www.flickr.com/photos/b
16. more on less
17. shorten our ttp
18. != lvl 0
19. pain
20. schedulers
21. orchestration Image: https://www.flickr.com/photos/au
22. clustered schedulers Image:https://www.flickr.com/photo
23. three distinct types
24. monolithic
25. two-level
26. shared state
27. batch jobs
28. service jobs
29. system jobs
30. predicates
31. •(anti-)affinfity •os •capacity •labels / tags
32. priorities
33. scheduler platform wishes
34. cluster health
35. service health
36. interaction
37. • multiple task drivers • persistent volumes • multi-tenancy • role based access control
38. composable 
 &
 extendable
39. alternatives? Image: https://www.flickr.com/photos/piceye/
40. docker/moby swarm kubernetes mesos&marathon nomad
41. docker’s moby’s swarm mode Image: https://www.flickr.com/photos/13
42. $ docker swarm init --advertise-addr <MANAGER-IP>
43. monolithic scheduler
44. batteries included
45. drawbacks
46. kubernetes Image: https://www.flickr.com/photos/atelier_tee/
47. monolithic
48. multiple task drivers
49. Drawbacks
50. mesos & marathon (DC/OS)
51. the two-level scheduler
52. drawbacks
53. nomad Image: https://www.flickr.com/photos/anjan58/
54. shared state
55. drawbacks
56. where are we?
57. Consul - for service discovery Helios - for docker/moby scheduling Haproxy - for service routing Vault - for secrets management Saltstack - for orchestration and auth WeaveNet - for network overlays ohoy - for developers our platform:
58. orchestrator
59. magnus.bengtsson ExpressenAB$ ohoy deploy Usage: ohoy deploy [options] <environment(s)> [application] Options: -h, --help output usage information -j, --jobfile <file> helios job file to deploy -n, --nojobmerge do not merge the jobfile with the default -r, --revision <rev> the revision to deploy -l, --allow-local-commits Allow deploying changes not yet pushed to origin Examples: Deploy node app in current working directory to environment 'production'. App name is picked up from 'package.json': $ ohoy deploy production Deploy revision 'a2jc3Fgb73' of app 'myapp' to environment 'production': $ ohoy deploy -r a2jc3Fgb73 production myapp ohoy
60. how to pick one?
61. the footprint Image: https://c1.staticflickr.com/3/2715/4148630899_d96c2ae16b_b_d.jpg
62. hurdles hurdles Image: https://www.flickr.com/photos/marjonarchive/
63. operability
64. migration-path
65. community
66. self-enablement
67. features
68. kubernetes
69. takeaways Image: https://www.flickr.com/photos/aidanwojtas/
70. • know your platform • lean if possible • composable • self-enablement • tools affect culture
71. thanks! magnus.bengtsson@bonniernews.se @cldmnky
72. menti