Managing containers: requirements, options and best practices

Docker Katowice meetup talk, see http://www.meetup.com/Docker-Katowice/events/227010858/

Transcript

1. © 2015 Mesosphere, Inc. All Rights Reserved. MANAGING CONTAINERS: REQUIREMENTS, OPTIONS AND BEST PRACTICES 1 Michael Hausenblas | Docker Katowice | 2015-12-16
2. © 2015 Mesosphere, Inc. All Rights Reserved. sys admin devops developer architect management other
3. © 2015 Mesosphere, Inc. All Rights Reserved. WHAT IS
 CONTAINER ORCHESTRATION? 3
4. © 2015 Mesosphere, Inc. All Rights Reserved. WHAT DOES A SCHEDULER DO? 4
5. © 2015 Mesosphere, Inc. All Rights Reserved. 5
6. © 2015 Mesosphere, Inc. All Rights Reserved. 6
7. © 2015 Mesosphere, Inc. All Rights Reserved. CONTENDERS 7 • Docker Swarm • Kubernetes • Apache Mesos+Marathon • Nomad • Firmament
8. © 2015 Mesosphere, Inc. All Rights Reserved. DOCKER SWARM 8
9. © 2015 Mesosphere, Inc. All Rights Reserved. DOCKER SWARM 9 http://www.slideshare.net/snrism/swarm-container-cluster-service
10. © 2015 Mesosphere, Inc. All Rights Reserved. KUBERNETES 10
11. © 2015 Mesosphere, Inc. All Rights Reserved. KUBERNETES 11 http://k8s.info/cs.html
12. © 2015 Mesosphere, Inc. All Rights Reserved. KUBERNETES 12 http://k8s.info/cs.html
13. © 2015 Mesosphere, Inc. All Rights Reserved. APACHE MESOS+ MARATHON 13
14. © 2015 Mesosphere, Inc. All Rights Reserved. APACHE MESOS + MARATHON 14 http://mesos.berkeley.edu/mesos_tech_report.pdf Marathon
 scheduler Spark
 scheduler Spark
 executor Marathon
 executor Spark
 executor Marathon
 executor Mesos Agent Mesos Agent Mesos Agent Mesos
 Master Standby
 Master Standby
 Master Framework
15. © 2015 Mesosphere, Inc. All Rights Reserved. MARATHON
 APP SPEC 15 { "id": "webserver", "cmd": "python3 -m http.server 8080", "cpus": 0.5, "mem": 32.0, "container": { "type": "DOCKER", "docker": { "image": "python:3", "network": "BRIDGE", "portMappings": [ { "containerPort": 8080, "hostPort": 0 } ] } }, "acceptedResourceRoles": [ "slave_public" ], "constraints": [ [ "hostname", "UNIQUE" ] ] }
16. © 2015 Mesosphere, Inc. All Rights Reserved. MARATHON UI/UX 16
17. © 2015 Mesosphere, Inc. All Rights Reserved. NOMAD 17
18. © 2015 Mesosphere, Inc. All Rights Reserved. NOMAD 18 https://www.nomadproject.io/docs/internals/architecture.html
19. © 2015 Mesosphere, Inc. All Rights Reserved. NOMAD 19 https://www.nomadproject.io/docs/internals/scheduling.html
20. © 2015 Mesosphere, Inc. All Rights Reserved. FIRMAMENT 20
21. © 2015 Mesosphere, Inc. All Rights Reserved. FIRMAMENT 21 http://www.firmament.io/
22. © 2015 Mesosphere, Inc. All Rights Reserved. FIRMAMENT 22 http://www.firmament.io/
23. © 2015 Mesosphere, Inc. All Rights Reserved. STATEFUL SERVICES 23
24. © 2015 Mesosphere, Inc. All Rights Reserved. STATEFUL SERVICES 24 # a stateless, centralized service cat /dev/random # a stateless, distributed service http PUT http://1.2.3.4:8080/v2/apps < app.json # a stateful, centralized service echo 'lolwut' > ./some.dat # a stateful, distributed service hadoop fs -put ./some.dat hdfs:///user/me/some.dat
25. © 2015 Mesosphere, Inc. All Rights Reserved. STATEFUL SERVICES 25
26. © 2015 Mesosphere, Inc. All Rights Reserved. STATEFUL SERVICES: EXPERIMENT 26
27. © 2015 Mesosphere, Inc. All Rights Reserved. OK SMARTY-PANTS, WHICH CONTAINER MANAGEMENT SYSTEM SHOULD I USE? 27
28. © 2015 Mesosphere, Inc. All Rights Reserved. 28 I don't really mind, just DON'T WRITE IT YOURSELF. Pretty please. With sugar on top of it.
29. © 2015 Mesosphere, Inc. All Rights Reserved. 29
30. © 2015 Mesosphere, Inc. All Rights Reserved. 30 COMPARISON
31. © 2015 Mesosphere, Inc. All Rights Reserved. 31 COMPARISON
32. © 2015 Mesosphere, Inc. All Rights Reserved. 32 Use Marathon, Kubernetes, etc. >>
 write your own container manager >>
 manually managing containers http://www.cloudtp.com/2015/11/30/docker-container-landscape/
33. © 2015 Mesosphere, Inc. All Rights Reserved. HANDS-ON 33
34. © 2015 Mesosphere, Inc. All Rights Reserved. LEARNING RESOURCES 34
35. © 2015 Mesosphere, Inc. All Rights Reserved. 35 WHERE CAN
 I LEARN MORE? http://shop.oreilly.com/product/9781939902184.do 35 http://shop.oreilly.com/product/0636920035671.do
36. © 2015 Mesosphere, Inc. All Rights Reserved. 36 WHERE CAN
 I LEARN MORE? http://shop.oreilly.com/product/0636920039952.do https://manning.com/books/mesos-in-action 36
37. © 2015 Mesosphere, Inc. All Rights Reserved. 37 WHERE CAN
 I LEARN MORE? 37 http://shop.oreilly.com/product/0636920043874.do http://www.oreilly.com/webops-perf/free/kubernetes.csp http://mhausenblas.info/dnsd/toc.pdf
38. © 2015 Mesosphere, Inc. All Rights Reserved. 38 WHERE CAN
 I LEARN MORE? http://p24e.io 38 http://k8s.info