Introduction to Docker support in Apache Mesos

Introduction to Apache Mesos and small preview of Mesos 0.20 Docker support.

Transcript

1. APACHE MESOS Isabel Jimenez @ijimene Wednesday, August 20, 14
2. WHO I AM OPW Intern for Apache Mesos Wednesday, August 20, 14
3. OPEN SOURCE CLUSTER MANAGER FOR SHARING DISTRIBUTED APPLICATIONS FRAMEWORKS Wednesday, August 20, 14
4. CLUSTER MANAGER Wednesday, August 20, 14
5. RESOURCE MANAGER Wednesday, August 20, 14
6. RESOURCE NEGOTIATOR Wednesday, August 20, 14
7. MOTIVATION Wednesday, August 20, 14
8. Wednesday, August 20, 14
9. Applications need: a computer Wednesday, August 20, 14
10. Wednesday, August 20, 14
11. Applications need: a computer computers Wednesday, August 20, 14
12. Wednesday, August 20, 14
13. Applications need: a computer computers a datacenter Wednesday, August 20, 14
14. PaaS (Services) datacenter datacenter applications Wednesday, August 20, 14
15. datacenter datacenter applications PaaS (Services) STATIC PARTITIONING Wednesday, August 20, 14
16. Poor Utilization and Low Elasticity Wednesday, August 20, 14
17. PaaS (Services) ↓ CPU ↑ MEM ↑ CPU ↓ MEM Wednesday, August 20, 14
18. High Operational Overhead Wednesday, August 20, 14
19. PaaS (Services) Ops Wednesday, August 20, 14
20. All problems in computer science can be solved with another level of indirection. Wednesday, August 20, 14
21. PaaS (Services) datacenter kernel ? Wednesday, August 20, 14
22. PaaS (Services) S S S S” S” S” S’ S’ S’ datacenter kernel ? Wednesday, August 20, 14
23. PaaS (Services) mesos-slaves mesos-master S S S S” S” S” S’ S’ S’ Wednesday, August 20, 14
24. CLUSTER MANAGER Wednesday, August 20, 14
25. Framework mesos-slaves mesos-master Wednesday, August 20, 14
26. mesos-slaves mesos-master OFFER 1 CPU 1GB MEM Framework Wednesday, August 20, 14
27. mesos-slaves mesos-master LAUNCH TASK T Framework Wednesday, August 20, 14
28. mesos-slaves mesos-master LAUNCH TASK T Framework Wednesday, August 20, 14
29. mesos-slaves mesos-master T Framework Wednesday, August 20, 14
30. mesos-slaves mesos-master TASK RUNNING Framework T Wednesday, August 20, 14
31. mesos-slaves mesos-master TASK RUNNING Framework T Wednesday, August 20, 14
32. mesos-slaves mesos-master Framework T TASK TERMINATED Wednesday, August 20, 14
33. mesos-slaves mesos-master Framework T TASK TERMINATED Wednesday, August 20, 14
34. Framework mesos-slaves mesos-master Wednesday, August 20, 14
35. mesos-slaves mesos-master OFFER 1 CPU 1GB MEM Framework Wednesday, August 20, 14
36. mesos-slaves mesos-master LAUNCH TASK T Framework Wednesday, August 20, 14
37. mesos-slaves mesos-master LAUNCH TASK T Framework Wednesday, August 20, 14
38. mesos-slaves mesos-master T Framework E T Wednesday, August 20, 14
39. mesos-slaves mesos-master T Framework E T T Wednesday, August 20, 14
40. mesos-slaves mesos-master TASK RUNNING Framework E Wednesday, August 20, 14
41. mesos-slaves mesos-master TASK RUNNING Framework E Wednesday, August 20, 14
42. mesos-slaves mesos-master Framework E Wednesday, August 20, 14
43. Enable running multiple distributed systems on the same cluster of machines and dynamically share the resources more efficiently! Wednesday, August 20, 14
44. Provide common functionality every new distributed system re-implements like failure detection, task distribution, task starting, task monitoring, task killing, task cleanup! Wednesday, August 20, 14
45. Distributed systems built purely on Mesos: Aurora Marathon Chronos Singularity Standalone systems that run on Mesos: Spark Storm Jenkins Hadoop And many more! Wednesday, August 20, 14
46. DOCKER SUPPORT IN MESOS Wednesday, August 20, 14
47. HISTORY CONTEXT • 2011 LXC • 2012 Cgroups • 2013 Docker (preliminary) • 2014 External Containerizer • Last week Docker 1st class citizen Wednesday, August 20, 14
48. EXTERNAL CONTAINERIZER • Default containerization is done through internal containerizer component. • This adds support for external containerization programs. • Alpha released Wednesday, August 20, 14
49. mesos-slave MesosContainerizer Executor Task Task container Task container CPU Isolator Mem Isolator ... Disk Isolator MESOS CONTAINERIZER Wednesday, August 20, 14
50. mesos-slave External Containerizer Executor Task Task container EXTERNAL CONTAINERIZER Wednesday, August 20, 14
51. mesos-slave External Containerizer Executor Task Task container Executor container docker external EXTERNAL CONTAINERIZER Task Task Wednesday, August 20, 14
52. Wednesday, August 20, 14
53. mesos-slave MesosContainerizer Executor Task Task container CPU Isolator Mem Isolator ... Wednesday, August 20, 14
54. mesos-slave MesosContainerizer Executor Task Task container CPU Isolator Mem Isolator ... DockerContainerizer Docker Image Docker Image container Wednesday, August 20, 14
55. #MESOSCON! August 21,22 2014 Sheraton Chicago http://events.linuxfoundation.org/events/mesoscon Wednesday, August 20, 14
56. THANK YOU! Isabel Jimenez @ijimene mesos.apache.org Wednesday, August 20, 14
57. user@mesos.apache.org dev@mesos.apache.org IRC : #mesos Wednesday, August 20, 14