Comeback of Grids

The year 2015 put containers in the spotlight, but now that everyone is using Docker it is time to put containers in production. Grid clusters are again on the rise, this time in the form of Google Kubernetes, Docker Swarm, Amazon ECS and Mesosphere just to name a few. This talk will explain the basic principles of how grids solve problems related to managing large fleets of containers, and what new challenges grids introduce to application developers.

Presented at http://www.meetup.com/London-DevOps/events/229579550/ and at https://devcontlv-march2016.events.co.il/

Transcript

1. The Comeback of Grids aka. Compute Clusters
2. Evgeny Zislis Co-Founder / CTO www.devops.co.il www.devopspro.co.uk
3. Agenda • Buzzing trends in Soft. Architecture • Containers • Schedulers • Containers inside schedulers
4. architecture of SaaS applications
5. aws.amazon.com/architecture Software HA
6. _...still Software HA_
7. monolithic vs. micro yobriefca.se/blog/2013/04/29/micro-service-architecture/ Circa 2000 Circa 2014
8. What is MicroServices Architecture? Loosely coupled service oriented architecture with bounded contexts not updated at the same time minimal knowledge of own environment
9. monitoring configuration router layout data access queue cache scheduler micro services infrastructure services authentication authorization form handling file uploads web scraping indexing searching application services e-mail pdf generation payments workflow engine pagination load balancer
10. Death-star graph of microservices at Netflix
11. “If you can’t feed a team with two pizzas, it’s too large. That limits a task force to five to seven people, depending on their appetites” - Jeff Bezos medium.com/@benorama/ the-evolution-of-software-architecture-bd6ea674c477
12. Gartner Hype Cycle
13. last three years... Docker Containers
14. Docker API host containers
15. time to provision in seconds 10000 100 1 Bare Metal VM Container
16. kubernetes Orchestration
17. kubernetes mesos / marathon or Orchestration
18. kubernetes coreos / fleet geard mesos or or or Orchestration
19. Discovery kubernetes coreos / fleet geard mesos or or or consul helios etcd centurion
20. Infrastructure kubernetes coreos / fleet geard mesos or or or consul helios etcd centurion EC2 Rack space GCE DO Tutum Heroku
22. Mesos is a Distributed OS kernel • • • • • mesosphere.com/blog/2015/04/23/apple-details-j-a-r-v-i-s-the-mesos-framework-that-runs-siri/ www.wired.com/2013/03/google-borg-twitter-mesos
24. Mesos - abstract resource manager virtual machines docker App A App A MESOS host | host | host | host | host | host
25. blog.twitter.com/2012/incubating-apache-mesos nerds.airbnb.com/introducing-chronos/ dev.hubspot.com/blog/mesos-hubspot-and-the-singularity ebaytechblog.com/2014/05/12/delivering-ebays-ci-solution-with-apache-mesos-part-ii/
26. mesosphere.com/blog/2015/11/10/mesos-nvidia-gpus/
27. mesosphere.com/blog/2015/08/20/mesos-everywhere-apache-mesos-for-windows-server/ Mesos on Windows Server
28. but, but ... What about Containers?
29. github.com/mesosphere/marathon • Highly available schedulers • Constraints for application instances • Service discovery - DNS & Load balancing • Health checks • Event subscription endpoint • Graphical UI • JSON / REST APIs for scriptability • Metrics Mesosphere Marathon
30. • Docker compatible • Grid/cluster management • AWS APIs • Custom & default scheduler • Docker Compose support for local dev • Monitoring / Logging • Custom docker repositories + AWS Repo Elastic Container Service
31. • Self healing • Service discovery & load balancing • Secrets & config management • Automated rollouts & rollbacks • Storage orchestration • Automatic binpacking
32. Docker Swarm • Docker Engine API • Integrated Networking & Volumes • High Scalability - 1k hosts 50k containers • High Availability with failovers • Pluggable scheduler • Pluggable host discovery
33. • Task Groups == K8s Pods == Docker Compose • Service discovery - Consul • Health checks - HTTP • Containers - or - ◦ Docker / Rocket / runc … ◦ Single binary apps: Java / Go / … • or! Virtual Machines (like OpenStack Nova) • “Run Everywhere”, “Batch”, “Service”, “Cron” • Constraints • Multi Datacenter + Continental • Easy installation using GO & single binary • Lack of Zookeeper - uses Consul instead • Monitoring • Pluggable service discovery: Consul / ZK / etcd / … • Self healing • Automatic binpacking • Orhestration of tasks on Windows
37. Thank you! We invite you to join Operations UK Facebook group on dvps.me/OpsUK www.devopspro.co.uk