Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling infrastructure beyond containers

Scaling infrastructure beyond containers

This is the talk about using Apache Mesos to effectively manage resources in modern infrastructure.

Mateusz Gajewski

September 24, 2015
Tweet

More Decks by Mateusz Gajewski

Other Decks in Technology

Transcript

  1. @wendigo Agenda • Evolution of infrastructure at Allegro, • Why

    Apache Mesos™? • Apache Mesos key concepts, • Future of datacenter and cloud computing?
  2. @wendigo Challenges • cloud not used as cloud ;), •

    high cost of virtualization, • effective resource utilization, • microservice architecture, • spread of new technologies, • heterogenous resources, • scalability, fault tolerance & HA, • performance isolation, • data processing at scale
  3. @wendigo Mesos HA • master election/failover with ZooKeeper, • master

    maintains soft-state, • framework state reconciliation, • slave checkpointing, • slave recovery, • framework checkpointing
  4. @wendigo Beyond offers • offer filters (constraints), • static (pre-startup)

    reservations, • dynamic (post-startup) reservations, • oversubscription, • persistent volumes, • pluggable allocator scheduling policy (fair, priority based)
  5. @wendigo Mesos recap • „programming against the datacenter", • distributed

    datacenter kernel, • two-level multi-resource scheduler, • scalable, highly-available & fault-tolerant, • performance isolation with containers, • exposes homogeneous resources, • elastic, dynamic partitioning, • high resource utilization