Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cloudstack design decisions

Cloudstack design decisions

Cloud operations at scale

Pierre-Yves Ritschard

June 10, 2014

More Decks by Pierre-Yves Ritschard

Other Decks in Technology


  1. SHORT BIO Pierre-Yves Ritschard CTO @ exoscale - The safe

    home for your cloud applications Open Source Developer - pithos, cyanite, riemann, collectd, openbsd Architect of several cloud platforms - paper.li Recovering Operations Engineer
  2. BASIC NETWORKING One IP per VM. Security groups are hypervisor

    controlled layer 2 firewall rules. Provides all the flexibility of a traditionnal firewall, completely API controlled.
  3. THE GOOD CITIZEN CONTRACT new machines have roles role defines

    converged configuration as sum of components each component has an expected normal state and reports it no local intervention needed
  4. CONFIGURATION MANAGEMENT code is a great way to define infrastructure

    ensures homogeneity ability to iterate fast great source of change tracking avoids fear of change
  5. CONFIGURATION MANAGEMENT: PUPPET battle tested tool simple declarative DSL to

    express configuration fits our component approach well
  6. LOGS all application and system logs sent over the wire

    logstash disects and extracts metadata elasticsearch indexes for easy retrieval simple correlation
  7. METRICS all application and system metrics sent over the wire

    by collectd graphite's carbon aggregates and produces appropriate roll- ups if it moves, graph it. if it doesn't, graph it if it starts moving.
  8. ALERTS unbounded stream of log and metric data passive approach

    bodes well with node volatility riemann takes decisions based on stream content ability to extract meaningful information
  9. REMOTE EXECUTION a simple pubsub system recurrent commands stored as

    scenarios command line, HTTP and IRC interaction
  10. A SIMPLE PUBSUB SYSTEM each node runs an agent responsible

    for carrying out commands. commands are sent to groups of nodes (by predicates such as role).
  11. COMMAND LINE, HTTP AND IRC INTERACTION most of our production

    environment can be controlled through our chatroom
  12. SOFTWARE FILLING IN THE GAPS Customer management Real-time metering and

    billing Integrated console A few other things
  13. REAL-TIME METERING AND BILLING can't be tied to a cloudstack

    only solution cloudstack emits useful data ties into our customer management
  14. INTEGRATED CONSOLE integrated experience across our services hides complexity and

    cloudstack specifics exposes exoscale specific features
  15. SMALL SRE TEAM Our platform must be simple to operate,

    additional moving parts must provide business value or help operations
  16. AVOIDING DEPLOY ANXIETY Our software and infrastructure helps ensure we

    have good tools to ensure quiet nights and easily caught errors
  17. LOOKING BACK Cloudstack is a solid foundation for a IAAS

    platform There's a bit more to it than just installing cloudstack Building a sustainable and scalable platform on top of cloudstack is possible