Tweet
Tweet

Slide 1

Slide 1 text

Autoscaling Best Practices FOSDEM’14 Marc Cluet DevOps & Automation Advisory Rackspace http://www.flickr.com/photos/gozalewis/3422530465/

Slide 2

Slide 2 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Who am I?! Marc Cluet (@lynxman) More than 16 years of experience as a SysAdmin Founding member of Juju and MAAS while at Canonical Leading a DevOps Engineering Team at Rackspace Likes DevOps, programming and long walks on the beach

Slide 3

Slide 3 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Rackspace?! Founded in 1998 in San Antonio, TX by three guys that wanted to create a hosting company Home of Fanatical Support /o/ Second biggest Public Cloud in the world OpenStack Project co-founder

Slide 4

Slide 4 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?!

Slide 5

Slide 5 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?! WASTED! $$$!

Slide 6

Slide 6 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?!

Slide 7

Slide 7 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?! The ability to automatically or semi- automatically scale up and down a group of servers based on computing or traffic demand by provisioning new services!

Slide 8

Slide 8 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/fischerfotos/7419253200/

Slide 9

Slide 9 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns!

Slide 10

Slide 10 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! ON & OFF! Analytics! Banks/Tax Agencies! Test environments!

Slide 11

Slide 11 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! FAST GROWTH! Events! Business Growth! Slashdot Effect!

Slide 12

Slide 12 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! VARIABLE! News & Media! Event Registrations! Rapid fire sales!

Slide 13

Slide 13 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! CONSISTENT! HR Application! Accounting/Finance! E-mail!

Slide 14

Slide 14 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/maximalideal/3356408693/

Slide 15

Slide 15 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Methodologies! Time Based! Reactive! Predictive!

Slide 16

Slide 16 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server

Slide 17

Slide 17 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server 9:00am!

Slide 18

Slide 18 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server Nov 1st!

Slide 19

Slide 19 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server Server

Slide 20

Slide 20 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! GOOD FOR! On & Off! Consistent!

Slide 21

Slide 21 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 60% Server 60%

Slide 22

Slide 22 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 80% Server 80%

Slide 23

Slide 23 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 60% Server 60% Server 40%

Slide 24

Slide 24 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 30% Server 30% Server 30%

Slide 25

Slide 25 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 45% Server 45%

Slide 26

Slide 26 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! GOOD FOR! Fast Growth! Variable!

Slide 27

Slide 27 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server

Slide 28

Slide 28 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server Forecasted! Traffic! +30%!

Slide 29

Slide 29 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server Server

Slide 30

Slide 30 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! GOOD FOR! Fast Growth! Variable!

Slide 31

Slide 31 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/samuraislice/3309481048/

Slide 32

Slide 32 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools!

Slide 33

Slide 33 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Amazon Cloudformation! Based on Scaling Groups! High/Low Watermark! Scheduled Events! Uses base image + CF!

Slide 34

Slide 34 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Rackspace Autoscale! Based on Scaling Groups! High/Low Watermark! Scheduled Events! Uses Gold Image!

Slide 35

Slide 35 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Rightscale Autoscale! Based on Scaling Groups! High/Low Watermark Quorum! Scheduled Events! Uses Rightscale scripts! $$$!

Slide 36

Slide 36 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Heat! Based on Templates! High/Low Watermark! Scheduled Events! Uses Heat Scripts! DSL Compatible with CF!

Slide 37

Slide 37 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Scryer! Based on AI! Predictive Fidelity model! Feeds AWS API!

Slide 38

Slide 38 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Your own!! Collect your metrics! !collectd, diamond, statsd! Have a good metrics database! !whisper, rrd!

Slide 39

Slide 39 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Your own!! Write your own autoscaling code! !with message queues! :)! !attached to your code! !brain close to the centre of decision!

Slide 40

Slide 40 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/68751915@N05/6355318323/

Slide 41

Slide 41 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Beware of the Kraken!! Autoscaling can be dangerous! Have min-max allocations! http://www.flickr.com/photos/liquidnight/5992114196/

Slide 42

Slide 42 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Choose the right metrics! Stay with basic metrics! !CPU, mem, I/O disk/net! Review autoscaling strategy with metrics!

Slide 43

Slide 43 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Choose your strategy! Scale up early! Scale down slowly! Don’t apply the same strategy to all apps!

Slide 44

Slide 44 text

RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Phasing in and Phasing Out! Have in mind time to availability! Have in mind also decommission time! Golden Images can help speed!

Slide 45

Slide 45 text

45 RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.CO.UK RACKSPACE® HOSTING | 5 MILLINGTON ROAD | HAYES, UNITED KINGDOM UB3 4AZ UK SALES: +44 (0)20 8712 6507 | UK SUPPORT: 0800 988 0300 | WWW.RACKSPACE.CO.UK @lynxman! http://slideshare.net/lynxmanuk/! http://www.rackspace.co.uk/technicalservices/ ! !