Slide 1

Slide 1 text

3 Ways to get Capacity Utilization Wrong Jason Simpson

Slide 2

Slide 2 text

www.netuitive.com 2 Capacity Utilization Metric • A metric used to measure the rate at which potential output levels are being met or used

Slide 3

Slide 3 text

www.netuitive.com 3 Capacity Utilization Rate • Usually expressed as a percentage, it is computed by dividing the total capacity with the portion being utilized 100 50 0 75 units / 100 units capacity = .75 (75%) Utilization

Slide 4

Slide 4 text

www.netuitive.com 4 So that is easy… • Now just monitor the CPU metric to understand the capacity utilization

Slide 5

Slide 5 text

www.netuitive.com 5 So how did I get it wrong? • Most times a single metric will not give the full picture for capacity

Slide 6

Slide 6 text

www.netuitive.com 6 Need to find more metrics… • What key metrics make up the capacity utilization CPU, Memory, I/O, Network Speed, Queue Length, etc.

Slide 7

Slide 7 text

www.netuitive.com 7 Multiple metrics and still not right… • Understanding the high water mark for metrics is essential when calculating capacity

Slide 8

Slide 8 text

www.netuitive.com 8 How do we find total capacity… • Some times it is as simple as pulling attributes (or metadata) about the metric and other times the metric will need to be observed 4 GB RAM, 45 TPM

Slide 9

Slide 9 text

www.netuitive.com 9 Don’t toss in the towel… • Applying best practices and subject matter expertise are required

Slide 10

Slide 10 text

www.netuitive.com 10 What is this computed metric… • Creating computed metrics is required in most capacity utilization measurements (X IOPS/sec / 300 total IOPS/sec ) = Y (%) Utilization

Slide 11

Slide 11 text

www.netuitive.com 11 Takes some trial and error… • Unfortunately for most complex systems it will take some tuning to get correct You tried your best and you failed miserably. The lesson is, never try

Slide 12

Slide 12 text

www.netuitive.com 12 Capacity falls into two buckets… • Macro trend – expected capacity • Micro trends – unexpected capacity

Slide 13

Slide 13 text

www.netuitive.com 13 Planning verse real time… • Capacity planning is for macro trends and real time monitoring addresses micro trends Performance and capacity meet

Slide 14

Slide 14 text

www.netuitive.com 14 Applying best practices… • Create capacity utilization metrics from industry practices (Z Run Queue / X CPU#)*100 = Y (%) Utilization

Slide 15

Slide 15 text

www.netuitive.com 15 Don’t fall into old habits… • Over provisioning infrastructure, applications, and services

Slide 16

Slide 16 text

www.netuitive.com 16 Leveraging tools… • Automation is a goal for DevOps

Slide 17

Slide 17 text

www.netuitive.com 17 Getting automation correct… • Tying capacity utilization to automation helps to ensure systems have been provisioned correctly My system auto-provisioned 36 instances but should I leave them running ?

Slide 18

Slide 18 text

www.netuitive.com 18 Icing on the cake… • Behavior learning technologies coupled with metric correlation can assist with building accurate capacity utilization metrics

Slide 19

Slide 19 text

www.netuitive.com 19 Putting it all together… • Example capacity utilization for Amazon Web Services (AWS) Infrastructure as a Service (IaaS)

Slide 20

Slide 20 text

www.netuitive.com 20 Recap top 3 items… 1. Many times a single metric will not give the full picture for capacity 2. Understanding the high water mark for the metrics is essential when calculating capacity 3. Applying best practices and subject matter expertise are required