our data processing infrastructure on AWS cloud • At any time around 1500 machines • More than 50 S3 buckets with TBs of data storage • Rapid Multi AZ deployments and much more . . . • SIGNIFICANT COSTS !!
on application metrics ◦ GitHub : https://github.com/indix/vamana ◦ SlideDeck : https://speakerdeck.com/ashwanthkumar/introducing-vamana • Matsya : Placing the auto-scaling in right spot market if available, otherwise fall back to On-Demand ◦ GitHub : https://github.com/indix/matsya ◦ SlideDeck : https://speakerdeck.com/ashwanthkumar/matsya-apr-16 ~ SAVED close to a million dollars a year ~
to regularly track your cost fluctuation is essential. • Several paid solutions are available out there. Other common tools used by the users - AWS Budget/ Netflix Ice/ Trusted Advisor/ Cost Explorer/CloudTrail etc. • Manual effort has to done on Cost Explorer to analyse costs in detail. Why not automate it ?
Reports on daily basis and sends alerts based on user defined cost limits. Inspired from : https://aws.amazon.com/blogs/aws/new-upload-aws-cost-usage-reports-to-redshift-and-quicksight/