Auto Scaling with Ruby, AWS, Jenkins and Redis 

hello! I am JeDDie A software engineer. A Rails Girls volunteer. 

Auto Scaling with Ruby, AWS, Jenkins and Redis 

1. Auto Scaling? Scalability. 

“ Methods of adding more resources for a particular application fall into two broad categories: horizontal and vertical scaling. http://en.wikipedia.org/wiki/Scalability Michael, Maged; Moreira, Jose E.; Shiloach, Doron; Wisniewski, Robert W. (March 26, 2007). "2007 IEEE International Parallel and Distributed Processing Symposium" 

Scale Vertically ▸ Scale up and down about SCALABILITY Scale Horizontally ▸ Scale out scale up scale down 1 4 

Okay, and WHY? needs auto scaling 

about our office ❤ Taiwan 

Place your screenshot here Content Matters When the live show attracts people, they will become audience right away. 

柯P：一個更好的台北 2014-11-29 158,157 clicks 10,400 ccu 

2. Amazon Web Services What we need for auto scaling. 

AWS require “aws” auto_scaling = ec2 + cli + elb + elasti_cache 

3. Amazon EC2 Elastic Compute Cloud 

Amazon EC2 ▸ Amazon Elastic Compute Cloud ○ “A web service that provides resizable compute capacity in the cloud” ○ “Designed to make web-scale cloud computing easier for developers” ■ Scale up/down; start, stop, terminate...etc. EASY management with a great UI. 

AMI ▸ Amazon Machine Images ○ “A template for the root volume for the instance (for example, an operating system, an application server, and applications)” A script of an instance. 

4. AWS CLI Command Line Interface 

AWS CLI ▸ AWS Command Line Interface ○ “A unified tool to manage your AWS services” ■ AWS CLI and AWS EC2 CLI ■ Github ● aws/aws-sdk-ruby ● aws/aws-cli ○ Access key ■ AWS Identity and Access Management (IAM) API. 

Process of Launching Instance Launch instance using image Allocate IP Associate IP with instance 

`ec2-run-instances #{AMI_ID} #{REGION} #{GROUP} #{SUBNET} #{INSTANCE_TYPE} #{BLOCK_DEVICE_MAPPING}` Launch an Instance Using an Image. launch instance Image ID security group small? large? additional store volume 

ec2-run-instances ec2-run-instances ami-1a2b3c4d -s subnet-1a2b3c4d -t c1.medium OUTPUT> RESERVATION r-1a2b3c4d 111122223333 INSTANCE i-1a2b3c4d ami-1a2b3c4d pending c1.medium YYYY-MM-DDTHH:MM:SS+0000 10.0.0.146 … from Amazon doc 

`ec2-allocate-address -d vpc #{REGION}` Allocate an Elastic IP for use. virtual private cloud 

ec2-allocate-address ec2-allocate-address -d vpc OUTPUT> ADDRESS 198.51.100.1 vpc eipalloc-5723d13e from Amazon doc 

`ec2-associate-address #{ALLOCATION_ID} #{INSTANCE_ID} #{REGION}` Associates an Elastic IP with an Instance. bind IP and instance elastic ip 

ec2-associate-address ec2-associate-address -a eipalloc-5723d13e -i i- 4fd2431a OUTPUT> ADDRESS i-43a4412a eipalloc-5723d13e eipassoc-fc5ca095 from Amazon doc 

Do all in One Step ? 

Do All in One ▸ Pros ○ Simple flow ▸ Cons ○ Legacy > 5 mins Facts that matter Break Things Down ▸ Pros ○ Flexible to handle ▸ Cons ○ Different entries by time It takes 5 minutes to run an instance up process launch + IP go online process 

Process of Terminating Instance Disassociate IP from instance Release IP Terminate instance 

`ec2-disassociate-address # {ASSOCIATION_ID} #{REGION}` Disassociates Elastic IP from Instance. the link ec2-disassociate-address -a eipassoc-048c746d OUTPUT> ADDRESS eipassoc-048c746d example from Amazon doc 

`ec2-release-address #{ASSOCIATION_ID} # {REGION}` Release Elastic IP. ec2-release-address -a eipassoc-048c746d OUTPUT> ADDRESS eipassoc-048c746d example from Amazon doc 

`ec2-terminate-instances #{INSTANCE_ID} #{REGION}` Shutdown Instance. PROMPT> ec2-terminate-instances i-1a2b3c4d OUTPUT> INSTANCE i-1a2b3c4d running shutting-down example from Amazon doc 

5. AWS ELB Elastic Load Balancing 

AWS ELB ▸ Elastic Load Balancing ○ “Automatically distributes incoming application traffic across multiple Amazon EC2 instances in the cloud.” Traffic-monitoring UI and the metrics. Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

`elb-register-instances-with-lb # {LOAD_BALANCER} #{INSTANCE_ID} #{REGION} #{CREDENTIAL_FILE}` Make Load Balancer Know Instance. 

elb-register-instance-with-lb aws elb register-instances-with-load-balancer --load- balancer-name my-test-loadbalancer --instances i- 4e05f721 OUTPUT> { "Instances": [ {"InstanceId": "i-315b7e51"}, {"InstanceId": "i-4e05f721"} ] } from Amazon doc 

`elb-deregister-instances-with-lb # {LOAD_BALANCER} #{INSTANCE_ID} #{REGION} #{CREDENTIAL_FILE}` Cut Instance out from Load Balancer. aws elb register-instances-with-load-balancer --load-balancer-name my-test-loadbalancer --instances i-4e05f721 OUTPUT> {"Instances": [{"InstanceId": "i-315b7e51"}]} from Amazon doc 

`aws elb describe-instance-health # {LOAD_BALANCER} #{REGION}` Returns the current state of the instances registered with the specified load balancer. 

describe-instance-health aws elb describe-instance-health --load-balancer-name MyHTTPSLoadBalancer OUTPUT> { "InstanceStates": [ {"InstanceId": "i-cb439ec2", "ReasonCode": "N/A", "State": "InService", "Description": "N/A"} ] } from Amazon doc 

`mon-get-stats #{METRIC} #{NAMESPACE} #{STATISTICS} #{REGION} #{DIMENSIONS} #{CREDENTIAL_FILE}` Get time-series data for one or more statistics of a given Metric. get time-series data requestCount, HTTPCode_Backend_2XX, ... aws/elb sum lb name 

mon-get-stats mon-get-stats RequestCount --statistics "Sum" -- namespace "AWS/ELB" OUTPUT> 2015-01-29 12:01:00 687.0 Count 2015-01-29 12:02:00 753.0 Count 2015-01-29 12:03:00 836.0 Count from Amazon doc 

Elements ELB monitor traffic EC2 launch or terminate instance ElastiCache track instance status 

6. Amazon ElastiCache Redis 

Amazon ElastiCache ▸ Amazon ElastiCache ○ “makes it easy to deploy, operate, and scale an in-memory cache in the cloud” Redis, a key-value database. 

Redis “Redis is an open source, BSD licensed, advanced key-value cache and store. ” - http://redis.io Different data structures: strings, hashes, lists, sets, ... Icon made by Carlos Prioglio from www.iconfinder.com is licensed under CC BY-NC-SA 3.0 

7. Auto Scaling! Automation. 

Auto Scaling Icons made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

Let’s auto scale! Icon made by SimpleIcon from www.flaticon.com is licensed under CC BY 3.0 

A Robot’s Day Its name is Bee! Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

Monitor Traffic ▸ CLI ○ elb-register-instances-with-lb ○ mon-get-stats 

Decide a Threshold ▸ Observe what has happened time request 

The Basic Process ▸ Basic actions ○ ec2-run-instances ○ ec2-allocate-address ○ ec2-associate-address ○ elb-register ○ elb-deregister ○ ec2-disassociate-address ○ ec2-release-address ○ ec2-terminate-instances 

Watch for Status ▸ Now what should be done? ○ Add/remove instance ■ Number of online-servers ■ Traffic and threshold ○ Register/deregister instance with load balancer ○ Update instance status ■ pending / Initializing / running / stop / problem ○ White List ○ Limitation ■ Time ■ Scaling Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

Track Things Down ▸ Online instances ▸ Waken instances ▸ Problem instances Redis data type: List. i-abcde01 i-bcdef02 i-cdefg03 

Track Things Down ▸ Instance information ▸ The timestamp of the last instance initialized Redis data type: String. i-abcde01: "{id: i-abcde01, status: initializing, private_ip: 192.168.0.1, public_ip: 54.12.23.34, created_at: 2015/01/20 14:03:00}" 

Release 

8. Deployment Let’s meet other robots! 

http://capistranorb. com/ Icon made by Charles Lowell and Frontside from jenkins-ci.org is licensed under CC BY-SA 3.0 

Always put the NEWEST service online. Icon made by OCHA , icon made by Freepik, icon made by Sarfraz Shoukat from www.flaticon.com is licensed under CC BY 3.0 Icon made by Charles Lowell and Frontside from jenkins-ci.org is licensed under CC BY-SA 3.0 

with Jenkins Auto Scaling + Deployment 

New pre and post processes. Original Deployment Get servers’ IP Build Image 

Get servers’ IP `aws ec2 describe-instances #{REGION} --filters "Name=instance-state-name,Values=running" "Name=instance.group-name,Values=FrontEnd" "Name=tag-value,Values=FrontEnd Production*" "Name=ip-address,Values=*"` RESERVATION r-1a2b3c4d 111122223333 INSTANCE i-1a2b3c4d ami-1a2b3c4d running my-key-pair 0 m1.small YYYY-MM-DDTHH:MM: SS+0000 us-west-2b windows monitoring-disabled 50.112.172.209 10.0.0.167 vpc-1a2b3c4d subnet-1a2b3c4d ebs hvm xen ABCDE1234567890123sg-1a2b3c4d default false BLOCKDEVICE /dev/sdb vol-1a2b3c4d YYYY-MM-DDTHH:MM:SS.SSSZtrue NIC eni-1a2b3c4dsubnet-1a2b3c4d vpc-1a2b3c4d111122223333in-use10.0.1.167 true NICATTACHMENT eni-attach-1a2b3c4d 0 attached YYYY-MM-DDTHH:MM:SS+0000true GROUP sg-1a2b3c4d my-security-group PRIVATEIPADDRESS 10.0.1.167 PRIVATEIPADDRESS 10.0.1.12 TAG instance i-1a2b3c4d Name Windows from Amazon doc 

Build Image `ec2-create-image #{INSTANCE_ID} #{NAME} #{DESCRIPTION} --no-reboot #{REGION}` ec2-create-image i-10a64379 --name "Standard Web Server" --description "Standard web server AMI" OUTPUT> IMAGE ami-4fa54026 from Amazon doc 

Do we solve it? NOT yet! 

Good communication matters! icons made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

Happy Auto Scaling! Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0 

Join us! https://livehouse.in/recruit 

Thanks! any questions ? You can find me at [email protected] 

Credits Special thanks to all the people who made and released these awesome resources for free: ▸ Busy Icons by Olly Holovchenko ▸ Presentation template by SlidesCarnival ▸ Photographs by Unsplash ▸ Paper backgrounds by SubtlePatterns ▸ Other icons are from ▸ http://www.freepik.com ▸ http://www.flaticon.com ▸ https://livehouse.in ▸ http://jenkins-ci.org