Setting up shop with Boto

Cologne AWS User Group, 2015-07-23

Transcript

1. Boto Setting up shop with @ottopoellath 2015-07-23
2. What is Boto? Why would I use it? How do I use it? What does it look like in practice?
3. What is Boto?
4. Boto emerging from water © Mark Carwardine / naturepl.com
5. What is Boto? • AWS SDK for Python • Supports ~50 AWS services • Boto 3 has been released recently • AWS CLI is based on Boto 3 • Suitable for infrastructure automation and application development
6. What are the alternatives? • Other AWS SDKs • fog • CloudFormation • Terraform • Many others…
7. Why would I choose Boto? • Does your team have Python skills? • What services do you need to work with? • Do you want to write applications and tools, or automate your infrastructure?
8. How do I install it? $ pip install boto3 awscli $ aws configure
9. How do I use it? import boto3 s3 = boto3.resource('s3') bucket = 'existing-bucket' file = 'boto.jpg' b = s3.Object(bucket, file) b.put(Body=open(file, 'rb'))
10. What’s in the box? botocore Session Credentials Clients HTTPS Authentication Serialization Response handling Pagination Waiters boto3 Session Config Resources Clients Collections Events
11. Clients - low level API ec2 = boto3.client('ec2') r = ec2.create_vpc(CidrBlock='10.0.0.0/16') vpc_id = r['Vpc']['VpcId'] tags = [] tags.append({'Key': 'acme:env', 'Value':'woot'}) tags.append({'Key': 'acme:role','Value':'vpc'}) ec2.create_tags(Resources=[vpc_id], Tags=tags)
12. Paginators r = ec2.describe_tags() for tag in r['Tags']: print tag['Key'] p = ec2.get_paginator('describe_tags') for page in p.paginate(): for tag in page['Tags']: print tag['Key']
13. Waiters r = ec2.create_subnet(VpcId=vpc_id, CidrBlock=’10.0.0.0/24') subnet_id = r['Subnet']['SubnetId'] w = ec2.get_waiter('subnet_available') w.wait(SubnetIds=[subnet_id])
14. Resources - higher-level API ec2 = boto3.resource('ec2') vpc = ec2.create_vpc(CidrBlock='10.0.0.0/16') subnet = vpc.create_subnet(CidrBlock='10.0.0.0/24') subnet.delete() vpc.delete()
15. What does it look like in practice? • We used Boto to setup and tear down environments on demand • An environment is a named VPC spanning multiple availability zones • It contains several Beanstalk apps, RDS, Cassandra and Elasticache instances as well as network and security related resources
16. What does it look like in practice? • AWS Api is low-level, so you end up building your own abstractions on top of Boto • When automating infrastructure, it becomes essential to manage dependencies between resources • You’ll notice the first time you cannot delete a resource…
17. Boto emerging from water © Mark Carwardine / naturepl.com