Going Serverless: AWS Lambda Martin Smith, DevOps Engineer [email protected]

Martin B. Smith, DevOps Engineer @ Rackspace @martinb3 - http://martinb3.io - [email protected] - github:martinb3 15 years of infrastructure automation, software development, systems administration. Unhealthy obsession with acquiring new hobbies: Memes in presentations, Photography, Knitting, Baking, Kayaking, Languages, Travel…

The Plan What is Lambda. Why it matters. Demo. Limits.

I lied. Here’s what I want you to know.

The Plan What is Lambda. Why it matters. Demo. Limits.

AWS ‘Services’ Compute: EC2, ECS, EMR, Lambda* Net: Route53, VPC, DirectConn., ELB CDN: CloudFront Storage: S3, Glacier, EBS, EFS DB: Dynamo, RDS, Kinesis, SimpleDB Deployment: CF, ElasticBeanstalk, OpsWorks, CodeDeploy Mgmt: IAM, Directory Services, CloudWatch, KMS App Mgmt: API Gateway, Search, SES, SQS, SNS, SWF, ad nauseam. Mechanical turk...

AWS ‘Services’ Compute: EC2, ECS, EMR, Lambda* Net: Route53, VPC, DirectConn., ELB CDN: CloudFront Storage: S3, Glacier, EBS, EFS DB: Dynamo, RDS, Kinesis, SimpleDB Deployment: CF, ElasticBeanstalk, OpsWorks, CodeDeploy Mgmt: IAM, Directory Services, CloudWatch, KMS App Mgmt: API Gateway, Search, SES, SQS, SNS, SWF, ad nauseam. Mechanical turk...

No content

Lambda “AWS Lambda lets you run code without provisioning or managing servers.” Like the calculus.

Lambda exports.myHandler = function(event, context) { console.log("value1 = " + event.key1); console.log("value2 = " + event.key2); context.succeed("some message"); } NodeJS

Lambda package example; import com.amazonaws.services.lambda.runtime. Context; public class Hello { public String myHandler(String name, Context context) { return String.format("Hello %s.", name); } } Java

Lambda def my_handler(event, context): message = 'Hello {} {}!'.format (event ['first_name'], event['last_name']) return {'message' : message} Python

$ (requests) * (GB*seconds)

1M requests 400k GB-seconds

$0.00001667 per GB*s $0.0000002 per req.

Pricing Example 1 If you allocated 512MB of memory to your function, executed it 3 million times in one month, and it ran for 1 second each time, your charges would be calculated as follows: Monthly compute charges The monthly compute price is $0.00001667 per GB-s and the free tier provides 400,000 GB-s. Total compute (seconds) = 3M * (1s) = 3,000,000 seconds Total compute (GB-s) = 3,000,000 * 512MB/1024 = 1,500,000 GB-s Total compute – Free tier compute = Monthly billable compute GB- s 1,500,000 GB-s – 400,000 free tier GB-s = 1,100,000 GB-s Monthly compute charges = 1,100,000 * $0.00001667 = $18.34 Monthly request charges The monthly request price is $0.20 per 1 million requests and the free tier provides 1M requests per month. Total requests – Free tier requests = Monthly billable requests 3M requests – 1M free tier requests = 2M Monthly billable requests Monthly request charges = 2M * $0.2/M = $0.40 Total monthly charges Total charges = Compute charges + Request charges = $18.34 + $0.40 = $18.74 per month

Pricing Example 2 If you allocated 128MB of memory to your function, executed it 30 million times in one month, and it ran for 200ms each time, your charges would be calculated as follows: Monthly compute charges The monthly compute price is $0.00001667 per GB-s and the free tier provides 400,000 GB-s. Total compute (seconds) = 30M * (0.2sec) = 6,000,000 seconds Total compute (GB-s) = 6,000,000 * 128MB/1024 = 750,000 GB-s Total Compute – Free tier compute = Monthly billable compute seconds 750,000 GB-s – 400,000 free tier GB-s = 350,000 GB-s Monthly compute charges = 350,000 * $0.00001667 = $5.83 Monthly request charges The monthly request price is $0.20 per 1 million requests and the free tier provides 1M requests per month. Total requests – Free tier request = Monthly billable requests 30M requests – 1M free tier requests = 29M Monthly billable requests Monthly request charges = 29M * $0.2/M = $5.80 Total compute charges Total charges = Compute charges + Request charges = $5.83 + $5.80 = $11.63 per month

The Plan What is Lambda. Why it matters. Demo. Limits.

So much integration potential.

Could easily replace crontab or batch workloads. Scaling is a non-issue. Parallel-friendly workloads. Already seeing backup jobs for S3 built in Lambda. Could replace Heroku. Could replace FastCGI & workers. Single page apps... Event driven infrastructure

Image processing app

Squirrelbin

Deploy Lambda w/ Lambda

CI/CD or Load Testing Pipeline

CRISPR: edit genomes with unprecedented precision, efficiency, and flexibility.

The list goes on - Architectures - Event-driven computing - Startups - Microservices - Testing - Analytics - Stream processing - ETL / Batch - Statistics / metrics - Machine learning Serverless...

The New Normal - EC2 & S3 replaced VMs & File Storage - Immutable infrastructure, cattle not pets. Automated provisioning. Self-healing. - Will Lambda replace these? All the right constraints for another revolution.

Next?

Cost dominated by CDN

The Plan What is Lambda. Why it matters. Demo. Limits.

I lied. These demos aren’t live.

Sending Slack messages

Validating Chef configurations

Fanout jobs

No content

The Plan What is Lambda. Why it matters. Demo. Limits.

Language Choice C++, Ruby, Golang, etc

Identity & Access Management $$$$$$$$$$$$$$$$$$$$$$$

Performance Options Many more EC2 instance sizes.

Return Values Uneven. Mapping to HTTP errors is hard.

Dependency packaging OpenSSL? PyCrypto? :redflag:

Testing Local environments != Production

No Structure Huge List only gets bigger.

Regions in AWS. Not available everywhere.

Latency Around 1s for initial call, 100ms after

Never-catch-up Problem > 300s ad infinitum.

Vendor Lockin Perhaps. Perhaps not.

Competitors? Facebook: Parse, Firebase

Fin.