instances in the cloud Amazon ECS, EKS, and Fargate Container management service for running Docker on a managed cluster of EC2 AWS Lambda Serverless compute for stateless code execution in response to triggers
or a manual process? • Resilience • To what degree can we (automatically) recover from issues on infrastructure? • Cost • Can we control cost based on pricing per operation/invocation? • Maintenance and operations • How much OS/software maintenance will be needed going forward? • Security • How do I keep infrastructure secure and handle authentication/authorization?
rights reserved. Monthly costs of running the blog The website has been running stable for 3+ years with a few hundred visitors every month. • Route53 hosted zone $0,50 • Lambda function cost $0,30 • DynamoDB costs $0,20 • API Gateway costs $0,10 • Email costs $0,02 • Domain name $1 No maintenance (patching, scaling, backups) is required. TCO is at least 10 x cheaper than running this on EC2.
files Kinesis Agent Record producers Amazon Redshift or Aurora: Table loads Amazon Elasticsearch Service: Domain loads Amazon S3: Source record backup AWS Lambda: Transformations & enrichment Amazon DynamoDB: Lookup tables Raw records Lookup Transformed records Transformed records Raw records Kinesis Data Firehose: Delivery stream
Lambda function 1. File put into bucket 2. Lambda invoked Lambda function 2. Lambda invoked SNS topic 1. Data published to a topic Data 1. Message inserted into to a queue message Amazon SQS Lambda function 3. Function removes message from queue 2. Lambda polls queue and invokes function
such as order processing, report generation, and data analysis Add services in minutes Write and maintain less code AWS Step Functions AWS Lambda Amazon ECS AWS Fargate AWS Batch Amazon SageMaker AWS Glue Amazon DynamoDB Amazon SNS Amazon SQS
44.66 seconds...Data scanned: 169.53GB Cost: $5/TB or $0.005/GB = $0.85 SELECT custid, year, sum(count) FROM sales WHERE custid = ‘157231’ GROUP BY gram, year ORDER BY year ASC; Analytics & processing
Lambda Function Lambda Function Lambda Function Lambda Function Lambda Function Lambda Function Lambda Function Lambda Function This new feature can; • Modify the ACL’s or tags of objects on S3 at scale. • Copy objects to a new bucket while preserving properties. • Let Lambda (re)process all your files stored on S3. AWS takes care of running the operations, even if your bucket has billions of objects.
use a NoSQL database; • You need to integrate with other backend applications that run on a relational database (i.e. WordPress) or are hard to modify. • You need access to complex queries that are harder to do with NoSQL (i.e. multiple joins, fuzzy searches). • There may be other database features that your application requires (logging, ACID compliance).
service protocol for database access • SQL statements packaged as HTTP requests • Access your database from Lambda and AppSync • Access your database from the AWS SDK & CLI Data API Service Aurora Serverless
repository • Optionally use Amazon ElasticSearch for more complex queries AWS Lambda Metadata Index (DynamoDB) Search Index (Amazon ES) ObjectCreated ObjectDeleted PutItem Update Index S3 Bucket https://aws.amazon.com/answers/big-data/data-lake-solution/ Catalog & Search
AWS • Start developing on AWS in minutes • Work across your team, securely • Manage software delivery easily • Choose from a variety of project templates
Cold start Warm start Download your code Start new container Time Learn more about Lambda under the hood on YouTube; - AWS re:Invent 2018: A Serverless Journey: AWS Lambda Under the Hood (SRV409) https://www.youtube.com/watch?v=QdzV04T_kec
security, scale and associated controls Enabling new application development patterns New patterns through events, workflows, functions, and APIs Minimizing undifferentiated code Eliminating duplicate code, increase reuse Empowering serverless developers and operations Meet developers and operations where they are, lead them where they need to be
API Gateway and Lambda ü HIPAA for Step Functions, Serverless Application Repository ü GDPR for all services Scale, availability, and pricing improvements ü AWS Lambda SLA (99.95%), API Gateway SLA (99.95%) ü API Gateway tiered pricing (as low as $1.51/million) ü Increased Step Functions throughput (1,000 transitions/sec) aws.amazon.com/compliance aws.amazon.com/lambda/sla - aws.amazon.com/api-gateway/sla
API Networks Storage Rate Limiting Metadata Service • Firecracker microVMs have the same security as KVM VMs • Designed for low overhead, high density, and fast start times • Built-in fair sharing Firecracker Architecture and Benefits
strong process isolation Greater efficiency Speed by design Accelerates kernel loading to reduce cold start times (150 microVMs/second) More processes can be run per instance and more efficient use of compute resources. firecracker-microvm.io
VM barrier and strong process isolation Greater efficiency Speed by design Accelerates kernel loading to reduce cold start times (150 microVMs/second) More processes can be run per instance and more efficient use of compute resources. firecracker-microvm.io
API Networks Storage Rate Limiting Metadata Service • Firecracker microVMs have the same security as KVM VMs • Designed for low overhead, high density, and fast start times • Built-in fair sharing Firecracker Architecture and Benefits
marekq
nenonaninu
yamaguchitk333
.jpg){kind=avatar}
oshanqq
duelist2020jp
coosuke
mochizuki875
ishikawa_satoru
ytaka23
chanyou0311
axelmizu
marchin1989
oracle4engineer
matthewcrist
chriscoyier
speakerdeck
marcduiker
mojombo
brettharned
addyosmani
3n
iamctodd
jlugia
destraynor
