Read World Serverless

@Koenighotze #Voxxed Real World Serverless David Schmitz Senacor Technologies

@Koenighotze #Voxxed DAVID SCHMITZ SENACOR TECHNOLOGIES @KOENIGHOTZE

@Koenighotze #Voxxed 4 QUESTIONS

@Koenighotze #Voxxed MICROSERVICES CONTAINERS CLOUD SERVERLESS

@Koenighotze #Voxxed EXPECTATION MANAGEMENT

@Koenighotze #Voxxed VENDOR? CLOUD GURU?

@Koenighotze #Voxxed

@Koenighotze #Voxxed THINGS ARE MOVING FAST

@Koenighotze #Voxxed –Me “Some of the things we learned, while
moving an application (partially) to AWS Lambda.”

@Koenighotze #Voxxed ASP.NET MSSQL EMPLOYEE ADMINISTRATION PLATFORM

@Koenighotze #Voxxed ASP.NET MSSQL Users Projects Budget

@Koenighotze #Voxxed RUNTIME MATTERS SCALE(LAMBDA) !!>>> REST LAMBDA-TIMTOWTDY DEPLOYMENT STILL
SUCKS SECURITY IS A THING LAMBDA WITCHCRAFT

@Koenighotze AWS LAMBDA 1-0-1

@Koenighotze #Voxxed Ye olde days

@Koenighotze #Voxxed INFRASTRUCTURE AS A SERVICE

@Koenighotze #Voxxed PLATFORM AS A SERVICE

@Koenighotze #Voxxed CONTAINERS

@Koenighotze #Voxxed Provisioning Scaling Monitoring State Security Deploying …

@Koenighotze #Voxxed HOW TO DRAW AN OWL?

@Koenighotze #Voxxed 1. Draw some circles 2. Draw the rest
of the damn owl

@Koenighotze #Voxxed DESIGNING DISTRIBUTED SYSTEMS IS DIFFICULT

@Koenighotze #Voxxed What I actually care about

@Koenighotze #Voxxed ENTER SERVERLESS

@Koenighotze #Voxxed SO WHAT IS SERVERLESS?

@Koenighotze #Voxxed Serverless computing allows you to build and run
applications and services without thinking about servers. Serverless applications don't require you to provision, scale, and manage any servers… Building serverless applications means that your developers can focus on their core product instead of worrying about managing and operating servers or runtimes…

@Koenighotze #Voxxed FOCUS ON WHAT MATTERS

@Koenighotze #Voxxed …AT LEAST THAT IS WHAT THEY SELL ;)

@Koenighotze #Voxxed AWS CHEAT SHEET

@Koenighotze #Voxxed LAMBDA - SERVERLESS COMPUTE

@Koenighotze #Voxxed S3 - DROPBOX

@Koenighotze #Voxxed IAM - SECURITY

@Koenighotze #Voxxed CLOUDFORMATION - PROVISIONING

@Koenighotze #Voxxed WHAT IS A “LAMBDA FUNCTION”?

@Koenighotze #Voxxed Event driven Stateless Asynchronous Single purpose

@Koenighotze #Voxxed EXECUTION MODEL

@Koenighotze #Voxxed S3

@Koenighotze #Voxxed Some time later…

@Koenighotze #Voxxed SCALE BY REQUEST

@Koenighotze #Voxxed NO OVERPROVISION NO UNDERPROVISION

@Koenighotze #Voxxed CHARGE BY EXECUTION

@Koenighotze NEW ARCHITECTURES NEW TRAPS

@Koenighotze #Voxxed A SERVERLESS APPLICATION

@Koenighotze #Voxxed SERVERLESS WEBSITE SERVERLESS COMPUTE SERVERLESS DATAXXX

@Koenighotze #Voxxed NO API GATEWAY? NO EVENT DRIVEN EXTRAVAGANZA?

@Koenighotze SCALE(LAMBDA) !!>>> REST

@Koenighotze #Voxxed LAMBDA SCALES BY REQUEST

@Koenighotze #Voxxed …YOUR BACKEND PROBABLY DOES NOT

@Koenighotze #Voxxed “Billings are submitted using our legacy API”

@Koenighotze #Voxxed …AND AT THE END OF A MONTH…

@Koenighotze #Voxxed Grigoriy Myasoyedov.1897 Please stop this lambda non-sense But
my CV!

@Koenighotze #Voxxed ALWAYS USE CONCURRENCY LIMITS

@Koenighotze #Voxxed aws lambda put-function-concurrency --function-name <NAME> --reserved-concurrent-executions <N>

@Koenighotze #Voxxed BOTTLENECKS TEND TO SPREAD

@Koenighotze #Voxxed PREFER ASYNCHRONOUS INTEGRATION

@Koenighotze #Voxxed AWS On Premise

@Koenighotze ATTACK OF SELF DENIAL

@Koenighotze #Voxxed CONCURRENCY IS LIMITED

@Koenighotze #Voxxed KNOW YOUR PER-ACCOUNT LIMITS

@Koenighotze #Voxxed Projects Budget Users

@Koenighotze #Voxxed SHARE NOTHING LAMBDA EDITION

@Koenighotze #Voxxed SPLIT PER BOUNDED CONTEXT

@Koenighotze #Voxxed Projects Budget Users

@Koenighotze #Voxxed Projects Project Account Users Users Account Budget Budget
Account

@Koenighotze LAMBDA-TIMTOWTDY

@Koenighotze #Voxxed ONE LAMBDA WITH DISPATCH MULTI LAMBDA - SHARED
ZIP MULTI LAMBDA - SHARED NOTHING

@Koenighotze #Voxxed ONE LAMBDA WITH DISPATCH

@Koenighotze #Voxxed create Order forward Order cancel Order Order ZIP

@Koenighotze #Voxxed EASE OF TRANSITION FLEXIBILITY SECURITY SIZING DEPLOYMENT COMPLEXITY

@Koenighotze #Voxxed MULTI LAMBDA - SHARED ZIP

@Koenighotze #Voxxed create Order forward Order cancel Order

@Koenighotze #Voxxed MULTI LAMBDA - SHARED NOTHING

@Koenighotze #Voxxed Create Order ZIP Forward Order ZIP Cancel Order
ZIP cancel Order forward Order create Order

@Koenighotze #Voxxed cancel Order forward Order create Order

@Koenighotze DEPLOYMENT STILL SUCKS

@Koenighotze #Voxxed AWS LAMBDA MAY NEED NO SPECIAL FRAMEWORK

@Koenighotze #Voxxed VENDOR LOCK-IN

@Koenighotze #Voxxed LOG4J VS. COMMONS-LOGGING

@Koenighotze #Voxxed YOU ABSOLUTELY NEED TOOLING FOR DEPLOYMENT

@Koenighotze #Voxxed AVOID UI DEPLOYMENTS

@Koenighotze #Voxxed MINIMAL LIST OF THINGS NEEDED TO RUN A
LAMBDA

@Koenighotze #Voxxed CODE AND DEPENDENCIES HANDLER NAME RUNTIME ROLE AND
POLICY

@Koenighotze #Voxxed $ aws lambda create-function \ --function-name HelloWorld \
--runtime nodejs6.10 \ --role arn:aws:iam::…:… \ --handler index.handler \ --zip-file fileb://index.zip

@Koenighotze #Voxxed S3 BUCKET WITH WEBSITE HOSTING 3 LAMBDAS +
ALIAS 3 ROLES, POLICIES DYNAMODB TABLE

@Koenighotze #Voxxed REAL AUTOMATION IS KEY

@Koenighotze #Voxxed $ claudia create \ --region eu-west-1 \ --handler
index.handler \ --name HelloWorld

@Koenighotze #Voxxed MEET AWS SAM

@Koenighotze #Voxxed SERVERLESS APPLICATION MODEL

@Koenighotze #Voxxed Function code SAM Template Cloudformation AWS Lambda

@Koenighotze #Voxxed Function code SAM Template Cloudformation AWS Lambda DESCRIBE
YOUR FUNCTION

@Koenighotze #Voxxed Function code SAM Template Cloudformation AWS Lambda PACKAGE
EVERYTHING

@Koenighotze #Voxxed Function code SAM Template Cloudformation AWS Lambda DEPLOY
IT

@Koenighotze #Voxxed AWSTemplateFormatVersion: '2010-09-09' Transform: AWS::Serverless-2016-10-31 Description: Hello World Resources:
HelloWorld: Type: AWS::Serverless::Function Properties: Timeout: 5 Runtime: nodejs6.10 Handler: index.handler CodeUri: .

@Koenighotze #Voxxed ALL TOOLS HAVE DIFFERENT DRAWBACKS

@Koenighotze #Voxxed DEBUGGING ROLLBACK STATE FEATURE COMPLETENESS

@Koenighotze CLEANLINESS IS NEXT TO GODLINESS

@Koenighotze #Voxxed INTEGRATION TEST RIGHT FROM THE START

@Koenighotze #Voxxed SAM LOCAL

@Koenighotze #Voxxed YOUR TESTING TOOLS SHOULD BE AS MATURE AS
YOUR PRODUCTION TOOLS

@Koenighotze #Voxxed TESTING LAMBDA FOR REAL IS JUST TOO EASY

@Koenighotze #Voxxed aws lambda invoke \ --function-name ReceiptUpload \ --region
eu-central-1 \ --payload file://expensive_receipt.json \ out.json

@Koenighotze PROTECT PRODUCTION

@Koenighotze #Voxxed STAGING IS A THING

@Koenighotze #Voxxed Parameters: … Stage: Type: String Default: DEV ForwardBilling:
Type: AWS::Serverless::Function Properties: FunctionName: !Sub ForwardBilling-${Stage}

@Koenighotze #Voxxed aws cloudformation deploy --template-file … --stack-name … --parameter-overrides
Stage=PROD

@Koenighotze #Voxxed YES ALIASES HELP, TOO

@Koenighotze #Voxxed CLEANUP UNUSED LAMBDAS

@Koenighotze

@Koenighotze #Voxxed HOW DO YOU REASON ABOUT CLOUD ARCHITECTURES?

@Koenighotze #Voxxed HOW TO KNOW WHAT TO CLEANUP?

@Koenighotze #Voxxed PYTHON LIST_LAMBDAS.PY \ —INACTIVE-DAYS-FILTER 10 https:!//github.com/epsagon/list-lambdas

@Koenighotze #Voxxed REDUCE ATTACK SURFACE REDUCE COGNITIVE CLUTTER STAY IN
CONTROL

@Koenighotze SECURITY IS A THING

@Koenighotze #Voxxed SERVERLESS IS GOOD FOR SECURITY

@Koenighotze #Voxxed NO LONG LIVED SERVERS OR MANUAL PATCH SCHEDULES

@Koenighotze #Voxxed THAT YOU NEED TO HANDLE

@Koenighotze #Voxxed …BUT AMAZON DOES

@Koenighotze #Voxxed HOW DO YOU DEPLOY A WEB APPLICATION FIREWALL…
…WITHOUT A WEB …WITHOUT AN APPLICATION …WITHOUT A SERVER

@Koenighotze #Voxxed NEW OR ADAPTED SECURE CODING PATTERNS NEEDED

@Koenighotze #Voxxed INCREASED ATTACK SURFACE

@Koenighotze #Voxxed IMAGINE EVERYBODY WANTS TO HARM YOU

@Koenighotze #Voxxed EVENT INJECTION

@Koenighotze #Voxxed Validation and security magic

@Koenighotze #Voxxed CLASSIC LAYERED CAKE ARCHITECTURE DOES NOT APPLY TO
SERVERLESS

@Koenighotze #Voxxed NEVER TRUST YOUR CALLER

@Koenighotze #Voxxed Security boundary Security boundary Security boundary Security boundary

@Koenighotze #Voxxed BILLING ATTACK

@Koenighotze #Voxxed SECURITY IS LIKE CSS NO ONE DELETES RULES
YOU ONLY ADD RULES

@Koenighotze #Voxxed BEWARE CRAPPY CODE EXAMPLES

@Koenighotze #Voxxed "Statement": [{ "Effect": "Allow", "Action": [ “s3:*", ],
"Resource": [ “arn:aws:s3:::*” ] }, …

@Koenighotze #Voxxed "Statement": [{ "Effect": "Allow", "Action": [ "s3:*", ],
"Resource": [ "arn:aws:s3:::*" ] }, …

@Koenighotze #Voxxed SECURITY SHOTGUN

@Koenighotze #Voxxed PRINCIPLE OF LEAST PRIVILEGES

@Koenighotze #Voxxed "Statement": [{ "Effect": "Allow", "Action": [ “s3:*", ],
"Resource": [ “arn:aws:s3:::senacor/fis/orders/*” ] }, …

@Koenighotze #Voxxed "Statement": [{ "Effect": "Allow", "Action": [ "s3:GetObject" ],
"Resource": [ “arn:aws:s3:::senacor/fis/orders/*” ] }, …

@Koenighotze #Voxxed “ALLOW ONLY READING OBJECTS FROM A SPECIFIC BUCKET”

@Koenighotze #Voxxed WHAT ABOUT SHARING CONFIGURATION?

@Koenighotze #Voxxed DO NOT SHARE POLICIES

@Koenighotze #Voxxed NO EXCUSES WITH PROPER TOOLING

@Koenighotze #Voxxed Resources: ForwardBillingRole: Type: "AWS::IAM::Role" Properties: RoleName: !Sub "ForwardBillingRole-${Stage}"
AssumeRolePolicyDocument: ... ManagedPolicyArns: ... Policies: - PolicyName: !Sub "StoreBillingInS3Policy-${Stage}" PolicyDocument: ... ForwardBilling: Type: AWS::Serverless::Function Properties: Role: !GetAtt ForwardBillingRole.Arn

@Koenighotze #Voxxed USE A SECURITY WATCHDOG

@Koenighotze #Voxxed YOUR FUNCTION MAY BE SMALL, BUT YOUR DEPENDENCIES
MAY NOT

@Koenighotze #Voxxed $ du -s src/ 8.0K src/ $ ls
-lh lambda.zip 7.6M Mar 1 07:13 lambda.zip

@Koenighotze #Voxxed SECURITY MUST BE PART OF DEVELOPMENT RIGHT FROM
THE START

@Koenighotze #Voxxed YOU BUILD IT YOU RUN IT

@Koenighotze #Voxxed YOU BUILD IT YOU SECURE IT AND THEN
RUN IT

@Koenighotze LAMBDA WITCHCRAFT AKA. HOT AND COLD START

@Koenighotze #Voxxed Users

@Koenighotze #Voxxed Users Cold COLD START

@Koenighotze #Voxxed Users Cold

@Koenighotze #Voxxed Users Cold HOT START

@Koenighotze #Voxxed COLD START HAPPENS ONCE, RIGHT?

@Koenighotze #Voxxed SCALE BY REQUEST

@Koenighotze #Voxxed Users Cold

@Koenighotze

@Koenighotze #Voxxed COLD START WILL HAPPEN ONCE FOR EACH CONCURRENT
EXECUTION OF YOUR FUNCTION

@Koenighotze #Voxxed WHAT CAN YOU DO?

@Koenighotze #Voxxed NO SLA

@Koenighotze #Voxxed NO HARD DETAILS JUST GUIDELINES

@Koenighotze #Voxxed PACKAGE SIZE?

@Koenighotze #Voxxed NO OBVIOUS CORRELATION!?

@Koenighotze #Voxxed MEMORY SETTINGS?

@Koenighotze #Voxxed /AWS/LAMBDA/…REPORT REQUESTID: DURATION: 3208.99 MS BILLED DURATION: 3300
MS MEMORY SIZE: 128 MB MAX MEMORY USED: 59 MB

@Koenighotze #Voxxed MAYBE?

@Koenighotze #Voxxed WARMUP-PING?

@Koenighotze #Voxxed INVASIVE SCALE BY REQUEST MONEY FOR NOTHING

@Koenighotze #Voxxed AWS WILL KILL EVEN WARM LAMBDAS AFTER A
CERTAIN UNSPECIFIED TIME FRAME

@Koenighotze #Voxxed MEASURE CHANGE MEASURE

@Koenighotze #Voxxed MEASURE USER EXPERIENCE

@Koenighotze #Voxxed DESIGN WITH LATENCY IN MIND

@Koenighotze SUMMARY

@Koenighotze #Voxxed SERVERLESS HYPE TRAIN

@Koenighotze #Voxxed DESIGNING DISTRIBUTED SYSTEMS IS STILL HARD

@Koenighotze #Voxxed MOSTLY DIFFERENT CHALLENGES

@Koenighotze #Voxxed YOU NEED A CLOUD-SAVVY OPERATIONS TEAM MEMBER

@Koenighotze #Voxxed DEVOPSSEC DONE RIGHT

@Koenighotze #Voxxed TOOLING IS STILL EVOLVING

@Koenighotze #Voxxed NOT A SILVER BULLET

@Koenighotze #Voxxed SOMETIMES A SIMPLE VM IS ENOUGH

@Koenighotze #Voxxed SERVERLESS

@Koenighotze #Voxxed LESS SERVER THAT WE NEED TO TAKE CARE
OF

@Koenighotze #Voxxed AND…SET BILLING ALERTS, I MEAN IT

THANK YOU! FEEDBACK? COMMENTS? QUESTIONS? @KOENIGHOTZE

Read World Serverless

Read World Serverless

More Decks by David Schmitz

Featured

Transcript