Datascript: Serverless Architecture

Transcript

1. Serverless Architecture Ladislav Prskavec Datascript, 13.12.2016 1

2. Serverless is a hot topic in the software architecture world.

   — Mike Roberts Datascript, 13.12.2016 2

3. Is Serverless buzzword? Datascript, 13.12.2016 3

4. Backend as a Service and Function as a Service Datascript,

   13.12.2016 4

5. Backend as a Service (BaaS) » Firebase - DB +

   Auth » Hoodie - Offline first, PouchDB » Algolia - Search » Auth0 - SSO, Token Based Auth » Kinvey - Mobile Backend as Service » Syncano - Assemble your backend Datascript, 13.12.2016 5

6. Function as a Service (FaaS) » Amazon Lambda & API

   Gateway (Nov'14) » IBM Bluemix Openwhisk (Feb'16) » Google Cloud Functions (Feb'16) » Azure Functions (Mar'16) » Webtask.io (Mar'15) Datascript, 13.12.2016 6

7. Amazon Lambda Datascript, 13.12.2016 7

8. Amazon Lambda - Inputs » Event Source » API Gateway

   » S3 » Kinesis » DynamoDB » AWS Config » Amazon Cognito » AWS CloudFormation » ... Datascript, 13.12.2016 8

9. Amazon Lambda - Processing » Compute Service » Languages (NodeJS

   0.10 and 4.3, Java, Python, C#) » Security Model (IAM, VPC) » Cascading (AWS Step Functions) » Run code at any scale » Charged on execution scale Datascript, 13.12.2016 9

10. Amazon Lambda - Outputs » Event » Storage » Messaging

    Datascript, 13.12.2016 10

11. Cost effective Scenario - 16k req/day @ 200ms avg =

    3200 s/day $2.97/day - 2 EC2 instances (upfront) $0.05/day - Lambda (1GB) Datascript, 13.12.2016 11

12. AWS Serverless Application Model (AWS SAM) » https://github.com/awslabs/serverless-application-model » AWS

    SAM is a model used to define serverless applications on AWS. » Specification » AWS SAM is based on AWS CloudFormation. Datascript, 13.12.2016 12

13. AWSTemplateFormatVersion: '2010-09-09' Transform: 'AWS::Serverless-2016-10-31' Resources: MyFunction: Type: 'AWS::Serverless::Function' Properties: Handler:

    index.handler Runtime: nodejs4.3 CodeUri: 's3://my-bucket/function.zip' Datascript, 13.12.2016 13

14. Amazon States Language » Specification » Linter - https://github.com/awslabs/statelint Datascript,

    13.12.2016 14

15. { "Comment": "A Retry example of the Amazon States Language

    using an AWS Lambda Function", "StartAt": "HelloWorld", "States": { "HelloWorld": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:FailFunction", "Retry": [ { "ErrorEquals": ["HandledError"], "IntervalSeconds": 1, "MaxAttempts": 2, "BackoffRate": 2.0 }, { "ErrorEquals": ["States.TaskFailed"], "IntervalSeconds": 30, "MaxAttempts": 2, "BackoffRate": 2.0 }, "ErrorEquals": ["States.ALL"], "IntervalSeconds": 5, "MaxAttempts": 5, "BackoffRate": 2.0 } ], "End": true } } } Datascript, 13.12.2016 15

16. Frameworks » Chalice » Apex » Serverless » Zappa »

    Sparta Datascript, 13.12.2016 16

17. Chalice » Python » https://github.com/awslabs/chalice » microframework Datascript, 13.12.2016 17

18. Apex - http://apex.run » in golang support nodejs, golang, python,

    java » optional terraform support » multiple deployment targets for different environments » idempotent deployments » author @tjholowaychuk Datascript, 13.12.2016 18

19. Serverless - http://www.serverless.com » in NodeJS, actual version 1.3.0 »

    support aws-nodejs, aws-python, aws-java-gradle, aws-java- maven, aws-scala-sbt, aws-csharp » config in serverless.yml » support env variables (support added into Lambda in November'16) » AWS CloudFormation Datascript, 13.12.2016 19

20. Zappa - https://zappa.gun.io » in Python support Python » https://github.com/Miserlou/lambda-packages

    » https://github.com/Miserlou/django-zappa Datascript, 13.12.2016 20

21. Sparta - http://gosparta.io » in Golang support Golang » CloudFormation

    Datascript, 13.12.2016 21

22. Libraries and utils » claudiajs » aws-serverless-express Datascript, 13.12.2016 22

23. ClaudiaJS » NodeJS » Claudia is not trying to change

    the way you structure or run projects. » Deployment utility » https://github.com/claudiajs/claudia Datascript, 13.12.2016 23

24. AWS Serverless Express » extends ExpressJS » NodeJS 4.3 LTS

    » https://github.com/awslabs/aws-serverless-express » cannot use native packages » currently no support for binary data (AWS Gateway have support from Nov'16) Datascript, 13.12.2016 24

25. Security » https://github.com/vandium-io/vandium-node » Powerful input validation, Forces values into

    correct types » JSON Web Token (JWT) verification and validation » Cross Site Request Forgery (XSRF) detection when using JWT » SQL Injection (SQLi) detection and protection » Environment variable mapping, » Free resources post handler execution » Handles uncaught exceptions » Promise support Datascript, 13.12.2016 25

26. Testing » https://github.com/lambci/docker-lambda/ » Docker images and test runners that

    replicate the live AWS Lambda environment » NodeJS 0.10/4.3 » Python » Java8 Datascript, 13.12.2016 26

27. Architectures examples Datascript, 13.12.2016 27

28. Datascript, 13.12.2016 28

29. Datascript, 13.12.2016 29

30. Datascript, 13.12.2016 30

31. Datascript, 13.12.2016 31

32. Datascript, 13.12.2016 32

33. Datascript, 13.12.2016 33

34. Datascript, 13.12.2016 34

35. Datascript, 13.12.2016 35

36. API Gateway & Lambda problems » limit 6MB on Lambda

    response » API Gateway don't support gzip » problems with with strange 500 errors without » not parsable error object from Lambda into API Gateway » API Gateway template system (based on Velocity templates) » problem with local testing API Gateway Datascript, 13.12.2016 36

37. Q & A Datascript, 13.12.2016 37

38. re:Invent 2016 sessions » Videos - https://gist.github.com/stevenringo/ 5f0f9cc7b329dbaa76f495a6af8241e9 » Slides

    - http://www.slideshare.net/AmazonWebServices/ tagged/reinvent2016 Datascript, 13.12.2016 38

39. Resources » https://aws.amazon.com/lambda/ » https://github.com/anaibol/awesome-serverless » https://cloudcraft.co » https://github.com/lambci/docker-lambda/ »

    http://www.allthingsdistributed.com/2016/05/aws-lambda-serverless-reference- architectures.html » https://www.thoughtworks.com/radar/techniques/serverless-architecture » https://serifandsemaphore.io/azure-cloud-functions-vs-aws-lambda- caf8a90605dd#.dbk2yntw1 » https://github.com/donnemartin/awesome-aws Datascript, 13.12.2016 39