Serverless for the Enterprise

Serverless computing is steadily gaining momentum in the IT industry and more companies are looking to leverage this new way of building and running cloud native systems. Yet, since this area is still relatively young, many are confused about best ways to go about building serverless architectures, particularly more complex ones. In this talk, I'll discuss how common Enterprise specific requirements and challenges can be addressed while building large systems using FaaS/Serverless stack on AWS.

Transcript

1. Serverless for the Enterprise Rafal Gancarz CODEMOTION MILAN - SPECIAL EDITION 10 – 11 NOVEMBER 2017
2. @RafalGancarz AIR ASIA HANDLES UP TO 40 MILLION REQUESTS PER DAY
3. @RafalGancarz THOMSON REUTERS PROCESSES UP TO 10,000 EVENTS PER SECOND (25 BILLION EVENTS PER MONTH)
4. @RafalGancarz FINRA EXECUTES 500 BILLION DATA VALIDATIONS ON 37 BILLION MARKET EVENTS EVERY DAY
5. @RafalGancarz Rafal Gancarz IT Consultant @ Starbucks @RafalGancarz
6. @RafalGancarz WHAT IS SERVERLESS?
7. (CC) theaucitron
8. @RafalGancarz Cloud-native
9. @RafalGancarz Platform as a Service (PaaS)
10. @RafalGancarz Event-driven
11. @RafalGancarz Managed
12. @RafalGancarz Serverless ≠ FaaS Faas Serverless FaaS = Function as a Service
13. @RafalGancarz WHY SERVERLESS?
14. (CC) snapp3r
15. @RafalGancarz Availability at $0
16. @RafalGancarz Scalability 0 … 1000 …
17. @RafalGancarz Economy pay per use
18. @RafalGancarz Time to market months -> days
19. @RafalGancarz Security in depth
20. @RafalGancarz Operability from the start
21. @RafalGancarz Culture Agile/DevOps
22. (CC) Neil Tackaberry ENTERPRISE REQUIREMENTS
23. PERFORMANCE RESPONSIVENESS
24. SCALABILITY AVAILABILITY, ELASTICITY
25. SECURITY AUDITABILITY, COMPLIANCE
26. OPERABILITY OBSERVABILITY, SUPPORTABILITY
27. FLEXIBILITY EVOLVABILITY, MAINTAINABILITY
28. VIABILITY SUITABILITY, DELIVERABILITY, ECONOMICS
29. (CC) Ray Sadler BUILDING BLOCKS
30. @RafalGancarz AWS Lambda Java, C#, NodeJS, Python sync & async invocation max 5 minutes execution time 1 million invocations and 400k GB-s free per month $0.20 per 1 million requests and ~$6.65 for 400k GB-s thereafter Cloud Functions Functions
31. @RafalGancarz Execution model event + context callback (err, data) (NodeJS) return value (Java, Python, C#)
32. @RafalGancarz Hello World (NodeJS) console.log(‘Loading function’) exports.handler = (event, context, callback) => { // console.log(JSON.stringify(event)); // your logic goes here callback(null, 'Hello from Lambda’); // callback(new Error(‘something went wrong’)); };
33. @RafalGancarz Hello World (Python) from __future__ import print_function import json print('Loading function') def lambda_handler(event, context): print("Received event: " + json.dumps(event, indent=2)) // your logic goes here return “Hello from Lambda” #raise Exception('Something went wrong')
34. @RafalGancarz AWS S3 durable, available and scalable functions as content processors 5 GB of storage and 15 GB of data transfer out to Internet each month for free $0.03 per TB/month and $0.09 per GB data transfer out to Internet Cloud Storage Blob Storage
35. @RafalGancarz Image resizer S3 object S3 bucket Lambda function upload notification put
36. @RafalGancarz AWS API Gateway security, caching, throttling functions as API implementations 1 million requests free per month $3.50 per 1 million requests and $0.09/GB (for the first 10 TB, then cheaper) Cloud Endpoints <integrated>
37. @RafalGancarz NPM Registry API handler API Gateway publisher upload NPM package tarball
38. @RafalGancarz AWS DynamoDB document and key-value function as triggered procedures 25 GB of storage and 25 units of read capacity each month for free (~200k requests per month) $0.25 per GB/month and $0.0065 per hour for 10 units of write capacity (36k writes/hour) or 50 units of read capacity (180k reads/hour) Firebase, Bigtable DataStore Table Storage
39. @RafalGancarz CRUD API API handler API Gateway DynamoDB table record processor DynamoDB table trigger
40. @RafalGancarz AWS SNS pub-sub, push notifications functions as destinations 1m publishes, 1m mobile push notifications, 1k emails, 100k HTTP notifications and 1 GB of data transfer out each month for free $0.50 per 1m publishes, $0.60 per 1m HTTP notifications and $0.09 per GB data transfer out to the Internet Cloud Pub/Sub Queue Storage, Event Grid
41. @RafalGancarz Async tasks API handler API Gateway DynamoDB table SNS topic task executor
42. @RafalGancarz AWS Kinesis Streams pub-sub, persistent functions as consumers no free tier $0.015 per shard/hour, $0.014 per 1m PUT payload units (25KB) + extended retention charges data transfer is free Cloud Pub/Sub Queue Storage
43. @RafalGancarz AWS SQS point to point messaging, persistent poll based API, functions need to consume messages explicitly 1m requests (API actions or messages) each month for free $0.40 per 1m requests (standard) or $0.50 per 1m requests (FIFO) Cloud Pub/Sub Queue Storage
44. @RafalGancarz Persistent consumers API handler API Gateway SNS topic SQS queue
45. (CC) Tim Lumley ECOSYSTEM
46. @RafalGancarz Serverless Ecosystem (AWS) SES LEX Cloud Front Route53 KMS Cognito Step Functions Security Delivery Messaging Glacier RDS Redshift Elasti Cache Athena EMR ES Storage & Analytics Artificial Intelligence Polly Rekognition Operations IoT Alexa Skills Internet of Things Compute Cloud Trail Batch ECS EC2 Legend: no servers in sight servers visible servers visible (VPC)
47. @RafalGancarz Serverless Ecosystem (GCP) Machine Learning Cloud Natural Language API Cloud Speech API Cloud Translation API Cloud Vision API Cloud Video Intelligence API Cloud Pub/Sub Cloud Spanner
48. @RafalGancarz Serverless Ecosystem (Azure) Cosmos DB Machine Learning Text Analytics API Face API Compute Vision API Analytics Services
49. @RafalGancarz single cloud vs multi-cloud
50. (CC) perceptions ARCHITECTURE PATTERNS
51. @RafalGancarz Serverless Monolith
52. @RafalGancarz Serverless Microservices A B C D
53. @RafalGancarz Sync integration A B HTTPS (IAM/?) HTTPS (IAM)
54. @RafalGancarz Async integration A B
55. @RafalGancarz Async notifications A B
56. (CC) etherlore CONTINUOUS DELIVERY DEPLOYMENT
57. @RafalGancarz Infrastructure provisioning A AWS CloudFormation (SAM) Hashicorp Terraform (S3 remote state)
58. @RafalGancarz Build/deployment pipeline 1 checkout build (compile/transpile + execute unit tests) deploy to DEVELOPMENT environment + execute component/API tests deploy to TESTING environment + execute end to end tests deploy to STAGING environment + execute smoke tests deploy to PRODUCTION environment + execute smoke tests 2 3 4 5 6
59. @RafalGancarz Infrastructure provisioning CI/CD orchestrator A B C DEVELOPMENT A B C TESTING A B C STAGING A B C PRODUCTION
60. @RafalGancarz Code deployments ES 2015 + rollupjs.org babeljs.io apex.run
61. @RafalGancarz Testing Unit testing (local/CI) Acceptance testing (test environment) Smoke testing (post deployment) testing pyramid Component testing (dev environment)
62. @RafalGancarz Testing + + Unit testing (local + CI) + Acceptance/functional testing (AWS) + Smoke testing (AWS) + (mochajs.org) (chaijs.com) (sinonjs.org) (proxyquire)
63. (CC) haru__q SECURITY
64. @RafalGancarz Security in depth A B team CI/CD IAM IAM STS IAM IAM / API KEY / STS / CUSTOM
65. @RafalGancarz AWS Parameter Store scalable, managed, secured configuration values and secrets
66. @RafalGancarz Secret storage API handler API Gateway secret KMS ciphertext plaintext key generate key
67. (CC) Grégoire Lannoy MONITORING
68. @RafalGancarz AWS CloudWatch scalable, managed real-time monitoring metrics, logs, alarms, events Stackdriver n/a
69. (CC) Jérôme S METRICS
70. @RafalGancarz CloudWatch Metrics retention: 1m (15 days), 5m (63 days), 1h (15 months) basic monitoring (1m/5m) is free 10 metrics and 1 million API requests for free each month $0.30 per metric/month for the first 10k metrics ($0.02 for metrics over 1M) $0.01 for 1000 API requests Stackdriver Monitoring n/a
71. ALERTING (CC) Martin Abegglen
72. @RafalGancarz CloudWatch Alarms watches metrics over time can trigger a function via SNS 10 alarms per month for free $0.10 per alarm per month Stackdriver Monitoring n/a
73. @RafalGancarz Serverless Alerting function CW alarm SNS topic email SMS channel CW metric condition
74. LOGGING (CC) Mari Smith
75. @RafalGancarz CloudWatch Logs ingests and stores application logs configurable retention period 5 GB data ingestion and 5 GB archived storage per month for free $0.5985 per GB ingested per month $0.0315 per GB archived per month Stackdriver Logging n/a
76. @RafalGancarz Log Collection CloudWatch log group Lambda service stdout Lambda function stderr
77. @RafalGancarz Log Filtering CloudWatch log group CloudWatch metric CloudWatch alarm filter condition
78. @RafalGancarz Log Browsing log group Elastic Search function JSON Kibana Bunyan
79. EVENTS (CC) JD Hancock
80. @RafalGancarz CloudWatch Events stores & streams application events $1 per 1 million custom events
81. @RafalGancarz Scheduled tasks function SDK event metrics table
82. HEALTH CHECKS (CC) Rosmarie Voegtli
83. @RafalGancarz Route53 Health Checks monitors HTTP(S) endpoints 50 AWS endpoint checks per month for free $0.50 per health check per month $1 per feature (HTTPS, string matching, fast interval, latency) per month
84. @RafalGancarz Health Checks health check metric alarm api function table
85. TRACING (CC) Ozzy Delaney
86. @RafalGancarz AWS X-Ray collects transaction traces 100k traces recorded and 1 million traces retrieved/scanned free per month $5 per 1 million traces recorded and $0.50 per 1 million traces retrieved/ scanned per month Stackdriver Trace n/a
87. AUDITING (CC) The Steve
88. @RafalGancarz AWS CloudTrail audits all console, API, SDK activity first copy of management event free additional copies $2 per 100k events $0.10 per 100k data events
89. CHALLENGES (CC) mangpages
90. @RafalGancarz Infancy
91. @RafalGancarz Rapid Evolution
92. @RafalGancarz Provider Lock-in
93. @RafalGancarz Capacity management (Lambda, DynamoDB, Kinesis Streams)
94. @RafalGancarz Frameworks
95. @RafalGancarz Tooling
96. THE FUTURE (CC) matt northam
97. @RafalGancarz Maturity
98. @RafalGancarz Services & Tools
99. @RafalGancarz Patterns
100. @RafalGancarz Business Agility
101. (CC) Alan Turkus THANK YOU! QUESTIONS? @RafalGancarz