Serverless: State of the Union

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless:
State of the Union
Danilo Poccia
Technical Evangelist
[email protected]
@danilop
danilop

View Slide

A typical day for a developer…
Manager “We need an app to let our customers update preference
settings – our competitors just launched the same thing, so I need it
fast. I don’t want to pay a lot for it, especially when no one is using it.
But remember that we’re growing, so make sure it scales great and is
easy to manage and operate. And you’re on your own – sorry!”
Developer “Not a problem. I’ll make it serverless…”

View Slide

Serverless means…
No Server Management
The picture can't be displayed.
Flexible Scaling
No Idle Capacity
$
High Availability

View Slide

Joe promised his boss an app.
Now what?
Step 1: Find a working example!
Serverless web app with
…an API hosted on Amazon API Gateway
…access to existing data stored in Amazon DynamoDB
…static content served by Amazon S3 and Amazon CloudFront
…dynamic content/business logic encoded as Lambda functions
What we need

View Slide


View Slide

• Search and browse ready-made apps
and samples
• Customize open source apps to get
started quickly
• Share apps privately or publically
•Monetize APIs using theAWS
Marketplace
• Powered by AWS Serverless
Application Model (AWS SAM)!
AWS Serverless Application Repository
(preview)
© 2017, Amazon Web Services, Inc. or its Affiliates.All rights reserved.

View Slide

Lambda Function Editor
• Edit multiple files at once!
• Create new files for existing
packages
• Run tests and view results
and logs without leaving the
editor
• Save test inputs and reuse
them later

View Slide

Serverless app benefits
Go from concept to working code in under 5 minutes. And
your app isn’t just a prototype…
• 1,000 concurrent executions (10K TPS) by default.
• Every account in good standing is automatically
approved to 3X the default!

View Slide

• 1,000 concurrent executions (10K
TPS) by default. Auto-approvals for
everyone to triple.
Faster perf with
cold-start
optimization!
Up to 80% reduction in start
times for larger functions

View Slide

everyone to triple.
• Up to 80% faster cold start times
Built-in logging and
monitoring, now with:
“grab-n-go” logs in the
Lambda console

View Slide

everyone to triple.
• Find Lambda logs instantly 1.5GB
3GB
Top memory size
of…

View Slide

everyone to triple.
• Find Lambda logs instantly
• Top memory size of 3GB
Go
Serverless!

View Slide

Next, Joe needs to make some changes.
Step 2: Customize and share
Need an IDE for local dev/test/debug
Customize the app we deployed in step 1
Set up a CI/CD pipeline for the team
Deploy (safely!)
What we need
to do

View Slide

Easy-to-use IDE in the cloud
Builtin GitHub support
Builtin Lambda blueprint support
Builtin SAM Local:
Local testing!
IDE debugging!
Deploy directly to Lambda and/or
push updates to GitHub
New
AWS Cloud9

View Slide

Automated CI/CD process
Git push your changes from Cloud9
when ready to share…
Set up an AWS CodePipeline to
build automatically on updates
Local Testing

View Slide

I need to deploy Lambda functions
safely and incrementally.
Customer feedback
How can I deploy multiple
functions and APIs in a
coordinated way?
How do I roll back
automatically?
How can I shape traffic
between two versions of
an API?

View Slide

Safe, incremental serverless deployment
Lambda: Weighted aliases
• Set percentage of traffic between two versions of the same
function
API Gateway: Sub-stages for incremental deployments
• Share traffic between two stages
AWS CodeDeploy: Automated support for safe serverless
deployments
• Amazon CloudWatch metrics-driven rollout/rollback

View Slide


View Slide

Another typical day…
Manager: “That app you built is working great, but now we need to
include data from a relational DB and one of our legacy services in our
VPC. Is your serverless architecture going to handle that?”
Developer “Not a problem.”

View Slide

Next up: Deal with legacy stuff.
Step 3: Connect to enterprise systems
Monitor concurrency
Limit concurrency for legacy connectivity
Hook up APIs to VPC-based services
Audit and log all invocations
What we need
to do

View Slide

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls

View Slide

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer Feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls
Insight: Concurrency control is a key
element of managing functions in a
serverless app.

View Slide

Lambda: Concurrency metric
Lambda: Per-function concurrency throttles
Enterprise connectivity
What you can do with it
1. Limit concurrency to legacy systems
2. Protect serverless production services from
other functions in the same account
3. Temporarily disable a function
4. Develop functions with limited billing and
“runaway” protection

View Slide

VPC (PrivateLink) integrations
Access services and data in
your VPC from an API
Regional endpoints
Fast, region-specific API
endpoints
Enterprise connectivity: API Gateway

View Slide


View Slide

API Gateway connectivity solutions
To
From
Internet
Regional
AWS Service
Customer VPC
Internet
Regional
AWS Service
Existing Service
(Edge-optimized, public integrations)
Private VPC
Region-optimized Endpoints
Region Endpoints
+Private VPC
Recent
New

View Slide

Log and audit
Structured logging for APIs
AWS CloudTrail support for
Lambda functions

View Slide

Serverless for the enterprise: checklist
Uptime
Scale
Performance
Management
Safe deploys
Concurrency controls

View Slide

What about GraphQL?

View Slide

GraphQL
Open, declarative data-fetching specification
!= Graph database
Use NoSQL, Relational, HTTP, etc.
Traditional data-fetching GraphQL
/posts
/postInfo
/postJustTitle
/postsByAuthor
/postNameStartsWithX
/commentsOnPost

View Slide

How does GraphQL work?
{
"id": "1",
"name": "Get Milk",
“priority": "1"
},
{
"id": “2",
"name": “Go to gym",
“priority": “5"
},…
type Query {
getTodos: [Todo]
}
type Todo {
id: ID!
name: String
description: String
priority: Int
duedate: String
}
query {
getTodos {
id
name
priority
}
}
Model data with
application schema
Client requests what it
needs
Only that data is
returned

View Slide

GraphQL
Schema
type Event {
id: ID!
name: String
where: String
when: String
description: String
comments: [Comment]
}
type Comment {
commentId: String!
eventId: ID!
content: String!
createdAt: String!
}

View Slide

GraphQL
Schema
Mutation
type Mutation {
createEvent(
name: String!,
when: String!,
where: String!,
description: String!
): Event
deleteEvent(id: ID!): Event
commentOnEvent(
eventId: ID!,
content: String!,
createdAt: String!
): Comment
}

View Slide

GraphQL
Schema
Mutation
Query
type Query {
getEvent(id: ID!): Event
listEvents(
limit: Int,
nextToken: String
): EventConnection
}

View Slide

GraphQL
Schema
Mutation
Query
Subscription
type Subscription {
subscribeToEventComments(eventId: String!): Comment
@aws_subscribe(mutations: ["commentOnEvent"])
}

View Slide

GraphQL
Schema
Mutation
Query
Subscription
Realtime? YES
Batching? YES
Pagination? YES
Relations? YES
Aggregations? YES
Search? YES
Offline? YES

View Slide

AWS AppSync
DynamoDB
Table
Lambda
Function Elasticsearch
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool

View Slide

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool
Legacy
Application

View Slide

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
DynamoDB to Elasticsearch
Sync Function
AppSync
API
Cognito
User Pool

View Slide

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Autogenerate
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool

View Slide

Demo:
AWS AppSync & GraphQL

View Slide

Serverless for everything
Lambda and API Gateway in every commercial AWS Region +
AWS GovCloud
Lambda@Edge new features:
• Content-based Dynamic Origin Selection
• Network Calls from Viewer Events
• Advanced Response Generation

View Slide

Serverless for everything
• Faster cold start performance
• Assurance programs: ISO, PCI, HIPAA
• …and now SOC 1, SOC 2, and SOC 3
• Lambda for devices (AWS Greengrass, AWS Snowball Edge)
• Lambda for Windows – CoreCLR 2.0

View Slide

An expanding Serverless ecosystem
Build and CI/CD
Logging and Monitoring
Applications and Deployment
Chalice Framework Serverless Java Container

View Slide

• Turn any Go program into a
Lambda function by adding 2
lines
• Open source connector
• Now available!
Golang in Lambda

View Slide

Serverless:
State of the Union
Danilo Poccia
Technical Evangelist
[email protected]
@danilop
danilop

View Slide

Serverless: State of the Union

Serverless: State of the Union

Danilo Poccia

More Decks by Danilo Poccia

Other Decks in Programming

Featured

Transcript