Fastly @ Google Next18 - Speaker Deck

Slide 1

Slide 1 text

Building the next generation of   Edge Cloud services with GCP

Slide 2

Slide 2 text

@Randommood Hi, I’m Inés Sombra

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

Globally distributed & Highly available

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

built in the time of Cloud Native

Slide 7

Slide 7 text

CDN redefined 

Slide 8

Slide 8 text

CDN redefined  Cloud Developed Native*

Slide 9

Slide 9 text

CDN redefined  Cloud Developed Native* * not an actual industry term ⚠ Slide NOT vetted by Fastly Marketing

Slide 10

Slide 10 text

Edge Cloud Services

Slide 11

Slide 11 text

A tale of two Services ImageOpto Streaming Logs

Slide 12

Slide 12 text

Building Edge cloud Services + + + Goals Constraints ! Small Team

Slide 13

Slide 13 text

Edge Cloud Service Constraints Highly Available Globally distributed Horizontally Scalable Secure Performant Gracefully degrade under faults* Latency sensitive   and fast! (* when appropriate)

Slide 14

Slide 14 text

GCP & Fastly’s ImageOpto Service

Slide 15

Slide 15 text

JPEG 1920 × 1080 px Max quality 2.3MB Original image

Slide 16

Slide 16 text

Hero image Thumbnail image 200 × 200 px Quality 85 6.93KB vs 2.3MB JPEG 800 × 560 px Quality 85 47 KB vs 2.3MB

Slide 17

Slide 17 text

Edge Cloud Services

Slide 18

Slide 18 text

Origin ImageOpto Service

Slide 19

Slide 19 text

gordo-thumb please! Origin ImageOpto Service

Slide 20

Slide 20 text

original gordo please! gordo-thumb please! Origin ImageOpto Service

Slide 21

Slide 21 text

there you go gordo-thumb please! Origin ImageOpto Service

Slide 22

Slide 22 text

Origin gordo-thumb please! gordo-thumb please! ImageOpto Service

Slide 23

Slide 23 text

Origin Done! gordo-thumb please! ImageOpto Service

Slide 24

Slide 24 text

there you go gordo-thumb please! Origin ImageOpto Service

Slide 25

Slide 25 text

YASS! Origin ImageOpto Service

Slide 26

Slide 26 text

gordo-thumb please! Origin ImageOpto Service

Slide 27

Slide 27 text

Origin YASS! ImageOpto Service

Slide 28

Slide 28 text

ImageOpto Design Decisions

Slide 29

Slide 29 text

Orthogonality / Composability for request management for logging for authentication for state management for API translation for fault tolerance for caching!!! CDN for doing less work & max speed!

Slide 30

Slide 30 text

ImageOpto Pools Scaling ImageOpto with GCP

Slide 31

Slide 31 text

ImageOpto Pools Scaling ImageOpto with GCP

Slide 32

Slide 32 text

ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

Slide 33

Slide 33 text

ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

Slide 34

Slide 34 text

ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

Slide 35

Slide 35 text

ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

Slide 36

Slide 36 text

No content

Slide 37

Slide 37 text

Leveraging GCP Allows strategic infrastructure planning to meet customer needs in new regions Terraform for easy region bootstrapping GCP is a seamless part of our service infrastructure Easy to get spendy POP to GCP connectivity planning (PNIs) Really tested our service operational processes Pros Cons

Slide 38

Slide 38 text

A neat Story ☠ us-east4

Slide 39

Slide 39 text

A neat Story ImageOpto us-east4 RPS

Slide 40

Slide 40 text

A neat Story ImageOpto Global RPS

Slide 41

Slide 41 text

A neat Story ImageOpto Global RPS whatevs

Slide 42

Slide 42 text

Learn more about ImageOpto www.fastly.com/io

Slide 43

Slide 43 text

GCP & The Fastly Streaming Logs Service

Slide 44

Slide 44 text

No content

Slide 45

Slide 45 text

Edge Cloud Services

Slide 46

Slide 46 text

Streaming Logs Service

Slide 47

Slide 47 text

Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders

Slide 48

Slide 48 text

Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &

Slide 49

Slide 49 text

Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &

Slide 50

Slide 50 text

Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &

Slide 51

Slide 51 text

Streaming Logs Design Decisions

Slide 52

Slide 52 text

Streaming Logs pipeline is stateless We don’t batch your logs We don’t store your logs We stream your logs in near real-bme to your deﬁned endpoints

Slide 53

Slide 53 text

Logging Endpoints Aggregators Endpoints s3 syslog gcs sumologic bigquery ftp papertrail … Logging endpoints support various cloud services They enable our customers to perform traﬃc analysis

Slide 54

Slide 54 text

GCP Logging Endpoints GCP endpoint requests have increased as new services become available GCS has gained a lot of popularity since its introduction in Feb 2016 Big Query has lots of customer interest & we have recently re-architected it to support more volume Lots of opportunities to grow!

Slide 55

Slide 55 text

Classic integrabons challenges (each endpoint is a downstream dependency) Standard clients oeen don’t meet our needs as SDKs have diﬀerent perspecVves Having our own clients allows us to befer support mulb tenancy. Collaborabng with the GCP team to maximize our collecbve throughput Our Challenges

Slide 56

Slide 56 text

Learn more about Streaming Logs www.fastly.com/google-next18

Slide 57

Slide 57 text

GCP & two Services ImageOpto Streaming Logs

Slide 58

Slide 58 text

TL; DR GCP allows us to easily grow new edge cloud services & be more targeted in our hardware investment GCP Big Data allows Fastly customers to extend their application insights from the Edge to the Cloud Happy relationship (as consumers, partners, & integrators)

Slide 59

Slide 59 text

https://go-review.googlesource.com/c/go/+/1862 https://go-review.googlesource.com/c/go/+/12865 https://go-review.googlesource.com/c/go/+/13148 https://go-review.googlesource.com/c/go/+/45972 https://go-review.googlesource.com/c/go/+/68313 https://go-review.googlesource.com/c/go/+/68351 https://go-review.googlesource.com/c/go/+/68350 https://go-review.googlesource.com/c/go/+/100718 https://go-review.googlesource.com/c/go/+/103861 https://go-review.googlesource.com/c/go/+/124315 https://go-review.googlesource.com/c/go/+/125635 https://go-review.googlesource.com/c/go/+/125636 Some of our Contributions

Slide 60

Slide 60 text

@Randommood THANK YOU speakerdeck.com/randommood/fastly-at-google-next18