Fastly @ Google Next18

Stopping by Google GCP Next 18 to show how we leverage Google's cloud to build Fastly Edge Services

Transcript

1. Building the next generation of 
 Edge Cloud services with GCP
2. @Randommood Hi, I’m Inés Sombra
4. Globally distributed & Highly available
6. built in the time of Cloud Native
7. CDN redefined

8. CDN redefined
 Cloud Developed Native*
9. CDN redefined
 Cloud Developed Native* * not an actual industry term ⚠ Slide NOT vetted by Fastly Marketing
10. Edge Cloud Services
11. A tale of two Services ImageOpto Streaming Logs
12. Building Edge cloud Services + + + Goals Constraints ! Small Team
13. Edge Cloud Service Constraints Highly Available Globally distributed Horizontally Scalable Secure Performant Gracefully degrade under faults* Latency sensitive 
 and fast! (* when appropriate)
14. GCP & Fastly’s ImageOpto Service
15. JPEG 1920 × 1080 px Max quality 2.3MB Original image
16. Hero image Thumbnail image 200 × 200 px Quality 85 6.93KB vs 2.3MB JPEG 800 × 560 px Quality 85 47 KB vs 2.3MB
17. Edge Cloud Services
18. Origin ImageOpto Service
19. gordo-thumb please! Origin ImageOpto Service
20. original gordo please! gordo-thumb please! Origin ImageOpto Service
21. there you go gordo-thumb please! Origin ImageOpto Service
22. Origin gordo-thumb please! gordo-thumb please! ImageOpto Service
23. Origin Done! gordo-thumb please! ImageOpto Service
24. there you go gordo-thumb please! Origin ImageOpto Service
25. YASS! Origin ImageOpto Service
26. gordo-thumb please! Origin ImageOpto Service
27. Origin YASS! ImageOpto Service
28. ImageOpto Design Decisions
29. Orthogonality / Composability for request management for logging for authentication for state management for API translation for fault tolerance for caching!!! CDN for doing less work & max speed!
30. ImageOpto Pools Scaling ImageOpto with GCP
31. ImageOpto Pools Scaling ImageOpto with GCP
32. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP
33. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP
34. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP
35. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP
37. Leveraging GCP Allows strategic infrastructure planning to meet customer needs in new regions Terraform for easy region bootstrapping GCP is a seamless part of our service infrastructure Easy to get spendy POP to GCP connectivity planning (PNIs) Really tested our service operational processes Pros Cons
38. A neat Story ☠ us-east4
39. A neat Story ImageOpto us-east4 RPS
40. A neat Story ImageOpto Global RPS
41. A neat Story ImageOpto Global RPS whatevs
42. Learn more about ImageOpto www.fastly.com/io
43. GCP & The Fastly Streaming Logs Service
45. Edge Cloud Services
46. Streaming Logs Service
47. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders
48. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &
49. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &
50. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail … Aggregators Endpoints Senders &
51. Streaming Logs Design Decisions
52. Streaming Logs pipeline is stateless We don’t batch your logs We don’t store your logs We stream your logs in near real-bme to your defined endpoints
53. Logging Endpoints Aggregators Endpoints s3 syslog gcs sumologic bigquery ftp papertrail … Logging endpoints support various cloud services They enable our customers to perform traffic analysis
54. GCP Logging Endpoints GCP endpoint requests have increased as new services become available GCS has gained a lot of popularity since its introduction in Feb 2016 Big Query has lots of customer interest & we have recently re-architected it to support more volume Lots of opportunities to grow!
55. Classic integrabons challenges (each endpoint is a downstream dependency) Standard clients oeen don’t meet our needs as SDKs have different perspecVves Having our own clients allows us to befer support mulb tenancy. Collaborabng with the GCP team to maximize our collecbve throughput Our Challenges
56. Learn more about Streaming Logs www.fastly.com/google-next18
57. GCP & two Services ImageOpto Streaming Logs
58. TL; DR GCP allows us to easily grow new edge cloud services & be more targeted in our hardware investment GCP Big Data allows Fastly customers to extend their application insights from the Edge to the Cloud Happy relationship (as consumers, partners, & integrators)
59. https://go-review.googlesource.com/c/go/+/1862 https://go-review.googlesource.com/c/go/+/12865 https://go-review.googlesource.com/c/go/+/13148 https://go-review.googlesource.com/c/go/+/45972 https://go-review.googlesource.com/c/go/+/68313 https://go-review.googlesource.com/c/go/+/68351 https://go-review.googlesource.com/c/go/+/68350 https://go-review.googlesource.com/c/go/+/100718 https://go-review.googlesource.com/c/go/+/103861 https://go-review.googlesource.com/c/go/+/124315 https://go-review.googlesource.com/c/go/+/125635 https://go-review.googlesource.com/c/go/+/125636 Some of our Contributions
60. @Randommood THANK YOU speakerdeck.com/randommood/fastly-at-google-next18