Fastly @ Google Next18

Fastly @ Google Next18

Stopping by Google GCP Next 18 to show how we leverage Google's cloud to build Fastly Edge Services

C64a0152c9b0928e62d88f0bb5eb8138?s=128

Ines Sombra

July 24, 2018
Tweet

Transcript

  1. Building the next generation of 
 Edge Cloud services with

    GCP
  2. @Randommood Hi, I’m Inés Sombra

  3. None
  4. Globally distributed & Highly available

  5. None
  6. built in the time of Cloud Native

  7. CDN redefined


  8. CDN redefined
 Cloud Developed Native*

  9. CDN redefined
 Cloud Developed Native* * not an actual industry

    term ⚠ Slide NOT vetted by Fastly Marketing
  10. Edge Cloud Services

  11. A tale of two Services ImageOpto Streaming Logs

  12. Building Edge cloud Services + + + Goals Constraints !

    Small Team
  13. Edge Cloud Service Constraints Highly Available Globally distributed Horizontally Scalable

    Secure Performant Gracefully degrade under faults* Latency sensitive 
 and fast! (* when appropriate)
  14. GCP & Fastly’s ImageOpto Service

  15. JPEG 1920 × 1080 px Max quality 2.3MB Original image

  16. Hero image Thumbnail image 200 × 200 px Quality 85 6.93KB vs

    2.3MB JPEG 800 × 560 px Quality 85 47 KB vs 2.3MB
  17. Edge Cloud Services

  18. Origin ImageOpto Service

  19. gordo-thumb please! Origin ImageOpto Service

  20. original gordo please! gordo-thumb please! Origin ImageOpto Service

  21. there you go gordo-thumb please! Origin ImageOpto Service

  22. Origin gordo-thumb please! gordo-thumb please! ImageOpto Service

  23. Origin Done! gordo-thumb please! ImageOpto Service

  24. there you go gordo-thumb please! Origin ImageOpto Service

  25. YASS! Origin ImageOpto Service

  26. gordo-thumb please! Origin ImageOpto Service

  27. Origin YASS! ImageOpto Service

  28. ImageOpto Design Decisions

  29. Orthogonality / Composability for request management for logging for authentication

    for state management for API translation for fault tolerance for caching!!! CDN for doing less work & max speed!
  30. ImageOpto Pools Scaling ImageOpto with GCP

  31. ImageOpto Pools Scaling ImageOpto with GCP

  32. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

  33. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

  34. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

  35. ImageOpto Pools ImageOpto GCP Scaling ImageOpto with GCP

  36. None
  37. Leveraging GCP Allows strategic infrastructure planning to meet customer needs

    in new regions Terraform for easy region bootstrapping GCP is a seamless part of our service infrastructure Easy to get spendy POP to GCP connectivity planning (PNIs) Really tested our service operational processes Pros Cons
  38. A neat Story ☠ us-east4

  39. A neat Story ImageOpto us-east4 RPS

  40. A neat Story ImageOpto Global RPS

  41. A neat Story ImageOpto Global RPS whatevs

  42. Learn more about ImageOpto www.fastly.com/io

  43. GCP & The Fastly Streaming Logs Service

  44. None
  45. Edge Cloud Services

  46. Streaming Logs Service

  47. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail

    … Aggregators Endpoints Senders
  48. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail

    … Aggregators Endpoints Senders &
  49. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail

    … Aggregators Endpoints Senders &
  50. Streaming Logs Service s3 syslog gcs sumologic bigquery ftp papertrail

    … Aggregators Endpoints Senders &
  51. Streaming Logs Design Decisions

  52. Streaming Logs pipeline is stateless We don’t batch your logs

    We don’t store your logs We stream your logs in near real-bme to your defined endpoints
  53. Logging Endpoints Aggregators Endpoints s3 syslog gcs sumologic bigquery ftp

    papertrail … Logging endpoints support various cloud services They enable our customers to perform traffic analysis
  54. GCP Logging Endpoints GCP endpoint requests have increased as new

    services become available GCS has gained a lot of popularity since its introduction in Feb 2016 Big Query has lots of customer interest & we have recently re-architected it to support more volume Lots of opportunities to grow!
  55. Classic integrabons challenges (each endpoint is a downstream dependency) Standard

    clients oeen don’t meet our needs as SDKs have different perspecVves Having our own clients allows us to befer support mulb tenancy. Collaborabng with the GCP team to maximize our collecbve throughput Our Challenges
  56. Learn more about Streaming Logs www.fastly.com/google-next18

  57. GCP & two Services ImageOpto Streaming Logs

  58. TL; DR GCP allows us to easily grow new edge

    cloud services & be more targeted in our hardware investment GCP Big Data allows Fastly customers to extend their application insights from the Edge to the Cloud Happy relationship (as consumers, partners, & integrators)
  59. https://go-review.googlesource.com/c/go/+/1862 https://go-review.googlesource.com/c/go/+/12865 https://go-review.googlesource.com/c/go/+/13148 https://go-review.googlesource.com/c/go/+/45972 https://go-review.googlesource.com/c/go/+/68313 https://go-review.googlesource.com/c/go/+/68351 https://go-review.googlesource.com/c/go/+/68350 https://go-review.googlesource.com/c/go/+/100718 https://go-review.googlesource.com/c/go/+/103861 https://go-review.googlesource.com/c/go/+/124315

    https://go-review.googlesource.com/c/go/+/125635 https://go-review.googlesource.com/c/go/+/125636 Some of our Contributions
  60. @Randommood THANK YOU speakerdeck.com/randommood/fastly-at-google-next18