Innovating with confidence: FaaS at Netflix

By William Blankenship - Netflix

Presented at Functions 2018 / ServerlessDays Toronto

https://functions.events/2018/toronto/william-blankenship/

Transcript

3. A majority of customers interact with our brand exclusively through the services that we build
4. Every Request Every Device 130M+ Members
5. Innovating with Confidence William Blankenship Sr. Software Engineer
6. The challenge.
7. The challenge.
8. The challenge. Netflix API …
9. The challenge. ✔ Build and deploy server side business logic
10. The challenge. ✔ Build and deploy server side business logic ✖ Maintain and operate a distributed system at scale
11. Our customer.
12. Our customer. • Netflix device engineers
13. Our customer. • Netflix device engineers • Need to build server side business logic
14. Our customer. • Netflix device engineers • Need to build server side business logic • Are not staffed for distributed systems
16. serverless-like experience
17. Introducing the platform. Node.js
18. restify Introducing the platform.
19. GET /browse/originals ↳./lib/originals.js GET /hello_world ↳./hello_world.js Introducing the platform.
20. module.exports = function helloWorld(req, res, next) { res.send(200, "Hello World!"); return next(); }; Introducing the platform.
21. module.exports = function helloWorld(req, res, next) { res.send(200, "Hello World!"); return next(); }; Introducing the platform.
22. module.exports = function helloWorld(req, res, next) { res.send(200, "Hello World!"); return next(); }; Introducing the platform.
23. module.exports = function helloWorld(req, res, next) { res.send(200, "Hello World!"); return next(); }; Introducing the platform.
24. Introducing the platform. Metrics Registration Logging Tracing RPC And More!
25. Introducing the platform. module.exports = function helloWorld(req, res, next) { req.log("Hello Logger!"); req.getAtlas() .counter('hello').increment(); … }; Metrics Registration Logging Tracing RPC And More!
26. $ newt init Introducing the platform.
27. $ newt init Project Scaffolding Introducing the platform.
28. $ newt init Project Scaffolding CI/CD (Spinnaker + Jenkins) Introducing the platform.
29. $ newt init Project Scaffolding CI/CD (Spinnaker + Jenkins) Alerts + Dashboards (Atlas) Introducing the platform.
30. $ newt develop Introducing the platform.
31. $ newt develop $ newt test Introducing the platform.
32. $ newt develop $ newt test $ newt publish Introducing the platform.
33. $ newt deploy Introducing the platform.
34. Introducing the platform.
35. Introducing the platform.
36. Introducing the platform.
37. Introducing the platform.
38. Introducing the platform.
39. serverless-like experience
41. The strangler pattern.
42. The strangler pattern. Legacy API
43. The strangler pattern. Legacy API λ
44. The strangler pattern. Legacy API λ
45. The strangler pattern. Legacy API λ
46. The strangler pattern. λ Legacy API
47. The strangler pattern. Legacy API λ
48. The strangler pattern. λ λ λ λ λ λ λ λ λ λ λ Legacy API
49. The strangler pattern. λ Legacy API λ λ λ λ λ λ λ λ λ λ
50. The strangler pattern. λ Legacy API λ λ λ λ λ λ λ λ λ λ
51. Benefits of the strangler pattern.
52. Benefits of the strangler pattern. • Iterate with a tight feedback loop
53. Benefits of the strangler pattern. • Iterate with a tight feedback loop • Reduced blast radius
54. Benefits of the strangler pattern. • Iterate with a tight feedback loop • Reduced blast radius • Ability to fallback
55. Benefits of the strangler pattern. • Iterate with a tight feedback loop • Reduced blast radius • Ability to fallback • Isolate stability
56. Isolate change.
57. Isolate change. λ Legacy API λ λ λ λ λ λ λ λ λ λ
58. Isolate change. λ λ
59. Isolate change. λ λ CI/CD
60. Isolate change. λ λ CI/CD
61. Isolate change. λ λ CI/CD
62. Isolate change. λ λ CI/CD
63. Isolate change. • Surgically introduce change
64. Isolate change. • Surgically introduce change • Centrally track the changes being introduced
65. Isolate change. • Surgically introduce change • Centrally track the changes being introduced • Ship changes in isolation
67. Reduce blast radius. Legacy API λ
68. New Reduce blast radius. Old
69. Reduce blast radius. New Old
70. Reduce blast radius. New Old
71. Reduce blast radius. • Limit a change’s initial exposure to production traffic
72. Reduce blast radius. • Limit a change’s initial exposure to production traffic • Automatically route traffic away from regressions
73. Reduce blast radius. • Limit a change’s initial exposure to production traffic • Automatically route traffic away from regressions • Provide a tight feedback loop for engineers
75. Systems are not perfect
76. Minimize unintended change.
77. Minimize unintended change.
78. Minimize unintended change.
79. Minimize unintended change.
80. Minimize unintended change.
81. Minimize unintended change. d472aa25 260ae731 3b41da5c 0779b37e
82. Minimize unintended change. • Contain everything we need to run our application • Built in integrity checking
83. Minimize unintended change. Unit & Integration Tests
84. Minimize unintended change.
85. Minimize unintended change.
86. Minimize unintended change.
87. Minimize unintended change. • Tightly controlled build process
88. Minimize unintended change. • Tightly controlled build process • Artifacts contain the desired state of production
89. Minimize unintended change. • Tightly controlled build process • Artifacts contain the desired state of production • The state of the artifact is verifiable
92. Summary
93. Summary • Netflix is migrating our API to a serverless experience
94. Summary • Netflix is migrating our API to a serverless experience • We are investing in de-risking innovation at our tier
95. Summary • Netflix is migrating our API to a serverless experience • We are investing in de-risking innovation at our tier ◦ Isolating changes
96. Summary • Netflix is migrating our API to a serverless experience • We are investing in de-risking innovation at our tier ◦ Isolating changes ◦ Reducing the blast radius of changes
97. Summary • Netflix is migrating our API to a serverless experience • We are investing in de-risking innovation at our tier ◦ Isolating changes ◦ Reducing the blast radius of changes ◦ Minimizing unintended changes
99. William Blankenship Sr. Software Engineer Summary • Netflix is migrating our API to a serverless experience • We are investing in de-risking innovation at our tier ◦ Isolating changes ◦ Reducing the blast radius of changes ◦ Minimizing unintended changes