eBPF Vienna 2025 Presentation

Transcript

1. Reducing cold start delays in FaaS and Serverless Environments Vienna
2. About me • Iʼm Teodor J. Podobnik from Slovenia 󰐶 • SRE at Prewave • Researcher at Faculty of Computer Science and Information Science, University of Ljubljana • Author of eBPFChirp 2 https://www.prewave.com https://fri.uni-lj.si https://ebpfchirp.substack.com
3. 3 The Problem of cold start delays
4. 4 FaaS (AWS Lambda, Cloud Run, …) Code Execution Container Initialization Cold start Warm start Event Deploy Cost vs. Latency
5. Real-time data analytics Image or video transcoding Web API endpoints Demand Constant demand, no cold starts Predictable demand, no cold starts
6. 6 FaaS (AWS Lambda, Cloud Run, …) Code Execution Container Initialization Cold start Warm start Event Deploy
7. 7 FaaS (AWS Lambda, Cloud Run, …) Code Execution Container Initialization Cold start Warm start Event Deploy Network Latency
8. 8 Client FaaS Provider 25 ms Source: https://wondernetwork.com/pings 100 ms 250 m s 240 ms Ping Latency
9. 9 Client FaaS Provider 50+ ms Source: https://wondernetwork.com/pings 200+ ms 500+ m s 480+ ms Aprox. FaaS Latency Could we “leverage” network latency to our advantage?
10. Cloudflare Solution • “Pre-warming” during TLS handshake -> hostname from SNI • CloudFlare Workers (NOT containers!) • Not open-source 10 Source: https://blog.cloudflare.com/eliminating-cold-starts-with-cloudflare-workers/
11. Cloudflare Solution • “Pre-warming” during TLS handshake -> hostname from SNI • CloudFlare Workers (NOT containers!) • Not open-source 11 Source: https://blog.cloudflare.com/eliminating-cold-starts-with-cloudflare-workers/
12. 12 eBPF Solution
13. eBPF Solution 13
14. eBPF Solution 14
15. TCP Packet Custom Payload 15
16. FaaS Function per TCP Port 16
17. Results 17 • Optimal Speed-Up: • Function “warm start” is the limit Network latency >= Function initialization time
18. 18 Q&A