Sergey Fedorov - What can network teach you about your service? - Monitorama PDX'19

A Netflix story of building a client-based system to run experiments to measure different aspects of client-server network interactions, analyze results and get meaningful signals to improve user experience.

Transcript

4. Network Request Time Device Processing Server Processing
5. DNS TCP TLS First Byte Download Device Processing Server Processing
9. • • • •
11. 5KB 5KB 5KB HTTP GET target1.test.me target2.test.me target3.test.me
12. target1.test.me target2.test.me target3.test.me HTTP GET
13. BIASED
16. 5KB 5KB 5KB HTTP GET target1.test.me target2.test.me target3.test.me DNS TCP TLS Protocol
17. HTTP GET - target1.test.me - target2.test.me - target3.test.me Connect + download 5KB Report: request time { target1: duration: 10, dns: 2, tcp: 3, tls: 4, ttfb: 6 target2: ..., target3: ... }, { ... } ...
22. server1.test.me server2.test.me server3.test.me 5KB 5KB 5KB GET Recipe
23. server1.test.me server2.test.me server3.test.me 5KB 5KB 5KB POST Result
28. Latency (ms) Control Experiment # of requests Latency (ms) # of requests Latency (ms) # of requests Control Experiment better
29. Latency (ms) Control Experiment # of requests Latency (ms) # of requests Latency (ms) # of requests Control Experiment better
30. # of requests Control Experiment Experiment - Control Experiment – Control (ms) 0 0 0 0 0 0 Magnitude of the latency change Number of impacted requests
31. Latency (ms) # of requests Control Experiment
32. Latency (ms) # of requests Control Experiment 0 0 0 0 0 0 0 0
33. Latency (ms) # of requests Control Experiment 0 0 0 0 0 0 Control latency, percentile vg(Experiment- Control), ms 0 0
36. DNS TCP TLS First Byte Download Device Processing Server Processing
41. ? ? ? HTTP GET server1.mydata.com server2.mydata.com server3.mydata.com
42. server2.mydata.com server1.mydata.com server3.mydata.com OK FAIL OK HTTP GET
43. server2.mydata.com server1.mydata.com server3.mydata.com FAIL FAIL FAIL HTTP GET
45. ≈ ≈ => Network Traffic Model
46. Path 1 Path 3 Path 2 + ≈
48. App Start Wait Run Probes Done
52. iOS
54. https://github.com/Netflix/probnik BETA
55. • • • • • • •
56. • • • • •