Latency Measurement and Results Analysis

EXTENT TALKS: Tbilisi
20.04.2019

Arseniy Marinin, NFT Analyst, Exactpro
Alexander Tregubov, Senior NFT Analyst, Exactpro

Website https://extent.exactpro.com/

Linkedin https://www.linkedin.com/company/exactpro-systems-llc
Instagram https://www.instagram.com/qatbilisi/
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/qatbilisi/
Youtube Channel https://www.youtube.com/c/exactprosystems

Transcript

1. 20 April 2019, Tbilisi, Georgia Latency Measurement and Results Analysis Arseniy Marinin, NFT Analyst, Exactpro Alexander Tregubov, Senior NFT Analyst, Exactpro
2. 20 April 2019 Tbilisi, Georgia Low latency and big data TESTING is a process of researching software with the intent of finding bugs. RESEARCH comes with data analysis. In case of performance testing - HUGE amount of data. 2
3. 20 April 2019 Tbilisi, Georgia Gathering the right data What do we really want to measure? How do we want to measure? 3
4. 20 April 2019 Tbilisi, Georgia Gathering the right data 4
5. 20 April 2019 Tbilisi, Georgia How do we want to measure? B A 5
6. 20 April 2019 Tbilisi, Georgia Measurement process User behavior Load composition Load configuration: ramp-up vs. constant 6
7. 20 April 2019 Tbilisi, Georgia Gathering raw data 7
8. 20 April 2019 Tbilisi, Georgia Gathering raw data 8
9. 20 April 2019 Tbilisi, Georgia Aggregation Distribution Detalization and anomalies 9
10. 20 April 2019 Tbilisi, Georgia 10
11. 20 April 2019 Tbilisi, Georgia 11
12. 20 April 2019 Tbilisi, Georgia Average color of image #9d9ca0 12
13. 20 April 2019 Tbilisi, Georgia Aggregation Distribution Detalization and anomalies 13
14. 20 April 2019 Tbilisi, Georgia Distribution 14
15. 20 April 2019 Tbilisi, Georgia 15
16. 20 April 2019 Tbilisi, Georgia 16
17. 20 April 2019 Tbilisi, Georgia Histogram 17
18. 20 April 2019 Tbilisi, Georgia Distribution of data 18
19. 20 April 2019 Tbilisi, Georgia 19
20. 20 April 2019 Tbilisi, Georgia What about latency stats distribution? 20
21. 20 April 2019 Tbilisi, Georgia How real distribution looks like? 21
22. 20 April 2019 Tbilisi, Georgia How we should compare 2 releases? 22
23. 20 April 2019 Tbilisi, Georgia How we should compare 2 releases? 23
24. 20 April 2019 Tbilisi, Georgia Aggregation Distribution Detalization and anomalies 24
25. 20 April 2019 Tbilisi, Georgia John Snow (281 AC - 302 AC, 302 AC - …) 25
26. 20 April 2019 Tbilisi, Georgia John Snow (1813 - 1858) One of the founders of modern epidemiology. Cholera outbreak in Soho, London, in 1854. 26
27. 20 April 2019 Tbilisi, Georgia London Cholera Epidemic of 1854 27
28. 20 April 2019 Tbilisi, Georgia 28
29. 20 April 2019 Tbilisi, Georgia 29
30. 20 April 2019 Tbilisi, Georgia 30
31. 20 April 2019 Tbilisi, Georgia Going into details 31
32. 20 April 2019 Tbilisi, Georgia Looking at the extremes and anomalies 32
33. 20 April 2019 Tbilisi, Georgia The Fastest vs. The Slowest 169 requests from 47 domains 4 MB transferred Pegs CPU for 4 seconds Rendering doesn’t begin for 20 seconds 33
34. 20 April 2019 Tbilisi, Georgia The Fastest vs. The Slowest 34
35. 20 April 2019 Tbilisi, Georgia Percentile 35
36. 20 April 2019 Tbilisi, Georgia Median 36
37. 20 April 2019 Tbilisi, Georgia Max 99% percentile graph 37
38. 20 April 2019 Tbilisi, Georgia Conclusion Keep looking at your data Investigate anomalies Go into details 38 Inspired by: Velocity 2011: John Rauser, "Look at Your Data" Velocity 2012: John Rauser, "Investigating Anomalies"
39. 20 April 2019 Tbilisi, Georgia Thanks for your attention! 39