Noise Canceling RUM - We Love Speed 2023

Noisy Real User Monitoring (RUM) data can ruin your day! We introduce a fresh concept called “Human Visible Navigations” (HVN) to tackle this risk; we focus on the experiences you actually care about when talking about the speed of our sites.

Presentation given at We Love Speed in Paris, May 10th 2023

Transcript

1. Noise Canceling RUM
   @TimVereecke
   

   View Slide

2. Noise Canceling RUM
   @TimVereecke
   

   View Slide

3. Real User Monitoring
   

   View Slide

4. View Slide

5. Very Noisy
   

   View Slide

6. View Slide

7. Noise
   Canceling
   RUM
   

   View Slide

8. time
   speed
   Deploy
   

   View Slide

9. time
   speed
   J
   Deploy
   

   View Slide

10. time
    speed
    L
    Deploy
    

    View Slide

11. time
    speed
    LL
    Deploy
    

    View Slide

12. time
    speed Gap
    Deploy
    

    View Slide

13. time
    speed
    Impact
    Gap
    Deploy
    

    View Slide

14. time
    speed
    Reach
    Impact
    Gap
    Deploy
    

    View Slide

15. time
    speed
    Reach
    Impact
    Zone
    Gap
    Deploy
    

    View Slide

16. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy
    

    View Slide

17. Single Percentile Fetish
    

    View Slide

18. time
    TTFB
    Deploy
    p95
    p75
    p50
    p25
    p10
    

    View Slide

19. time
    TTFB
    Deploy
    32%
    Edge HIT
    68%
    Edge MISS
    p95
    p75
    p50
    p25
    p10
    

    View Slide

20. time
    TTFB
    Deploy
    63%
    Edge HIT
    27%
    Edge MISS
    p95
    p75
    p50
    p25
    p10
    

    View Slide

21. #1 Analyse multiple percentiles
    

    View Slide

22. We don’t cancel our Noise
    

    View Slide

23. #2 Focus on Human Visible Navigations
    

    View Slide

24. 15%
    noise
    1%
    noise
    6%
    noise
    

    View Slide

25. 15%
    noise
    1%
    noise
    6%
    noise
    78%
    HVN
    

    View Slide

26. 40K Visits a day
    6M Pageviews per month
    

    View Slide

27. View Slide

28. Navigations
    

    View Slide

29. View Slide

30. 85%
    14%
    1%
    Navigation Types (MPA)
    Navigation Back-Forward Reload
    

    View Slide

31. View Slide

32. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy
    

    View Slide

33. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%
    

    View Slide

34. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%
    Blindspot
    

    View Slide

35. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%
    Hours wasted tuning
    Database queries
    

    View Slide

36. Page Group Reload Noise
    Homepage 2.3%
    Search 2.9%
    PDP (Kits) 0.6%
    PDP (Aftermarket) 0.6%
    

    View Slide

37. View Slide

38. My site is different!
    

    View Slide

39. https://rumarchive.com/
    

    View Slide

40. Navigation Types
    

    View Slide

41. Navigation Types (MPA)
    

    View Slide

42. Visible
    

    View Slide

43. View Slide

44. 93%
    7% 0%
    Visibility States (MPA)
    Always Visible Always Hidden Partially Hidden
    

    View Slide

45. View Slide

46. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy
    

    View Slide

47. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%
    

    View Slide

48. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%
    Blindspot
    

    View Slide

49. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%
    Hours wasted tuning
    Database queries
    

    View Slide

50. Visibility States (MPA)
    

    View Slide

51. View Slide

52. Human
    

    View Slide

53. View Slide

54. View Slide

55. View Slide

56. View Slide

57. CLS Spikes due to Bot(s)
    

    View Slide

58. 15%
    noise
    1%
    noise
    6%
    noise
    Navigation type:
    Back-Forward, Reload
    Visibility-State:
    Always & Partially Hidden
    Bot Type:
    Any non-human
    78%
    HVN
    

    View Slide

59. 1%
    signal
    Bot Type:
    Any non-human
    78%
    noise
    15%
    signal
    Navigation type:
    Back-Forward, Reload
    6%
    signal
    Visibility-State:
    Always & Partially Hidden
    

    View Slide

60. Thank you!
    @TimVereecke
    

    View Slide

61. Questions?
    @TimVereecke
    

    View Slide