$30 off During Our Annual Pro Sale. View Details »

Noise Canceling RUM - We Love Speed 2023

Noise Canceling RUM - We Love Speed 2023

Noisy Real User Monitoring (RUM) data can ruin your day! We introduce a fresh concept called “Human Visible Navigations” (HVN) to tackle this risk; we focus on the experiences you actually care about when talking about the speed of our sites.

Presentation given at We Love Speed in Paris, May 10th 2023

Tim Vereecke

May 11, 2023
Tweet

Other Decks in Technology

Transcript

  1. Noise Canceling RUM
    @TimVereecke

    View Slide

  2. Noise Canceling RUM
    @TimVereecke

    View Slide

  3. Real User Monitoring

    View Slide

  4. View Slide

  5. Very Noisy

    View Slide

  6. View Slide

  7. Noise
    Canceling
    RUM

    View Slide

  8. time
    speed
    Deploy

    View Slide

  9. time
    speed
    J
    Deploy

    View Slide

  10. time
    speed
    L
    Deploy

    View Slide

  11. time
    speed
    LL
    Deploy

    View Slide

  12. time
    speed Gap
    Deploy

    View Slide

  13. time
    speed
    Impact
    Gap
    Deploy

    View Slide

  14. time
    speed
    Reach
    Impact
    Gap
    Deploy

    View Slide

  15. time
    speed
    Reach
    Impact
    Zone
    Gap
    Deploy

    View Slide

  16. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy

    View Slide

  17. Single Percentile Fetish

    View Slide

  18. time
    TTFB
    Deploy
    p95
    p75
    p50
    p25
    p10

    View Slide

  19. time
    TTFB
    Deploy
    32%
    Edge HIT
    68%
    Edge MISS
    p95
    p75
    p50
    p25
    p10

    View Slide

  20. time
    TTFB
    Deploy
    63%
    Edge HIT
    27%
    Edge MISS
    p95
    p75
    p50
    p25
    p10

    View Slide

  21. #1 Analyse multiple percentiles

    View Slide

  22. We don’t cancel our Noise

    View Slide

  23. #2 Focus on Human Visible Navigations

    View Slide

  24. 15%
    noise
    1%
    noise
    6%
    noise

    View Slide

  25. 15%
    noise
    1%
    noise
    6%
    noise
    78%
    HVN

    View Slide

  26. 40K Visits a day
    6M Pageviews per month

    View Slide

  27. View Slide

  28. Navigations

    View Slide

  29. View Slide

  30. 85%
    14%
    1%
    Navigation Types (MPA)
    Navigation Back-Forward Reload

    View Slide

  31. View Slide

  32. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy

    View Slide

  33. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%

    View Slide

  34. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%
    Blindspot

    View Slide

  35. Page Group Back-Forward Noise
    Homepage 8.1%
    Search 22.9%
    PDP (Kits) 9.3%
    PDP (Aftermarket) 5.9%
    Hours wasted tuning
    Database queries

    View Slide

  36. Page Group Reload Noise
    Homepage 2.3%
    Search 2.9%
    PDP (Kits) 0.6%
    PDP (Aftermarket) 0.6%

    View Slide

  37. View Slide

  38. My site is different!

    View Slide

  39. https://rumarchive.com/

    View Slide

  40. Navigation Types

    View Slide

  41. Navigation Types (MPA)

    View Slide

  42. Visible

    View Slide

  43. View Slide

  44. 93%
    7% 0%
    Visibility States (MPA)
    Always Visible Always Hidden Partially Hidden

    View Slide

  45. View Slide

  46. time
    speed
    Reach
    Impact
    Zone
    Percentile
    Gap
    Deploy

    View Slide

  47. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%

    View Slide

  48. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%
    Blindspot

    View Slide

  49. Page Group (Partially) Hidden Noise
    Homepage 10.8%
    Search 1.5%
    PDP (Kits) 6.2%
    PDP (Aftermarket) 10.1%
    Hours wasted tuning
    Database queries

    View Slide

  50. Visibility States (MPA)

    View Slide

  51. View Slide

  52. Human

    View Slide

  53. View Slide

  54. View Slide

  55. View Slide

  56. View Slide

  57. CLS Spikes due to Bot(s)

    View Slide

  58. 15%
    noise
    1%
    noise
    6%
    noise
    Navigation type:
    Back-Forward, Reload
    Visibility-State:
    Always & Partially Hidden
    Bot Type:
    Any non-human
    78%
    HVN

    View Slide

  59. 1%
    signal
    Bot Type:
    Any non-human
    78%
    noise
    15%
    signal
    Navigation type:
    Back-Forward, Reload
    6%
    signal
    Visibility-State:
    Always & Partially Hidden

    View Slide

  60. Thank you!
    @TimVereecke

    View Slide

  61. Questions?
    @TimVereecke

    View Slide