The Good, The Bad, and The Ugly of the HTTP Archive

C620790ae5bf5b50c245b2e0ef95f338?s=47 Dean Hume
September 17, 2014

The Good, The Bad, and The Ugly of the HTTP Archive

Presented at Velocity Conference, September 2014.

The web is a fascinating place. Every day millions of websites around the world are constantly evolving and growing. Fortunately, great resources such as the HTTP archive capture statistics from over 300K URLS, and provide us with useful insights into the world of web performance.

http://deanhume.com
http://robinosborne.co.uk

C620790ae5bf5b50c245b2e0ef95f338?s=128

Dean Hume

September 17, 2014
Tweet

Transcript

  1. 6.

    HTTP Archive • Started in November 2011 • Contains over

    300K URLs • Both Mobile and Desktop sites
  2. 16.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modern
  3. 17.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modernmodern(ish)
  4. 18.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modern • Follows best practices modern(ish)
  5. 19.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modern • Follows best practices • Not a porn site modern(ish)
  6. 20.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modern • Follows best practices • Not a porn site (sorry) modern(ish)
  7. 21.

    The Criteria • The Alexa top 100 sites have been

    excluded from this list • The site needs to be usable and modern • Follows best practices • Not a porn site (sorry) • Bonus points for a responsive site modern(ish)
  8. 22.
  9. 23.
  10. 24.
  11. 26.
  12. 27.

    Key takeaway • Super fast holding pages • Super fast

    porn sites Http Archive + Big Query is a great way to find:
  13. 28.
  14. 31.

    Fully loaded A time measurement that includes any activity that

    is triggered by JavaScript after the main page loads.
  15. 33.

    Page Speed The PageSpeed Score (0- 100) is calculated on

    a number of factors. A high score is good. A low score is not so good.
  16. 35.

    Speed Index Speed Index measures how complete a page is

    during various points in page load A low score is good. A high score is not so good.
  17. 36.
  18. 37.

    SELECT url, pagespeed, SpeedIndex, fullyLoaded, rank FROM [httparchive:runs.latest_pages] WHERE (rank

    is not null) and (speedindex is not null) and pagespeed > 80 ORDER BY rank asc, pagespeed desc, speedindex asc limit 1000 ;
  19. 39.
  20. 40.

    filament group • 8-person development studio based all around the

    US • Develop a wide range of sites and apps • Responsive website
  21. 43.

    “How we load assets matters just as much as how

    many assets we’re loading. We focus on perceived performance”
  22. 45.
  23. 53.
  24. 54.

    nature.com • Scientific journal for research across a wide range

    of fields • Part of the Macmillan publishing group • Responsive website • Based in London, UK
  25. 56.
  26. 57.

    “ We try to stick to the 14 rules as

    outlined in High Performance Web Sites ”
  27. 58.
  28. 66.
  29. 67.

    Online restaurant guide - Based in New Delhi, India -

    13 countries in 5 languages - Responsive site - zomato.xxx -
  30. 70.

    “A blank page is always going to be the fastest,

    start from there. Add only what is needed.”
  31. 76.
  32. 77.

    envato marketplaces ➔ Specializes in online marketplaces ➔ Based in

    Melbourne, Australia ➔ Themeforest, CodeCanyon
  33. 86.
  34. 91.

    welovefashion.it ➔ Visually complete in 20 secs ➔ Fully loaded

    in 30 secs ➔ 3.5 MB of resources are downloaded
  35. 94.
  36. 95.
  37. 99.

    gu-japan.com ➔ 15.5 MB of images are loaded ➔ Visually

    complete in 16 secs ➔ Fully loaded in 35 secs
  38. 100.

    gu-japan.com ➔ 15.5 MB of images are loaded ➔ Visually

    complete in 16 secs ➔ Fully loaded in 35 secs ➔ 717 HTTP requests
  39. 103.

    1%

  40. 105.
  41. 106.
  42. 113.
  43. 114.
  44. 115.
  45. 117.
  46. 118.

    44

  47. 122.

    sailboatlistings.com • Fully loaded in 18 secs • Visually complete

    in 20 secs • 3 MB total • 580 requests in total
  48. 123.

    sailboatlistings.com • Fully loaded in 18 secs • Visually complete

    in 20 secs • 3 MB total • 580 requests in total • 535 image requests
  49. 124.

    sailboatlistings.com • Fully loaded in 18 secs • Visually complete

    in 20 secs • 3 MB total • 580 requests in total • 535 image requests • 14872 dom elements
  50. 126.

    14

  51. 130.

    colorsbycherry.com 34 MB of resources Fully loaded in 1 min

    Visually complete in 30 secs say what!?
  52. 132.
  53. 133.

    11

  54. 137.
  55. 138.

    callofduty.com 15.2 MB of resources Visually complete in 1.3 secs

    Fully loaded in 13 secs Page Speed score of 11 callofduty.com
  56. 139.
  57. 143.
  58. 144.
  59. 145.

    psi • Page Speed Insights • Get PSI reporting from

    the command line • On GitHub, by Addy Osmani • Can be hooked into a build process via the Gulp or Grunt plugins
  60. 146.
  61. 149.
  62. 151.