$30 off During Our Annual Pro Sale. View Details »

Optimize sitemaps for large e-commerce websites

Optimize sitemaps for large e-commerce websites

Stevy Liakopoulou

September 09, 2023
Tweet

Transcript

  1. Οptimize sitemaps for
    large e-commerce
    websites
    Stevy Liakopoulou
    Search Magic
    Stevy Liakopoulou
    [email protected]

    View Slide

  2. I HAVE A
    QUESTION
    #brightonseo

    View Slide

  3. #brightonseo

    View Slide

  4. #brightonseo

    View Slide

  5. TOP ERRORS
    01
    02
    03
    04
    05
    06
    07
    DISCOVERED-CURRENTLY NO INDEX
    PAGES THAT TURN TO 404
    NO CANONICAL TAGS
    LONG, COMPLEX URLS
    ORPHAN PAGES
    OUT OF STOCK PRODUCTS
    THIN CONTENT PAGES
    DUPLICATION
    #brightonseo

    View Slide

  6. View Slide

  7. CRAWL
    BUDGET
    MAIN GOALS
    #brightonseo

    View Slide

  8. NO INDEX
    PAGES
    CRAWL
    BUDGET
    MAIN GOALS
    #brightonseo

    View Slide

  9. DUPLICATION
    NO INDEX
    PAGES
    CRAWL
    BUDGET
    MAIN GOALS
    #brightonseo

    View Slide

  10. DUPLICATION
    NO INDEX
    PAGES
    CRAWL
    BUDGET
    ERRORS
    MAIN GOALS
    #brightonseo

    View Slide

  11. 1. HIERARCHY &
    ORGANIZATION
    #brightonseo

    View Slide

  12. GROUP
    URLS
    LOGICALLY
    #brightonseo

    View Slide

  13. GROUP
    URLS
    LOGICALLY
    SUBSITEMAPS
    #brightonseo

    View Slide

  14. GROUP
    URLS
    LOGICALLY
    SUBSITEMAPS LANGUAGES
    #brightonseo

    View Slide

  15. 2. INDEXATION
    DEBUGGING
    #brightonseo

    View Slide

  16. HYPOTHESIS
    100K PRODUCT PAGES
    5K CATEGORY PAGES
    20K SUB CATEGORY PAGES
    SITEMAP
    #brightonseo

    View Slide

  17. RESULTS
    50K INDEXED PAGES
    75K NO-INDEXED
    PAGES
    #brightonseo

    View Slide

  18. View Slide

  19. View Slide

  20. 75K NO INDEX
    PAGES
    WHAT TYPE OF PAGES
    ARE?
    BUT
    #brightonseo

    View Slide

  21. ΤYPES
    1.CATEGORIES + SUBCATEGORIES
    WITH 1 OR 0 PRODUCTS
    #brightonseo

    View Slide

  22. ΤYPES
    1.CATEGORIES + SUBCATEGORIES
    WITH 1 OR 0 PRODUCTS
    MERGE?
    REMOVE THE ZERO PRODUCT CATEGORIES?
    #brightonseo

    View Slide

  23. ΤYPES
    2. DUPLICATION
    #brightonseo

    View Slide

  24. NON-CANONICAL URLs
    #brightonseo
    #brightonseo

    View Slide

  25. DUPLICATE URL PATHS
    #brightonseo
    #brightonseo
    www.domain.com/cat1/cat2/cat3/women-skirt-1
    www.domain.com/cat1/cat2/cat3/women-skirt-2

    View Slide

  26. WWW vs. Non-WWW Urls
    #brightonseo
    #brightonseo
    www.domain.com/cat1/cat2/cat3/women-skirt-2
    domain.com/cat1/cat2/cat3/women-skirt-2

    View Slide

  27. UPPERCASE vs. LOWERCASE URLs
    #brightonseo
    #brightonseo
    www.domain.com/CAT1/cat2/cat3/women-skirt-2
    www.domain.com/cat1/cat2/cat3/women-skirt-2

    View Slide

  28. TRAILING SLASHES on URLs
    #brightonseo
    #brightonseo
    www.domain.com/cat1/cat2/cat3/women-skirt-2
    www.domain.com/cat1/cat2/cat3/women-
    skirt-2/

    View Slide

  29. ΤYPES
    3. PRODUCT PAGES WITH NO CONTENT
    #brightonseo

    View Slide

  30. ΤYPES
    3. PRODUCT PAGES WITH NO CONTENT
    4. PRODUCT PAGES WITH DUPLICATED
    CONTENT
    #brightonseo

    View Slide

  31. ΤYPES
    3. PRODUCT PAGES WITH NO CONTENT
    4. PRODUCT PAGES WITH DUPLICATED
    CONTENT
    5. PRODUCT PAGES WITH DESCRIPTION
    < 50 WORDS
    #brightonseo

    View Slide

  32. FUN FACT
    "GOOGLE CAN'T INDEX EVERYTHING ON
    THE WEB SO IT'S IMPORTANT TO BE
    SELECTIVE BY INDEXING ONLY THE
    CONTENT THAT MATTERS"
    l
    https://www.searchenginejournal.com/indexing-and-crawl-budget/462742/
    #brightonseo

    View Slide

  33. OPTIMIZE 1. DEFINE YOUR MOST
    IMPORTANT PRODUCTS
    AND MAKE MANUALLY
    OPTIMIZATIONS
    #brightonseo

    View Slide

  34. OPTIMIZE 2. NON- HIGH PRIORITY
    THIN CONTENT PRODUCT
    PAGES, TRY TO IMPROVE
    THEM OR NOINDEX THEM
    #brightonseo

    View Slide

  35. OPTIMIZE 3. ADD IN SITEMAP THE
    PREFERRED VERSIONS
    OF YOUR PAGES AND NOT
    THE ALTERNATES
    #brightonseo

    View Slide

  36. 3. OUT OF
    STOCK
    PRODUCTS
    #brightonseo

    View Slide

  37. "AND WHEN IT COMES TO THE REGULAR
    SEARCH RESULTS, IT CAN HAPPEN THAT
    WHEN WE SEE THAT SOMETHING IS OUT OF
    STOCK, WE WILL ASSUME IT’S MORE LIKE A
    SOFT 404 ERROR, WHERE WE WILL DROP
    THAT URL FROM THE SEARCH RESULTS AS
    WELL."
    John Mueller
    #brightonseo

    View Slide

  38. #brightonseo

    View Slide

  39. SCENARIO 1: PRODUCTS
    ARE PERMANENTLY OUT OF
    STOCK
    #brightonseo

    View Slide

  40. OPTIMIZATIONS
    IF RECEIVES TRAFFIC OR HAS
    BACKLINKS OR HAS RANKINGS
    #brightonseo

    View Slide

  41. OPTIMIZATIONS
    IF RECEIVES TRAFFIC OR HAS
    BACKLINKS OR HAS RANKINGS
    SET A 301 REDIRECTION
    REMOVE IT FROM SITEMAP
    REMOVE IT FROM PRODUCTS FEED
    1.
    2.
    3.
    #brightonseo

    View Slide

  42. OPTIMIZATIONS
    IF HAS NO TRAFFIC / BACKLINKS OR
    RANKINGS
    #brightonseo

    View Slide

  43. OPTIMIZATIONS
    IF HAS NO TRAFFIC / BACKLINKS OR
    RANKINGS
    SET A 410 HTTP STATUS
    REMOVE IT FROM SITEMAP
    REMOVE IT FROM PRODUCTS FEED
    1.
    2.
    3.
    #brightonseo

    View Slide

  44. OPTIMIZATIONS
    NO LINKS POINT TO REMOVED PRODUCT
    PAGES
    #brightonseo

    View Slide

  45. OPTIMIZATIONS
    REVIEW YOUR SITE FOR ANY
    REFERENCES TO REMOVED PRODUCTS
    #brightonseo

    View Slide

  46. SCENARIO 2: PRODUCTS
    ARE TEMPORARILY OUT
    OF STOCK
    #brightonseo

    View Slide

  47. IT'S ALL ABOUT
    USER EXPERIENCE
    #brightonseo

    View Slide

  48. ADD A PROPER SCHEMA MARKUP
    #brightonseo

    View Slide

  49. LINK OTHER RELATED
    PRODUCTS
    #brightonseo

    View Slide

  50. OPTION FOR SIGN UP
    NOTIFICATION WHEN THE
    PRODUCT IS BACK IN STOCK
    #brightonseo

    View Slide

  51. KEEP IT IN SITEMAP
    #brightonseo

    View Slide

  52. ELIMINATE LINKING TO THIS
    PRODUCT UNTIL IS AVAILABLE
    #brightonseo

    View Slide

  53. 4.PRODUCTS
    WITH MULTIPLE
    VARIATIONS
    #brightonseo

    View Slide

  54. CONSIDER
    CONSOLIDATING
    SIMILAR
    VARIATIONS
    UNDER ON
    PRODUCT ENTRY
    #brightonseo

    View Slide

  55. BIG ISSUE: DUPLICATION
    #brightonseo

    View Slide

  56. OPTIMIZATIONS
    2
    1.WHICH OF THE PRODUCT
    VARIATIONS:
    #brightonseo

    View Slide

  57. OPTIMIZATIONS
    1.WHICH OF THE PRODUCT
    VARIATIONS:
    MOST
    TRAFFIC
    MOST
    BACKLINKS
    IS BEST
    SELLER
    #brightonseo

    View Slide

  58. OPTIMIZATIONS
    2
    2. SET THIS PRODUCT AS A
    CANONICAL TAG FOR ALL THE
    OTHER VARIATIONS
    &
    ADD THIS VERSION TO
    SITEMAP
    #brightonseo

    View Slide

  59. OPTIMIZATIONS
    2
    3. ADD SCHEMA MARKUP TO
    POINT THE RELATIONSHIP
    BETWEEN DIFFERENT
    PRODUCT VARIATIONS
    #brightonseo

    View Slide

  60. OPTIMIZATIONS
    2
    4. REGULAR AUDITS
    #brightonseo

    View Slide

  61. OPTIMIZATIONS
    2
    4. REGULAR AUDITS
    ANALYZE THE PERFORMANCE OF
    VARIOUS PRODUCT VARIATIONS.
    #brightonseo

    View Slide

  62. 5. SEARCH
    RESULT PAGES
    #brightonseo

    View Slide

  63. DO NOT ADD
    THEM
    IN SITEMAP
    MAY CAUSE
    ISSUES
    #brightonseo

    View Slide

  64. DO NOT ADD
    THEM
    IN SITEMAP
    CONSIDER OF
    ADDING THEM
    MAY CAUSE
    ISSUES
    UNIQUE
    CONTENT
    #brightonseo

    View Slide

  65. THEY SHOUND NOT BE INDEXED
    HOWEVER
    EVALUATE YOUR ECOMMERCE INTERNAL
    SEARCH
    URLS FOR DEINDEXING
    #brightonseo

    View Slide

  66. 1.CHECK IN GA4 FOR PAGES THAT MAKE YOU
    MONEY
    IF THERE ARE SUCH PAGES
    OPTIMIZATIONS
    #brightonseo

    View Slide

  67. OPTIMIZATIONS
    2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM
    ORGANIC SEARCH? IF ΥΕS
    #brightonseo

    View Slide

  68. OPTIMIZATIONS
    2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM
    ORGANIC SEARCH? IF ΥΕS
    DE-INDEX THEM AND FOCUS ON
    OTHER SIMILAR PAGES
    #brightonseo

    View Slide

  69. OPTIMIZATIONS
    2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM
    ORGANIC SEARCH? IF HIGHER THAN 1-2%
    #brightonseo

    View Slide

  70. OPTIMIZATIONS
    2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM
    ORGANIC SEARCH? IF HIGHER THAN 1-2%
    CONTENT QUALITY ISSUES
    CRAWLABILITY ISSUES
    #brightonseo

    View Slide

  71. YOU MAY DECIDE TO KEEP THEM INDEXED
    IN THE UNLIKELY EVENT THEY’RE GETTING
    MORE ORGANIC TRAFFIC, REVENUE
    AND/OR CONVERSIONS.
    OR LAND ON A CUSTOM SOLUTION.
    #brightonseo

    View Slide

  72. 6. VIDEO
    SITEMAPS
    #brightonseo

    View Slide

  73. NOT BLOCKED IN ROBOTS.TXT
    #brightonseo

    View Slide

  74. REMOVE IRRELEVANT/OLD VIDEOS
    #brightonseo

    View Slide

  75. INCLUDE ALL THE RELEVANT META
    DATA
    #brightonseo

    View Slide

  76. 7. ERRORS
    #brightonseo

    View Slide

  77. REDIRECT 404 PAGES (IF WORTH IT).
    1.
    #brightonseo

    View Slide

  78. REDIRECT 404 PAGES (IF WORTH IT).
    REMOVE 3XX PAGES FROM SITEMAP
    1.
    2.
    #brightonseo

    View Slide

  79. REDIRECT 404 PAGES (IF WORTH IT).
    REMOVE 3XX PAGES FROM SITEMAP
    FIX THE 5XX ERRORS
    1.
    2.
    3.
    #brightonseo

    View Slide

  80. REDIRECT 404 PAGES (IF WORTHS IT).
    REMOVE 3XX PAGES FROM SITEMAP
    FIX THE 5XX ERRORS
    REVIEW SOFT 404 PAGES
    1.
    2.
    3.
    4.
    #brightonseo

    View Slide

  81. View Slide

  82. KEY TAKEAWAYS
    HIERARCHY & ORGANIZATION
    INDEXATION DEBUGGING
    OUT OF STOCK PRODUCTS
    PRODUCTS WITH MULTIPLE VARIATIONS
    SEARCH RESULT PAGES
    VIDEO SITEMAPS
    OTHER ERRORS
    #brightonseo

    View Slide

  83. THANK YOU FOR BEING HERE
    TODAY
    Talk to me
    Stevy Liakopoulou
    [email protected]
    #brightonseo

    View Slide