Optimize sitemaps for large e-commerce websites

Slide 1

Slide 1 text

Οptimize sitemaps for large e-commerce websites Stevy Liakopoulou Search Magic Stevy Liakopoulou [email protected]

Slide 2

Slide 2 text

I HAVE A QUESTION #brightonseo

Slide 3

Slide 3 text

#brightonseo

Slide 4

Slide 4 text

#brightonseo

Slide 5

Slide 5 text

TOP ERRORS 01 02 03 04 05 06 07 DISCOVERED-CURRENTLY NO INDEX PAGES THAT TURN TO 404 NO CANONICAL TAGS LONG, COMPLEX URLS ORPHAN PAGES OUT OF STOCK PRODUCTS THIN CONTENT PAGES DUPLICATION #brightonseo

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

CRAWL BUDGET MAIN GOALS #brightonseo

Slide 8

Slide 8 text

NO INDEX PAGES CRAWL BUDGET MAIN GOALS #brightonseo

Slide 9

Slide 9 text

DUPLICATION NO INDEX PAGES CRAWL BUDGET MAIN GOALS #brightonseo

Slide 10

Slide 10 text

DUPLICATION NO INDEX PAGES CRAWL BUDGET ERRORS MAIN GOALS #brightonseo

Slide 11

Slide 11 text

1. HIERARCHY & ORGANIZATION #brightonseo

Slide 12

Slide 12 text

GROUP URLS LOGICALLY #brightonseo

Slide 13

Slide 13 text

GROUP URLS LOGICALLY SUBSITEMAPS #brightonseo

Slide 14

Slide 14 text

GROUP URLS LOGICALLY SUBSITEMAPS LANGUAGES #brightonseo

Slide 15

Slide 15 text

2. INDEXATION DEBUGGING #brightonseo

Slide 16

Slide 16 text

HYPOTHESIS 100K PRODUCT PAGES 5K CATEGORY PAGES 20K SUB CATEGORY PAGES SITEMAP #brightonseo

Slide 17

Slide 17 text

RESULTS 50K INDEXED PAGES 75K NO-INDEXED PAGES #brightonseo

Slide 18

Slide 18 text

No content

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

75K NO INDEX PAGES WHAT TYPE OF PAGES ARE? BUT #brightonseo

Slide 21

Slide 21 text

ΤYPES 1.CATEGORIES + SUBCATEGORIES WITH 1 OR 0 PRODUCTS #brightonseo

Slide 22

Slide 22 text

ΤYPES 1.CATEGORIES + SUBCATEGORIES WITH 1 OR 0 PRODUCTS MERGE? REMOVE THE ZERO PRODUCT CATEGORIES? #brightonseo

Slide 23

Slide 23 text

ΤYPES 2. DUPLICATION #brightonseo

Slide 24

Slide 24 text

NON-CANONICAL URLs #brightonseo #brightonseo

Slide 25

Slide 25 text

DUPLICATE URL PATHS #brightonseo #brightonseo www.domain.com/cat1/cat2/cat3/women-skirt-1 www.domain.com/cat1/cat2/cat3/women-skirt-2

Slide 26

Slide 26 text

WWW vs. Non-WWW Urls #brightonseo #brightonseo www.domain.com/cat1/cat2/cat3/women-skirt-2 domain.com/cat1/cat2/cat3/women-skirt-2

Slide 27

Slide 27 text

UPPERCASE vs. LOWERCASE URLs #brightonseo #brightonseo www.domain.com/CAT1/cat2/cat3/women-skirt-2 www.domain.com/cat1/cat2/cat3/women-skirt-2

Slide 28

Slide 28 text

TRAILING SLASHES on URLs #brightonseo #brightonseo www.domain.com/cat1/cat2/cat3/women-skirt-2 www.domain.com/cat1/cat2/cat3/women- skirt-2/

Slide 29

Slide 29 text

ΤYPES 3. PRODUCT PAGES WITH NO CONTENT #brightonseo

Slide 30

Slide 30 text

ΤYPES 3. PRODUCT PAGES WITH NO CONTENT 4. PRODUCT PAGES WITH DUPLICATED CONTENT #brightonseo

Slide 31

Slide 31 text

ΤYPES 3. PRODUCT PAGES WITH NO CONTENT 4. PRODUCT PAGES WITH DUPLICATED CONTENT 5. PRODUCT PAGES WITH DESCRIPTION < 50 WORDS #brightonseo

Slide 32

Slide 32 text

FUN FACT "GOOGLE CAN'T INDEX EVERYTHING ON THE WEB SO IT'S IMPORTANT TO BE SELECTIVE BY INDEXING ONLY THE CONTENT THAT MATTERS" l https://www.searchenginejournal.com/indexing-and-crawl-budget/462742/ #brightonseo

Slide 33

Slide 33 text

OPTIMIZE 1. DEFINE YOUR MOST IMPORTANT PRODUCTS AND MAKE MANUALLY OPTIMIZATIONS #brightonseo

Slide 34

Slide 34 text

OPTIMIZE 2. NON- HIGH PRIORITY THIN CONTENT PRODUCT PAGES, TRY TO IMPROVE THEM OR NOINDEX THEM #brightonseo

Slide 35

Slide 35 text

OPTIMIZE 3. ADD IN SITEMAP THE PREFERRED VERSIONS OF YOUR PAGES AND NOT THE ALTERNATES #brightonseo

Slide 36

Slide 36 text

3. OUT OF STOCK PRODUCTS #brightonseo

Slide 37

Slide 37 text

"AND WHEN IT COMES TO THE REGULAR SEARCH RESULTS, IT CAN HAPPEN THAT WHEN WE SEE THAT SOMETHING IS OUT OF STOCK, WE WILL ASSUME IT’S MORE LIKE A SOFT 404 ERROR, WHERE WE WILL DROP THAT URL FROM THE SEARCH RESULTS AS WELL." John Mueller #brightonseo

Slide 38

Slide 38 text

#brightonseo

Slide 39

Slide 39 text

SCENARIO 1: PRODUCTS ARE PERMANENTLY OUT OF STOCK #brightonseo

Slide 40

Slide 40 text

OPTIMIZATIONS IF RECEIVES TRAFFIC OR HAS BACKLINKS OR HAS RANKINGS #brightonseo

Slide 41

Slide 41 text

OPTIMIZATIONS IF RECEIVES TRAFFIC OR HAS BACKLINKS OR HAS RANKINGS SET A 301 REDIRECTION REMOVE IT FROM SITEMAP REMOVE IT FROM PRODUCTS FEED 1. 2. 3. #brightonseo

Slide 42

Slide 42 text

OPTIMIZATIONS IF HAS NO TRAFFIC / BACKLINKS OR RANKINGS #brightonseo

Slide 43

Slide 43 text

OPTIMIZATIONS IF HAS NO TRAFFIC / BACKLINKS OR RANKINGS SET A 410 HTTP STATUS REMOVE IT FROM SITEMAP REMOVE IT FROM PRODUCTS FEED 1. 2. 3. #brightonseo

Slide 44

Slide 44 text

OPTIMIZATIONS NO LINKS POINT TO REMOVED PRODUCT PAGES #brightonseo

Slide 45

Slide 45 text

OPTIMIZATIONS REVIEW YOUR SITE FOR ANY REFERENCES TO REMOVED PRODUCTS #brightonseo

Slide 46

Slide 46 text

SCENARIO 2: PRODUCTS ARE TEMPORARILY OUT OF STOCK #brightonseo

Slide 47

Slide 47 text

IT'S ALL ABOUT USER EXPERIENCE #brightonseo

Slide 48

Slide 48 text

ADD A PROPER SCHEMA MARKUP #brightonseo

Slide 49

Slide 49 text

LINK OTHER RELATED PRODUCTS #brightonseo

Slide 50

Slide 50 text

OPTION FOR SIGN UP NOTIFICATION WHEN THE PRODUCT IS BACK IN STOCK #brightonseo

Slide 51

Slide 51 text

KEEP IT IN SITEMAP #brightonseo

Slide 52

Slide 52 text

ELIMINATE LINKING TO THIS PRODUCT UNTIL IS AVAILABLE #brightonseo

Slide 53

Slide 53 text

4.PRODUCTS WITH MULTIPLE VARIATIONS #brightonseo

Slide 54

Slide 54 text

CONSIDER CONSOLIDATING SIMILAR VARIATIONS UNDER ON PRODUCT ENTRY #brightonseo

Slide 55

Slide 55 text

BIG ISSUE: DUPLICATION #brightonseo

Slide 56

Slide 56 text

OPTIMIZATIONS 2 1.WHICH OF THE PRODUCT VARIATIONS: #brightonseo

Slide 57

Slide 57 text

OPTIMIZATIONS 1.WHICH OF THE PRODUCT VARIATIONS: MOST TRAFFIC MOST BACKLINKS IS BEST SELLER #brightonseo

Slide 58

Slide 58 text

OPTIMIZATIONS 2 2. SET THIS PRODUCT AS A CANONICAL TAG FOR ALL THE OTHER VARIATIONS & ADD THIS VERSION TO SITEMAP #brightonseo

Slide 59

Slide 59 text

OPTIMIZATIONS 2 3. ADD SCHEMA MARKUP TO POINT THE RELATIONSHIP BETWEEN DIFFERENT PRODUCT VARIATIONS #brightonseo

Slide 60

Slide 60 text

OPTIMIZATIONS 2 4. REGULAR AUDITS #brightonseo

Slide 61

Slide 61 text

OPTIMIZATIONS 2 4. REGULAR AUDITS ANALYZE THE PERFORMANCE OF VARIOUS PRODUCT VARIATIONS. #brightonseo

Slide 62

Slide 62 text

5. SEARCH RESULT PAGES #brightonseo

Slide 63

Slide 63 text

DO NOT ADD THEM IN SITEMAP MAY CAUSE ISSUES #brightonseo

Slide 64

Slide 64 text

DO NOT ADD THEM IN SITEMAP CONSIDER OF ADDING THEM MAY CAUSE ISSUES UNIQUE CONTENT #brightonseo

Slide 65

Slide 65 text

THEY SHOUND NOT BE INDEXED HOWEVER EVALUATE YOUR ECOMMERCE INTERNAL SEARCH URLS FOR DEINDEXING #brightonseo

Slide 66

Slide 66 text

1.CHECK IN GA4 FOR PAGES THAT MAKE YOU MONEY IF THERE ARE SUCH PAGES OPTIMIZATIONS #brightonseo

Slide 67

Slide 67 text

OPTIMIZATIONS 2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM ORGANIC SEARCH? IF ΥΕS #brightonseo

Slide 68

Slide 68 text

OPTIMIZATIONS 2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM ORGANIC SEARCH? IF ΥΕS DE-INDEX THEM AND FOCUS ON OTHER SIMILAR PAGES #brightonseo

Slide 69

Slide 69 text

OPTIMIZATIONS 2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM ORGANIC SEARCH? IF HIGHER THAN 1-2% #brightonseo

Slide 70

Slide 70 text

OPTIMIZATIONS 2. ARE THEY 1-2% ΟF TOTAL REVENUE FROM ORGANIC SEARCH? IF HIGHER THAN 1-2% CONTENT QUALITY ISSUES CRAWLABILITY ISSUES #brightonseo

Slide 71

Slide 71 text

YOU MAY DECIDE TO KEEP THEM INDEXED IN THE UNLIKELY EVENT THEY’RE GETTING MORE ORGANIC TRAFFIC, REVENUE AND/OR CONVERSIONS. OR LAND ON A CUSTOM SOLUTION. #brightonseo

Slide 72

Slide 72 text

6. VIDEO SITEMAPS #brightonseo

Slide 73

Slide 73 text

NOT BLOCKED IN ROBOTS.TXT #brightonseo

Slide 74

Slide 74 text

REMOVE IRRELEVANT/OLD VIDEOS #brightonseo

Slide 75

Slide 75 text

INCLUDE ALL THE RELEVANT META DATA #brightonseo

Slide 76

Slide 76 text

7. ERRORS #brightonseo

Slide 77

Slide 77 text

REDIRECT 404 PAGES (IF WORTH IT). 1. #brightonseo

Slide 78

Slide 78 text

REDIRECT 404 PAGES (IF WORTH IT). REMOVE 3XX PAGES FROM SITEMAP 1. 2. #brightonseo

Slide 79

Slide 79 text

REDIRECT 404 PAGES (IF WORTH IT). REMOVE 3XX PAGES FROM SITEMAP FIX THE 5XX ERRORS 1. 2. 3. #brightonseo

Slide 80

Slide 80 text

REDIRECT 404 PAGES (IF WORTHS IT). REMOVE 3XX PAGES FROM SITEMAP FIX THE 5XX ERRORS REVIEW SOFT 404 PAGES 1. 2. 3. 4. #brightonseo

Slide 81

Slide 81 text

No content

Slide 82

Slide 82 text

KEY TAKEAWAYS HIERARCHY & ORGANIZATION INDEXATION DEBUGGING OUT OF STOCK PRODUCTS PRODUCTS WITH MULTIPLE VARIATIONS SEARCH RESULT PAGES VIDEO SITEMAPS OTHER ERRORS #brightonseo

Slide 83

Slide 83 text

THANK YOU FOR BEING HERE TODAY Talk to me Stevy Liakopoulou [email protected] #brightonseo