Indexation Engineering: Controlling what Actually Gets Indexed - Manchester DM 2026

Google doesn’t index everything anymore. And it’s not trying to. Indexation is selective by design. AI search systems are even more selective. Most sites are massively overestimating what’s indexed. Indexation is earned, not given. This is how you can direct these systems in the right direction

Transcript

1. Manchester DM Sep 2026 Indexation Engineering Controlling what Actually Gets Indexed nikkihalliwell.com | techseotips.co.uk | techseonorth.com
2. Manchester DM Sep 2026
3. Google doesn’t index everything anymore. And it’s not trying to. Manchester DM Sep 2026
4. Manchester DM Sep 2026 Crawled Rendered Indexed Ranked Every stage loses URLs
5. Manchester DM Sep 2026 The Reality Check Crawled ➔ Indexation is selective by design ➔ AI search systems are even more selective ➔ Most sites massively overestimate what’s indexed Rendered Indexed Ranked Every stage loses URLs
6. Manchester DM Sep 2026 The Reality Check Crawled ➔ Indexation is selective by design ➔ AI search systems are even more selective ➔ Most sites massively overestimate what’s indexed Rendered Indexed Ranked The issue is a misunderstanding Every stage loses URLs
7. Submission does not = Indexation WHAT CLIENTS THINK sitemap.xml indexed Sitemap means indexation Sitemap is a guarantee Manchester DM Sep 2026
8. Manchester DM Sep 2026 Submission does not = Indexation WHAT CLIENTS THINK sitemap.xml IN REALITY indexed internal links canonicals content quality rendering duplication Sitemap means indexation A complex system of signals Sitemap is a guarantee Indexation is a competition for resources
9. Manchester DM Sep 2026
10. Stop treating indexing as something that just happens . Manchester DM Sep 2026
11. Manchester DM Sep 2026 We can shape what it sees, but indexation is complex and controlled by search engines and LLMs
12. Because we all love a framework… Manchester DM Sep 2026
13. Manchester DM Sep 2026 The 4 Pillars of Indexation Control 01 Discovery 02 Eligibility Can it be found? Does it deserve to be indexed? 03 04 Does it matter? Is it the main version? Priority Consolidation
14. 01 Discovery Manchester DM Sep 2026 If it’s not found, it’s not indexed 01. Discovery starts with links a. Sitemaps help, but internal links are what search engines follow and values Homepage Category Depth 0 Depth 1 The deeper a page sits, the less attention it gets 03. Orphan pages are invisible pages a. A page with no internal links pointing at it may never be found at all. Depth 2 Product 2 02. Crawl depth still matters a. Product 1 Orphaned pages Product 3
15. 01 Discovery Manchester DM Sep 2026 Examples of Discovery Failures Faceted URLs JS triggered links Buried pages Filters that multiply into near-infinite crawlable URL combinations. Navigation or links that only works with JS gives crawlers nothing to follow. High-value pages that sit deep in the architecture with no links pointing at them. /dresses <div onclick="go()"> /dresses?colour=black Dresses /dresses?colour=black&size=8 </div> … and so on no href means no crawl path Home › Category › Sub-category › Filter page › Money page
16. 01 Discovery Manchester DM Sep 2026 Fixing Discovery BEFORE AFTER Deep URL paths causing instances of orphaned URLs. A flatter structure where every page is linked to and the key page gets extra internal links from related pages.
17. 02 Manchester DM Sep 2026 Eligibility Why Google chooses not to index Common reasons a page may be left out of the index Google fetches Crawled URL Duplicate Same content on another URL Thin Little to add to the index Low Value Nothing a searcher needs Any reason found Not indexed
18. 02 Eligibility Indexation is a quality filter. Not every page passes validation. Manchester DM Sep 2026
19. 02 Eligibility Indexation is a quality filter. Not every page passes validation. This is a good thing! Manchester DM Sep 2026
20. 02 Eligibility Indexation is a quality filter. Not every page passes validation. This is a good thing! Manchester DM Sep 2026
21. 02 Eligibility Engineering Eligibility WEAK PAGE Black midi dress Black midi dress. High quality. Order now. Free delivery. Same template text on every similar URL. Manchester DM Sep 2026
22. 02 Manchester DM Sep 2026 Eligibility Engineering Eligibility WEAK PAGE STRONG PAGE Black midi dress Black midi dress Black midi dress. High quality. Order now. Free delivery. Bias-cut crepe midi dress that falls below the knee. Fit notes for petite and tall wearers, fabric care instructions, and outfit ideas for evening and daytime. Same template text on every similar URL. Unique copy, fit and fabric detail, entity-rich details.
23. 02 Eligibility Engineering Eligibility DO THE BASICS 01. Use unique product descriptions 02. Have bespoke category copy 03. Reduce boilerplate content 04. Include entity-rich details Manchester DM Sep 2026
24. 03 Priority Manchester DM Sep 2026 Not all pages are equal Google allocates resources unevenly. Guides Categories It is our job as SEOs to signal what matters most. Money pages Filters Utility Bubble size = share of crawl budget
25. 03 Priority Manchester DM Sep 2026 How to Signal Priority 01. Internal links a. More links from strong pages means more link equity. 02. Depth a. Closer to the homepage reads as being more important 03. Freshness a. Pages that are updated with relevant and new content earn return visits 04. Engagement a. Hints that a page is genuinely useful KEY ACTIONS Link to money pages more Reduce noise from low-value URLs Keep key pages fresh and updated
26. 03 Priority Manchester DM Sep 2026 The Hidden Killer: Index Bloat Too many low-value pages dilute your signals. Crawl and indexation resources get wasted. Valuable indexed pages [30%] Low-value indexed pages [70%]
27. 04 Manchester DM Sep 2026 Consolidation Stop Competing with Yourself /black-dress /black-dress?sort=price /black-dress?utm_source=email /dresses/black-dress /black-dress One canonical URL
28. 04 Manchester DM Sep 2026 Consolidation Stop Competing with Yourself /black-dress One canonical URL When several URLs carry near-identical content, search engines have to pick one, and it may not pick right. A canonical tag is a strong hint but Google can override it, so consolidation needs to be backed by consistent signals: internal links, redirects and sitemaps that all point to the same version.
29. 04 Manchester DM Sep 2026 Consolidation Consolidation Tactics Merge Canonicalise Noindex Remove For overlapping pages chasing the same intent. Combine the content and 301 to the winner. For near duplicates that must stay live, like variants and parameter URLs. Canonicalise to a single “Parent” URL. For pages that users need but search does not, like internal search results. Noindex the pages. For redundant URLs with no value. Remove and use a 301 redirect if there is a match, use a 410 if not.
30. Manchester DM Sep 2026 The Indexation Engineering Framework 01 02 03 04 Discovery Eligibility Priority Consolidation Can it be found? Does it deserve it? Does it matter? Is it the main version? Strength of each pillar (illustrative) Weakest link The weakest link defines the outcome. A site can be brilliant at three pillars and still be held back by the fourth.
31. Putting it into practice, and why the stakes are rising Manchester DM Sep 2026
32. Manchester DM Sep 2026 What To Do on Monday 01. Audit indexed vs valuable pages a. Compare what Google holds with what should earn traffic. 02. Identify waste a. Use log files and GSC to see what gets crawled and what doesn’t. 03. Improve internal linking a. Push links towards the pages that matter. 04. Consolidate duplication a. Merge, canonicalise, noindex or remove. 05. Enhance key page quality a. Make your priority pages worth indexing.
33. AI Has Changed the Stakes AI retrieval draws from a much smaller pool than the traditional index. AI systems are even more selective. Only the best, clearest, most authoritative pages survive. If a page isn't indexed it can't be a candidate for AI. Everything in this talk applies to AI visibility too, with the bar set higher. Manchester DM Sep 2026
34. Key Takeaways Manchester DM Sep 2026
35. 1. Manchester DM Sep 2026 Indexation is earned, not given.
36. Manchester DM Sep 2026 1. Indexation is earned, not given. 2. You can’t control indexing. You can shape the signals behind it.
37. Manchester DM Sep 2026 1. Indexation is earned, not given. 2. You can’t control indexing. You can shape the signals behind it. 3. Fewer, better indexed pages mean better performance.
38. Manchester DM Sep 2026 If it’s not indexed, it doesn’t exist.
39. Manchester DM Sep 2026 If it’s not indexed, it doesn’t exist. If everything is indexed, nothing performs.
40. TECH SEO SPECIALIST nikkihalliwell.com speakerdeck.com/nikkihalliwell Let’s Connect