Identifying Indexability Conflicts
What we will go through
- The signals that decide whether a URL is indexable
- How to build an indexability matrix
- How to spot pages whose signals disagree
- How to decide the intended state for each URL group
Short answer
An indexability conflict happens when a URL's signals disagree, such as a page linked in the menu and sitemap but carrying noindex, or a canonical pointing to a redirect. Build a matrix of status code, robots.txt, meta robots, canonical, sitemap presence, and internal links for each URL, then decide one intended state per page group.
So far in this module, you checked each signal on its own. Real problems usually show up when signals are compared. This lesson brings them together.
The six signals
For each URL, collect:
- Status code (Module 3)
- Robots.txt allowed or blocked
- Meta robots or X-Robots-Tag index or noindex
- Canonical self, other URL, or missing
- In XML sitemap yes or no
- Internal inlinks count and placement
The indexability matrix
| Page group | Status | Robots | Meta | Canonical | Sitemap | Inlinks | Conflict? |
|---|---|---|---|---|---|---|---|
| Products | 200 | Allowed | index | self | Yes | Many | No |
| Filter URLs | 200 | Allowed | index | clean URL | Yes | Many | Sitemap lists canonicalized URLs |
| Branch pages | 200 | Allowed | noindex | self | Yes | Menu | Noindex on linked, listed pages |
| Old promos | 301 | Blocked | n/a | n/a | Yes | Footer | Redirected, blocked, still listed and linked |
Every row where signals point in different directions is a conflict.
Decide one intended state per group
- Index: 200, crawlable, index, self-canonical, in sitemap, well linked.
- Consolidate: canonical or redirect to the preferred URL, out of the sitemap, internal links updated.
- Hide: noindex, crawlable, out of the sitemap, few links.
- Remove: 404 or 410, links removed, out of the sitemap.
Then list what must change for each group to match its state.
Practice: what is the intended state?
Sort each item into the right group.
-
Main service pages
Answer: Index.
-
?utm_source= tracking duplicates
Answer: Consolidate.
-
Thank-you pages
Answer: Hide or remove.
-
HTTP versions of pages
Answer: Consolidate.
-
Expired test pages
Answer: Hide or remove.
-
Location pages for each branch
Answer: Index.
Common mistakes
- Checking signals one at a time only. Conflicts appear between them.
- Deciding per URL instead of per group.
- No agreed intended state. Developers cannot fix “it depends.”
Your action
Next, you will compare your crawl with Google Search Console to confirm what Google actually did.
Key terms
- Indexable URL
- A URL that returns 200, is crawlable, has no noindex, and has a self-referencing or no canonical.
- Indexability matrix
- A table listing each URL's indexing signals side by side so contradictions stand out.
- Intended state
- The decision for a URL or group: index, consolidate, hide, or remove.
- Page group
- URLs that share a template or pattern, such as all product pages or all filter URLs.
Questions beginners ask
What is the quickest way to see indexability in a crawl?
Most crawlers have an Indexability column showing Indexable or Non-Indexable plus the reason. Start there.
Why work by page group instead of URL?
Signals come from templates, so groups share the same conflicts. Deciding per group creates fixes developers can apply once.
Are internal links part of indexability?
They are strong supporting signals. Linking heavily to a noindexed or canonicalized URL tells Google it matters, which contradicts the directive.
What if the client does not know which pages should be indexed?
Agree on intended states per page group in the audit brief. It is one of the most valuable decisions of the audit.
Related lessons
Want someone to handle SEO for your business while you learn? The team at Remar Digital can help.