TECHNICAL · SEO GLOSSARY
Deindexation
The removal of a page or set of pages from Google\'s search index — either intentionally (via noindex directives, robots.txt disallow, or URL removal requests) or unintentionally (via a Google manual action, algorithmic quality suppression, or crawl errors that prevent Google from reaching the page). A deindexed page cannot appear in search results.
Definition
Deindexation occurs when Google removes a page from its search index. The page no longer appears in any search results for any query. Deindexation can be: **Intentional**: you apply `<meta name="robots" content="noindex">` to a page, add it to `robots.txt` Disallow (prevents crawling, which eventually leads to removal from the index), or submit a URL removal request in GSC (temporary 6-month removal). **Unintentional** — common causes: accidentally applying `noindex` to important pages via an overly broad meta robots tag (a site-wide `noindex` applied to all pages via a CMS misconfiguration, or a `noindex` meant for staging that was left on production); a Google manual action for spam (thin content, unnatural links, cloaking) that removes affected pages; canonicalling to a non-existent or wrong URL (Google discovers the canonical and drops the original page from its index in favour of the canonical); a crawl block via `robots.txt` that accumulates over time — Google eventually drops pages it can\'t crawl from the index; or a hreflang misconfiguration that causes Google to prefer a different-language variant and drop the original. Monitoring deindexation: Google Search Console → Coverage is the primary tool. Look for spikes in "Excluded" URLs — specifically "Excluded by noindex tag", "Blocked by robots.txt" (may be accidentally blocking crawl), and "Submitted URL blocked by robots.txt" (a page you submitted in the sitemap is blocked from crawling — a clear misconfiguration). The "Not indexed" count naturally includes some intentionally excluded pages; the concern is unexpected changes in the count or unexpected page types appearing in the excluded list.
Why it matters for SEO
Accidental deindexation is one of the most severe technical SEO incidents — a page that disappears from Google\'s index generates zero organic traffic. The most common accidental deindexation scenarios: (1) staging `noindex` carried to production during a deployment (can deindex an entire site overnight if site-wide noindex is applied), (2) a CMS plugin update that changes robots.txt or meta robots settings, (3) a site migration that changes URL structure without redirects (old URLs get deindexed; new URLs may not be indexed yet). Monitor GSC Coverage weekly for unexpected changes in indexed page count.
How DeepSEOAnalysis checks this
The audit checks every crawled page\'s meta robots tag and HTTP X-Robots-Tag header for noindex directives, and cross-references against robots.txt to identify pages that are both crawlable AND noindexed (intentional) vs pages that are blocked from crawling (eventual deindexation risk). Pages that are canonicalled to a URL that is itself noindexed or blocked are flagged — the canonical target is effectively deindexing the source page. Pages submitted in the sitemap that have noindex are also flagged as a contradiction (submitting a page in the sitemap suggests it should be indexed, but noindex says it shouldn\'t).
Useful tools and resources
GLOSSARY
Related terms
technical
Noindex
A directive that tells search engines not to include a page in their index — implemented via a meta tag or HTTP header.
Read definition →technical
Robots.txt
A text file at the root of a domain that tells crawlers which pages or sections to access or avoid.
Read definition →technical
Canonical Tag
A canonical tag (rel="canonical") is an HTML link element that tells search engines which URL is the authoritative version of a page when duplicate or near-duplicate content exists at multiple URLs. It consolidates ranking signals from all duplicate variants to the canonical URL.
Read definition →technical
Google Penalties (Manual Actions)
A Manual Action is a human-reviewed Google penalty applied when a site violates Google\'s spam policies — distinct from algorithmic ranking adjustments. Manual Actions appear in Google Search Console and affect specific pages or the entire site.
Read definition →technical
Technical SEO
The discipline of optimising a website\'s infrastructure — crawlability, indexability, site speed, structured data, and security — so that search engines can discover, render, and understand pages correctly.
Read definition →technical
Indexability
Whether a web page can be added to Google\'s search index and therefore appear in search results — determined by the absence of indexation barriers: `noindex` directives, canonical tags pointing elsewhere, HTTP errors (4xx/5xx), robots.txt disallows blocking crawl, or redirect loops.
Read definition →See how your site scores on Deindexation.
The free DeepSEOAnalysis audit checks deindexation and 100+ other signals. Full report, no signup.
Run a free audit →