TECHNICAL · SEO GLOSSARY
Noindex Tag
A directive (`<meta name="robots" content="noindex">` or `X-Robots-Tag: noindex` HTTP header) that tells search engines not to include a page in their index — preventing it from appearing in search results regardless of its link equity or content quality.
Definition
The noindex directive is a signal from a website to search engines instructing them not to include a specific page in their search index. When a search engine crawler honours a valid noindex directive on a crawled page, that page is removed from (or never entered into) the crawler\'s index — it cannot appear in any search results for any query. There are two implementation methods: (1) **Meta robots tag** (`<meta name="robots" content="noindex">` in the `<head>` of the HTML page) — the most common method. Variants: `noindex` alone (don\'t index, follow links); `noindex, nofollow` (don\'t index, don\'t follow links on the page); `noindex, follow` (explicit follow alongside noindex). Can be targeted to a specific crawler: `<meta name="googlebot" content="noindex">` affects only Googlebot. (2) **X-Robots-Tag HTTP response header** (`X-Robots-Tag: noindex`) — set at the server/CDN level without HTML access; the only method that works for non-HTML files (PDFs, images). The critical prerequisite: Googlebot must be able to crawl the page to read the noindex tag. A page blocked in robots.txt cannot be crawled — Googlebot never reads the noindex directive, and the page may remain indexed from its previous crawl. **What does NOT constitute noindex**: robots.txt `Disallow` (prevents crawling, not indexing); removing the URL from the sitemap (sitemaps declare recommended pages, not exclusions); 410 Gone response (tells Google the resource is permanently removed, but doesn\'t noindex — the page deindexes through normal crawl cycles). Pages appropriate for noindex: paginated archive pages (page 2+), site search results, shopping cart and checkout pages, staging environments, thin tag/author archives, low-value product variant pages. Pages inappropriate for noindex: pages with quality backlinks (loses link equity), pages where the goal is improvement rather than exclusion, pages where canonical is the correct tool for duplicate content.
Why it matters for SEO
Noindex is a high-stakes directive — applied incorrectly, it removes pages from Google\'s index that you want to rank. The most common catastrophic mistake is applying a staging noindex setting to a production deployment, resulting in an entire site being excluded from search results. Equally damaging is over-applying noindex to low-quality pages rather than improving or consolidating them — noindex is not a substitute for content strategy. The correct use of noindex improves site quality signals by removing thin, duplicate, and utility content from Google\'s index, allowing crawl budget to focus on indexable content and preventing low-quality pages from diluting the site\'s overall quality assessment. For AI visibility: noindexed pages are still crawlable, but AI systems that use Google\'s index as a discovery source will not cite content from noindexed pages. Content intended for AI citation should be indexed, not noindexed.
How DeepSEOAnalysis checks this
The audit checks the robots meta tag and X-Robots-Tag header on every crawled page: noindex directive detection (present/absent, which crawler is targeted), noindex + sitemap conflict (a page simultaneously noindexed and included in the sitemap is a configuration conflict — the noindex will be honoured by Google but the sitemap inclusion creates an unnecessary signal inconsistency), noindex on pages with significant body content (potential unintentional noindex application), and noindex on pages with canonical tags pointing to them from other pages (a page that is canonicalled-to but noindexed will not benefit from the consolidated signals). The audit also checks pages that are blocked in robots.txt AND have noindex meta tags — this pattern is redundant (robots.txt already prevents crawling) and if the noindex was the intended signal, the robots.txt block is preventing it from being read.
Useful tools and resources
GLOSSARY
Related terms
technical
Robots Meta Tag
An HTML `<meta name="robots">` tag that tells crawlers whether to index a page, follow its links, or display snippets — more granular than robots.txt.
Read definition →technical
Robots.txt
A text file at the root of a domain that tells crawlers which pages or sections to access or avoid.
Read definition →technical
Canonical URL
The preferred URL for a page, declared via <link rel="canonical"> to prevent duplicate content from splitting ranking signals.
Read definition →technical
Crawl Budget
The number of pages Googlebot will crawl on a site within a given timeframe — determined by crawl rate limit and crawl demand.
Read definition →technical
Index Coverage
The count and status of pages Google has discovered, crawled, and indexed from a site — tracked in Google Search Console.
Read definition →See how your site scores on Noindex Tag.
The free DeepSEOAnalysis audit checks noindex tag and 100+ other signals. Full report, no signup.
Run a free audit →