Home›Checklists›Indexability Checklist

Free SEO checklist · 13 sections · 13 checks

Indexability Checklist

An indexability checklist walks through every signal that decides whether a page can appear in search results: status code, meta robots, X-Robots-Tag, canonical, robots.txt, internal links, sitemap inclusion, rendering, and duplication.

13 Checks7 High priority13 SectionsPDF · Word · Excel Formats
Download checklist

SiteAuditLint checklist library

What this checklist covers

An indexability checklist walks through every signal that decides whether a page can appear in search results: status code, meta robots, X-Robots-Tag, canonical, robots.txt, internal links, sitemap inclusion, rendering, and duplication.

It is organized into 13 sections: HTTP Status, Noindex, X-Robots-Tag, Canonical, Robots.txt, Internal Links, XML Sitemap, Redirects, JavaScript, Duplicates, Soft 404s, Orphan Pages and Search Console. Each check lists exactly what to verify and a priority, so you can work through the highest impact items first.

For background on the concepts behind these checks, see Indexing explained, Crawlability vs indexability, Noindex issues.

Testing method: Noindex sent in the X-Robots-Tag header is invisible in the page source. To test it, see HTTP header SEO testing.

Who it is for:

SEOsdevelopers

Download the indexability checklist

Use the interactive version below, or download it to share with your team, attach to tickets, or work through offline.

Indexability Checklist

Work through each check

0 of 13 checks complete

HTTP Status

Noindex

X-Robots-Tag

Canonical

Robots.txt

XML Sitemap

Redirects

JavaScript

Duplicates

Soft 404s

Orphan Pages

Search Console

Progress is saved in this browser only.

Detailed explanations

Each section below explains what to check, why it matters, the problems you will usually find, how to fix them, and how to confirm the fix.

HTTP Status

On this checklist: check status. Explained in full in the Technical SEO Checklist.

Noindex

What to check:

  • Check meta robots. No noindex in meta robots.

Why it matters: A page can be crawled but still excluded from search results. Indexability depends on several signals working together: status code, meta robots, the X-Robots-Tag header, canonical tags, and robots.txt. A single conflicting signal is enough to remove a page from Google.

Common problems:

  • A noindex left in place after a staging build goes live
  • X-Robots-Tag noindex sent by a server or CDN rule nobody remembers
  • Canonical tags pointing to a different URL than intended
  • Pages blocked in robots.txt, so Google never sees the noindex or canonical

How to fix it: Remove noindex directives from pages that should rank, align canonical tags with the URL you want indexed, and make sure robots.txt does not block indexable content.

How to verify: Check the page source and response headers for every key template, then use Search Console URL Inspection to confirm Google sees the page as indexable.

Learn more: Indexing explained, Indexing tests, Noindex issues and fixes, Noindex issue.

How SiteAuditLint helps: it checks noindex across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

X-Robots-Tag

What to check:

  • Check HTTP headers. No noindex in X-Robots-Tag.

Why it matters: A page can be crawled but still excluded from search results. See the earlier section on this topic for common problems.

How to verify: Check the page source and response headers for every key template, then use Search Console URL Inspection to confirm Google sees the page as indexable.

How SiteAuditLint helps: it checks x-robots-tag across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

Canonical

What to check:

  • Check canonical. Canonical is self-referencing or points to the preferred URL.

Why it matters: The canonical tag tells search engines which version of a page is the preferred one when duplicates or variants exist. It consolidates ranking signals onto one URL. A broken canonical can quietly deindex the page you care about most.

Common problems:

  • Canonicals pointing to staging or development domains
  • Relative canonical URLs that resolve incorrectly
  • Canonicals pointing to redirected, 404, or noindexed URLs
  • Every paginated or variant page canonicalized to page one

How to fix it: Use absolute canonical URLs on the production domain, make indexable pages self canonical, and point duplicates at a live, indexable 200 URL.

How to verify: Crawl the site and compare the canonical URL with the page URL. Flag any canonical that is non self referencing, redirects, returns an error, or is noindexed.

Learn more: Canonicals lesson, Canonical tag issues and fixes, Missing canonical issue, Canonicalised URL issue.

How SiteAuditLint helps: it checks canonical across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

Robots.txt

On this checklist: check robots.txt. Explained in full in the Robots.txt Checklist.

On this checklist: check internal links. Explained in full in the On-Page SEO Checklist.

XML Sitemap

On this checklist: check sitemap inclusion. Explained in full in the Technical SEO Checklist.

Redirects

On this checklist: check redirects. Explained in full in the Technical SEO Checklist.

JavaScript

On this checklist: check rendering. Explained in full in the JavaScript SEO Checklist.

Duplicates

On this checklist: check duplicates. Explained in full in the Technical SEO Checklist.

Soft 404s

What to check:

  • Check soft 404. Page has substantive content.

Why it matters: HTTP status codes tell crawlers whether a URL is live, moved, missing, or broken. See the earlier section on this topic for common problems.

How to verify: Crawl the site and filter by status code. Every URL in the sitemap and main navigation should return 200. Recheck flagged URLs individually with a header checker.

How SiteAuditLint helps: it checks soft 404s across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

Orphan Pages

What to check:

  • Check orphans. Page has inbound internal links.

Why it matters: Internal links distribute authority, define site architecture, and help crawlers discover content. See the earlier section on this topic for common problems.

How to verify: Crawl the site and review the broken links, redirecting links, and inlinks reports. Compare sitemap URLs against crawled URLs to find orphans.

How SiteAuditLint helps: it checks orphan pages across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

Search Console

What to check:

  • Inspect URL. URL Inspection shows indexed or indexable.

Why it matters: Without tracking you cannot measure the impact of launches, migrations, or fixes. Missing tags after a deployment create gaps that cannot be backfilled.

Common problems:

  • Analytics missing on new templates
  • Duplicate tags inflating sessions
  • Conversion events lost after a redesign
  • Search Console not verified on the new domain

How to fix it: Deploy analytics through a tag manager across all templates, verify Search Console, and test conversion events before launch.

How to verify: Use tag assistant and real time reports to confirm tags fire on each template and that conversions record.

Learn more: Tracking and analytics audit, Tracking pixel audit, Tracking missing on page issue, SEO KPIs lesson.

How SiteAuditLint helps: it checks search console across every crawled URL instead of one page at a time and lists exactly which URLs are affected.

Common mistakes

Blocking a page in robots.txt and expecting noindex to work

Assuming sitemap inclusion guarantees indexing

Ignoring canonical conflicts

Not inspecting the URL in Search Console

When to run the checklist

  • When a page is not appearing in Google
  • When Search Console reports excluded pages
  • After launches and migrations
  • Before submitting important new pages

How to verify fixes

Save a baseline crawl before you change anything. Fix high-priority and template-level issues first, since one template fix resolves many URLs, then re-crawl with the same start URL and settings and compare the two audits with audit comparison. Finally, confirm important pages in Search Console with URL Inspection. See how to prioritize audit findings.

SiteAuditLint workflow

Most checks in this list run automatically in a SiteAuditLint crawl. Use audit comparison to diff crawls and scheduled audits to monitor for regressions.

All SEO checklists

See the full checklist library, with a guide to choosing the right checklist for each job.