Platforms: Magento Open Source
A Magento store with ten thousand products can expose millions of crawlable URLs. Layered navigation filters, sort orders, category paths in product URLs and paginated category pages all generate new addresses for the same products.
This hub treats Magento SEO as crawl management and validation. You crawl the storefront, measure how many URLs each pattern creates, check which ones carry the right canonical and robots signals, and compare the result after every deployment.
Learn the audit workflow here, then open the guide that matches the problem in front of you.
Technical audit focus. Written for Magento 2 Open Source with Luma, Hyvä or custom themes. Most checks apply to Adobe Commerce too.
Definition
A Magento SEO audit checks what the storefront delivers to crawlers, not what the admin configuration says. It looks at the HTML served through the full page cache, the status codes and URL rewrites behind each address, and the titles, canonical tags, robots meta, structured data and internal links on category, product, CMS and search pages.
On a large catalog it is also a count. How many URLs does each filter, sort parameter and category path produce, and how many of them are indexable? That number decides where crawl budget goes.
The admin shows a setting is on. Only a crawl shows what the theme, extensions and cache actually serve.
Two different jobs
Why it matters
Magento is flexible enough to generate almost any URL. These five situations cause repeat problems on large catalogs.
Every filter option is a crawlable link by default. Combine color, size, price and brand with sort and limit parameters, and one category can produce thousands of URLs.
With category paths in product URLs, a product in three categories has three category URLs plus the short URL. Canonicals decide which one counts, if they are turned on.
SEO, layered navigation and theme extensions rewrite canonicals, robots meta and URLs. Two extensions can output conflicting tags on the same page.
A release can import configuration, reindex URL rewrites, change a theme and flush the cache at once. A staging base URL or a robots setting can ride along.
When crawlers spend their time on filtered, sorted and paginated variants, new products and updated categories wait longer to be crawled and indexed.
Reference
The checks are grouped by technical category and mapped to where Magento controls each one, so you know where to fix what the crawl finds.
Measure how many filter and parameter URLs are reachable, and which of them are indexable.
Magento note: filter parameters use attribute option IDs, such as ?color=49. Group crawl results by parameter name to see which attribute creates the most URLs.
Check product and category canonical tags against the URL you want indexed, including on filtered, sorted and paginated pages.
Find products reachable through several category paths, configurable product children with their own pages, and URL keys with numeric suffixes.
Check that changed URL keys redirect, rewrites do not chain, and internal links point at final URLs.
Confirm deep category pages are crawlable, linked with plain anchors, and not all canonicalized to page one.
Keep search results, compare pages, wishlist, cart, customer and review list URLs out of the index and out of crawl paths.
Check the generated sitemap lists only canonical, indexable product, category and CMS URLs, and that cron keeps it current.
Check Product, Offer and BreadcrumbList schema in the cached HTML, and confirm links and content are not hidden behind client-side rendering.
Related: JavaScript SEO explains how rendering affects what crawlers see.
Workflow
Follow the same seven steps every time. On a large catalog, a repeatable crawl scope matters as much as the checks.
Decide which parameters to follow and set a URL limit, then crawl and save the result. A first crawl with parameters followed shows the real size of the URL space.
Open a category, a filtered category, page two, a simple product, a configurable product, a CMS page and a search result. Confirm title, canonical, robots meta, H1 and schema.
Split the crawl by parameter name, category path depth and URL suffix. Patterns that create many indexable URLs are where crawl budget leaks.
Fifty thousand filtered URLs with self canonicals is one configuration or extension fix, not fifty thousand problems.
Change the catalog SEO setting, the layered navigation extension, the template or robots.txt, then note what you changed and in which release.
Confirm that fixed patterns are gone and that the change did not affect other page types.
Tie the next crawl to the next release, extension update or catalog import.
Focused guides
Each guide answers one question and starts from the workflow above.
How many filter URLs can crawlers reach?
Layered navigation, sort and limit parameters create crawl traps unless indexable facets are chosen deliberately.
Unique angle: URL counts per parameter, indexable facet selection, robots and canonical rules.
Read the faceted navigation guideHow many URLs does each product have?
Category paths, configurable children, store views and URL key suffixes all create duplicate product URLs.
Unique angle: category path settings, canonical link meta tags, visibility and URL rewrites.
Read the duplicates guideWhat changed after the release went live?
Config imports, extension updates, theme changes, reindexing and cache flushes all land together.
Unique angle: base URL and robots checks, extension regressions, cache warmup, crawl comparison.
Read the deployment guideRegression detection
A single crawl tells you what is wrong today. Two crawls with the same scope tell you what changed, which is usually the faster route to the cause.
Keep a crawl from before each deployment, extension update or catalog import. Afterwards, compare URL counts per pattern, indexable counts and canonical targets. A jump in indexable filter URLs is the classic Magento regression.
SiteAuditLint keeps audit history and shows new, fixed and changed issues between crawls, so the comparison does not depend on spreadsheets. See Audit Comparison for how it works.
| Check | Baseline | After update | Change |
|---|---|---|---|
| Crawlable filter URLs | 4,180 | 38,920 | +34,740 |
| Indexable filter URLs | 120 | 38,920 | +38,800 |
| Products with a canonical tag | 9,640 | 9,640 | 0 |
| Sitemap URLs returning 200 | 11,205 | 11,205 | 0 |
| Internal links to 4xx pages | 6 | 6 | 0 |
Numbers are made up to show the method. In this example, a layered navigation extension update dropped its noindex rule and turned multi-select filters into plain links.
Examples
These six problems come up again and again on Magento stores. Each one is easy to miss in the admin and obvious in a crawl.
| Finding | Likely cause | What the crawl shows |
|---|---|---|
| Filtered category URLs are indexable | Layered navigation links followed with no noindex or robots rule | Thousands of parameter URLs returning 200 with index robots meta |
| Products have several live URLs | Category paths used for product URLs, product canonical turned off | The same product title on several URLs with different paths |
| Sort and limit variants crawled | Toolbar links to product_list_order and product_list_limit followed | Category URLs multiplied by every sort and page size option |
| Deep category pages canonical to page one | Category canonical strips the ?p= parameter | Page two and beyond pointing their canonical at the first page |
| Internal search pages indexed | No noindex or robots rule on catalogsearch result URLs | Search result URLs in the crawl and in Search Console |
| Canonicals point at the staging host | Base URL copied from staging configuration during deployment | Canonical and sitemap URLs on a non-production domain |
GET /women/tops.html?color=49&size=167 <meta name="robots" content="NOINDEX,FOLLOW"> <link rel="canonical" href="https://www.example.com/women/tops.html">
Filter combination noindexed and canonical to the clean category.
GET /women/tops.html?color=49&size=167 <meta name="robots" content="INDEX,FOLLOW"> <link rel="canonical" href="https://www.example.com/women/tops.html?color=49&size=167">
Same URL, now indexable with a self canonical. Multiply by every filter combination.
Checklist
Reuse this list for every audit. It covers the baseline, the main technical checks, and verification after a release. For a full version, see the technical SEO checklist.
Tooling
Four kinds of tools each answer a different question. They work together, and none of them replaces the others.
Catalog SEO settings, URL rewrites, design configuration and SEO extensions control what the storefront outputs.
Does not show: how many URLs the storefront actually exposes.
Show indexing status, crawl stats and which URL patterns search engine bots actually request.
Does not show: on-page signals, or problems before bots find them.
Fetch every reachable URL and report status codes, canonicals, robots, metadata and links the way a search engine sees them.
Does not show: what changed, unless you keep and compare earlier crawls.
Sets two crawls side by side to expose regressions after a release and confirm that fixes worked.
Needs: a saved baseline with the same crawl scope.
Magento SEO problems are rarely about one product page. They come from URL patterns, configuration and extensions that multiply across the catalog, so the reliable check is a scoped crawl before and after each release. SiteAuditLint runs that crawl from your own computer and keeps the history for comparison.
Free version audits up to 100 URLs per crawl. Pro adds audit history and comparison.
Keep going
Start with the guide that matches your problem, then use the general technical SEO material for the details behind each check.
Magento guides
Technical SEO
In SiteAuditLint
Crawl your Magento store, review issues by URL pattern, and compare each crawl with the last one.
