Pagination and crawlable links: preserve a URL path through long lists

Make paginated collections reachable with normal links, unique URLs, and honest page-level content.

Sources reviewed 2026-09-10

Give every useful page of a long list a reachable URL

Pagination is crawlable when each page is available at its own URL and is linked with ordinary anchors. Google’s pagination guidance recommends unique URLs for paginated content; its link guidance explains that anchors with href attributes are the reliable discovery format. Infinite scrolling can remain a user interface choice, but do not make it the only route to older items.

Audit a collection from page one through a deep page. Record each URL, status, title, canonical, item range, next/previous links, and whether the items are meaningfully different. View source and rendered DOM where JavaScript is involved. Check that page two is discoverable from page one and that a page does not declare the first page as canonical merely because the template is shared.

Fix an endless-list example

A news archive loads another ten articles when a visitor scrolls, but /news/ is the only requestable route. The first ten stories have anchors; older stories appear after a button-driven API call with no page URL. Add routes such as /news/page/2/ with real anchors from the archive navigation, maintain a useful page title and content range, and let the scrolling UI enhance those routes. A crawler and a visitor can now reach the same older content without simulating an arbitrary scroll distance.

Test empty final pages, deleted items, filter combinations, and URL parameters. Ensure paginated pages do not redirect into a loop and are not accidentally blocked by a broad robots rule. If category filters multiply the page count, read faceted navigation crawl control before generating links freely. For internal path evidence, use internal links for crawl discovery.

Avoid misleading consolidation

Do not canonical every page to page one when later pages contain different items. Do not use fragment URLs such as #/page/2 for content that needs discovery. Do not expose page links only through click handlers without hrefs. Do not keep obsolete pages in a sitemap or return a 200 empty collection template for a non-existent page.

The AI search readiness checker can observe raw anchors and response behavior from a starting page. It does not crawl an unlimited archive, render every interaction, or promise indexing of each item. Re-test after a new paging component or framework routing update.

Treat page depth as a product path

Check that a visitor can move forward and back through a realistic number of pages without losing context. Verify page numbers, item counts, and final-page behavior before changing a component. This exposes repeated first-page canonicals, broken next links, and empty successful responses before the archive becomes difficult to navigate.

FAQ

Include deep pagination in pre-release checks, not only page one. Components can display initial results correctly while links or route handling fail after the first boundary.

Must paginated pages be in the XML sitemap?

Not necessarily. First make them reachable through useful internal links and include only URLs you intentionally want listed.

Can infinite scroll coexist with crawlable pages?

Yes. Keep stable paginated URLs and anchors beneath the enhanced scrolling experience.

Primary sources