Indexing: how Google stores (and uses) your pages
Learn the difference between crawling and indexing, what stops indexing, and how to check index coverage.
Indexing is what happens after crawling. Googlebot visits your page (crawling); if it likes the page, it stores it in its index (indexing).
Only indexed pages can appear in search results.
Crawling vs. indexing
- Crawling: discovery (Googlebot visits the page)
- Indexing: storage and evaluation (Google decides whether the page belongs in the index and what it’s about)
A page can be crawled without being indexed.
What prevents indexing
- noindex tag or X-Robots-Tag header
- robots.txt blocking the page
- canonical pointing to a different URL
- soft 404 behavior
- duplicate content without a clear canonical
- extremely low-quality or thin content
If your page isn’t showing up, don’t immediately assume a penalty. Start with these basics.
How to check index coverage
Google Search Console → URL Inspection Tool or Index Coverage report shows you:
- which pages are indexed
- which are excluded and why
- any errors preventing indexing
You can also use site: queries, but they’re less precise.
Link back to the glossary
Quick glossary definition: Indexing.
Related wiki terms
Q&A
Why isn't my page in the index?
Common reasons: noindex tag, blocked by robots.txt, canonical pointing elsewhere, soft 404, or low-value content.
Can I force Google to index my page?
You can request indexing via Google Search Console, but you can't force it. The page has to be worth indexing.
How long does indexing take?
It varies. Some pages are indexed in hours; others take weeks. Site health, crawl budget, and link authority all play roles.