If a page isn’t on Google, the fastest way to find out why is the URL Inspection tool in Google Search Console. It tells you whether Google knows the page, whether it’s indexed, and if not, the reason, such as a noindex tag, a robots.txt block or a canonical pointing elsewhere. Most causes are fixable; some, like quality or a very new site, simply take time.
Step 1: Inspect the URL
You need the site verified in Google Search Console. (If you haven’t set it up, see the Search Console guide.)
- Paste the full URL into the search bar at the top of Search Console.
- Read the headline result: “URL is on Google” or “URL is not on Google”.
- Open Page indexing for details: whether the page was discovered, when it was last crawled, whether crawling and indexing were allowed, and which canonical Google chose.
Don’t rely on a site: search. It’s a rough tool and can miss pages that are indexed.

Step 2: Run a live test
The first result shows what Google saw on its last visit. Click Test live URL to fetch the page now. The live test uses Google’s inspection crawler (you may see Google-InspectionTool in your logs).
If the live test passes but the indexed version shows a problem, you’ve probably already fixed it and just need Google to recrawl. If the live test fails too, keep going through the checks below.
Step 3: Match the reason to the fix
Excluded by “noindex” tag
The page, or its HTTP headers, tells Google not to index it:
<meta name="robots" content="noindex">
X-Robots-Tag: noindex
This is common after a site launch when a staging setting is left on, or with SEO plugins that noindex categories or tags. Remove the tag if you want the page indexed.
Blocked by robots.txt
Google can’t crawl the page, so it can’t read it. A blocked page can sometimes still appear in results as a bare URL with no description, but it won’t be properly indexed. Check your rules; robots.txt mistakes that hurt SEO covers the usual culprits, such as a leftover Disallow: /.
Also: if you block a page in robots.txt, Google can’t see a noindex tag on it. Use one or the other, not both.
Alternate page with proper canonical tag
Your page has a canonical tag pointing to another URL, so Google indexes that one instead. This is correct for duplicates. If it’s a mistake, for example every page pointing to the home page, fix the tag. See canonical tags.
Duplicate, Google chose different canonical than user
You said one URL is the main version; Google picked another. This usually means the pages are very similar, or your internal links, sitemap and redirects point to the other URL. Make the signals agree, or make the pages genuinely different.
Soft 404
The page returns 200 OK but looks empty or like an error: “no results”, “product unavailable”, very little text. Either add real content, or return a proper 404 or 410 if the page is gone.
Page with redirect, Not found (404), Server error (5xx)
The URL redirects elsewhere, doesn’t exist or failed to load. Check the final URL, fix broken links and make sure your server is stable.
Step 4: “Discovered” and “Crawled – currently not indexed”
These two confuse people most, because nothing is technically wrong.
- Discovered – currently not indexed. Google knows the URL exists but hasn’t crawled it yet. On small sites this is usually about priority: Google doesn’t see enough reason to fetch it soon. On very large sites it can relate to crawl budget or server load.
- Crawled – currently not indexed. Google fetched the page and decided not to index it, at least for now. It may revisit later.
Neither is a penalty. The common fixes:
- Improve the page. Does it answer a question better than what’s already indexed? Thin, duplicate or mostly boilerplate pages are often left out.
- Link to it internally from relevant, already-indexed pages, so Google sees it matters. See internal linking.
- Merge several weak pages on the same topic into one strong page.
- Be patient. Google doesn’t index every page it finds, and it says so openly.
Step 5: Request indexing
Once you’ve fixed the cause, click Request indexing on the URL Inspection result. This puts the page in a priority crawl queue. It doesn’t guarantee indexing, and there’s a daily limit, so use it for important pages rather than your whole site.
For many pages, submit an up-to-date XML sitemap instead.
New sites need patience
A brand-new domain with few links can take days to weeks before Google crawls and indexes much of it. Submit your sitemap, link your pages together, and get the site mentioned where it’s genuinely relevant. Repeatedly requesting indexing won’t speed things up.
Quality is often the real answer
If every technical check passes and a page still isn’t indexed, the honest answer is often that Google doesn’t think it adds enough. Ask:
- Is this page substantially different from others on my site?
- Does it fully answer what someone searching would want?
- Would I link to it from my home page?
OZMAICO’s Site audit can help spot thin pages, orphan pages and canonical problems across your whole site at once.
In short
- Inspect the URL in Search Console.
- Run a live test.
- Fix the stated reason: noindex, robots.txt, canonical, soft 404, redirect or error.
- For “Discovered” or “Crawled – currently not indexed”, improve the page and link to it.
- Request indexing once, then give it time.
- If everything is clean, focus on making the page genuinely more useful.
Check your own website
See which AI bots really visit your site — real or fake, page by page — and how many people AI assistants send you. Free.
