How to Check If Google Can See Your Website: Indexing, Sitemaps and Search Console

A website can load normally in a browser and still be missing from Google. This does not always mean that the site is broken. Google may not have discovered the URL yet, may have crawled it without selecting it for indexing, or may have found a technical directive that prevents indexing.

The following check takes approximately 15-30 minutes, costs nothing and requires access to Google Search Console.

• **crawling** - Googlebot visits the URL and reads the page;
• **indexing** - Google evaluates the page and may add it to its index;
• **ranking** - an indexed page competes for a position in search results.

Indexing does not guarantee a high ranking. However, a page that is not indexed cannot receive organic Google traffic. If your site cannot be found at all, start with Why my website is not in Google.

A five-minute initial check

1. Check the search results

site:yourdomain.com
site:yourdomain.com/specific-page

Treat this as a quick clue only. The site: operator is not a complete index report. Use Search Console URL Inspection for the definitive status of a specific URL.

2. Inspect the URL in Search Console

Paste the full URL into the inspection field, including the correct HTTPS and www/non-www version. URL is on Google means the URL is indexed, while URL is not on Google means it is currently absent from the index and the report should show a reason or status. For the full checklist, see Google Search Console: what to check.

3. Run Test Live URL

The live test checks the current version of the page. URL is available to Google means that the test found no immediate technical barrier to indexing. It does not guarantee that Google will index or rank the page.

HTTP status

• **200 OK** - the normal status for an indexable page;
• **301/308** - a redirect; the destination is what gets indexed;
• **404** - page not found;
• **410** - intentionally and permanently removed;
• **5xx** - server error;
• **soft 404** - the server returns 200 but the content looks like an error or empty page.

Do not redirect every retired URL to the homepage. Use a 301 only when a precise replacement exists. If there is no equivalent, a genuine 404 or 410 is usually more correct.

noindex and robots.txt

<meta name="robots" content="noindex">
X-Robots-Tag: noindex

Check Indexing allowed? in URL Inspection. The robots.txt file primarily controls crawling. If a URL is blocked there, Google may be unable to crawl the page and see its noindex directive. Robots.txt is therefore not a reliable method for removing a URL from the index.

Canonical URL

Compare User-declared canonical and Google-selected canonical. A unique indexable page should normally have a self-referencing canonical. If Google selects another URL, investigate duplicate content, parameters, HTTP/HTTPS, www/non-www, trailing slashes and inconsistent internal links.

sitemap.xml

• the URL returns 200;
• no noindex;
• no redirects;
• a self-referencing canonical;
• no 404 or 410;
• the preferred HTTPS hostname.

Submit sitemap.xml under Indexing → Sitemaps in Search Console. One current, consistent sitemap is better than several old ones with different hostnames. A sitemap assists discovery; it does not guarantee indexing.

Internal links

Important pages should be reachable through ordinary HTML links from navigation, a category or service hub, relevant articles, breadcrumbs or other related pages. A URL with no internal links is an orphan page and may appear unimportant even if it is listed in the sitemap. The content also has to match a clear search intent, which is what a semantic core organises.

Understanding common Search Console statuses

• **Discovered - currently not indexed:** Google knows the URL but has not fully processed it. Review the sitemap, internal links, server reliability and the number of low-value URLs.
• **Crawled - currently not indexed:** Google visited the page but has not selected it for indexing. Assess uniqueness, completeness and overlap with similar pages.
• **Page with redirect:** the source URL redirects; use the destination in the sitemap and internal links.
• **Alternate page with proper canonical tag:** Google treats the URL as an alternative to another page. No action is required if this is intentional.
• **Excluded by noindex:** Google found a noindex directive. Remove it only if the page should be public and indexed.
• **Blocked by robots.txt:** Googlebot cannot crawl the URL. Confirm whether the block is intentional before changing it.
• **Not found (404):** this is correct for removed content with no replacement. If an exact replacement exists, add one direct 301 redirect.

When to use Request Indexing

Use Request Indexing after publishing an important page or making a substantial correction. Do not submit the same URL every day: repeat requests do not speed up crawling, quotas apply, and submission does not guarantee indexing. For many URLs, rely on a clean sitemap and sensible site architecture. Do not use the Google Indexing API for ordinary service or blog pages; it is limited to supported JobPosting and livestream BroadcastEvent content.

Practical checklist

• The URL loads and returns 200.
• There is no meta or X-Robots-Tag noindex.
• robots.txt does not block the important page.
• The canonical points to the correct final URL.
• The URL appears in the current sitemap.xml.
• The sitemap contains no redirects, 404s or noindex pages.
• At least one contextual internal link points to the page.
• The content is unique and answers a clear search intent.
• Test Live URL succeeds.
• Request Indexing is submitted once after a meaningful change.

Conclusion

Identify the stage at which the problem occurs: discovery, crawling, indexing or ranking. The HTTP status, noindex directives, robots.txt, canonical URL, sitemap and internal links usually provide a clear initial diagnosis. To evaluate the entire website rather than a single URL, read our technical SEO audit guide or explore Juice SEO services.

Frequently asked questions