How Do You Keep Unwanted or Duplicate Pages Out of Google?

By Bill Stilwell · Last reviewed October 16, 2026

The short answer

To keep a page out of Google, add a noindex tag to it and leave it open for Google to crawl. To tell Google which version of a duplicate page to show, use a permanent redirect or a canonical tag that points to your preferred address. Then check the Page indexing report in Google Search Console to confirm what Google has and hasn’t indexed.

What this means

“Indexed” means Google has saved the page and can show it in search results. Not every page should be indexed. Good candidates to keep out:

Form thank-you pages
Test or staging pages (see 13.2.3 Staging and Production Sites)
Internal search results pages
Thin tag or archive pages your website builder creates automatically
Login and account pages

There are two main tools.

Noindex is a tag in the page code that says “don’t show this page in search.” Google says you can add it as a robots meta tag in the page’s head section, or as a Hypertext Transfer Protocol (HTTP) header for files like portable document format (PDF) files. HTTP is the system that sends web pages to browsers.

Canonical tells Google which address is the main one when the same content shows at several addresses. For example, your home page may load at “http://example.com,” “https://example.com,” and “https://www.example.com.” Google says redirects and canonical tags are strong signals, and listing a page in your sitemap is a weaker one.

Say Clear View Window Washing has a quote form. After someone sends it, they land on a “thanks” page. If that page is indexed, people may find it in Google and land on a page that says “Thanks for your request!” without ever sending one. That also throws off form tracking (see 13.7.3 Form Tracking). A noindex tag fixes it.

Why it matters

Junk pages crowd your results. Thank-you pages and empty archives can show up instead of your service pages.
Duplicates split your signals. If Google sees two copies of a page, it picks one, and it may not be the one you want.
Mistakes can hide real pages. A noindex left on a service page after launch removes it from search.
Robots.txt and noindex fight each other. Google says if robots.txt blocks a page, Google never sees the noindex tag, and the page can still show up if other sites link to it (see 19.5.1 Crawl Access and Robots.txt).

Who this applies to

Every business website. Sites built on WordPress or other content management systems often create extra archive pages without you knowing. Sites that changed from “http” to “https” or from “www” to no “www” need canonical and redirect checks (see 13.2.2 HTTPS).

How to do it

List pages that shouldn’t be in search: thank-you, test, login, internal search, and empty archive pages.
Add noindex to each one. Most website builders and search plugins have a setting like “hide from search engines” for each page. If not, ask your developer to add a robots meta tag with “noindex.”
Make sure those pages are not blocked in robots.txt. Google has to crawl the page to see noindex.
Pick one main version of your domain, such as “https://www.example.com,” and redirect the others to it (see 19.5.6 Broken Links and Redirects).
Check that each page has a canonical tag pointing to itself, using the full address. Many builders do this automatically. Google advises picking one canonical method rather than mixing them.
Don’t use noindex to handle duplicates within your site. Google recommends redirects or canonical tags instead, because noindex removes the page from search entirely.
In Google Search Console, open the Page indexing report. Look at “Why pages aren’t indexed” for pages you expected to be in search.
Use the URL Inspection tool to check a single page. It shows whether Google saw a noindex and which address Google chose as canonical.
Be patient. Google says it must recrawl a page to see a new noindex, and that can take a while for less important pages. You can request a recrawl in URL Inspection.

What proof to keep

A list of pages set to noindex and why
Screenshots of the Page indexing report and URL Inspection results for key pages
Notes on your chosen main domain version and the redirects in place

Keep these in your website records folder.

Common mistakes

Leaving “discourage search engines” turned on after launch. WordPress and some other builders have this setting. Check it on launch day.
Blocking a page in robots.txt and expecting it to drop out of Google. Use noindex and keep it crawlable.
Adding noindex to a duplicate location page instead of fixing it. If the page is thin, improve it or merge it with a redirect (see 13.4.6 Location Pages).
Canonical tags pointing to the home page from every page. Some templates do this. It tells Google your other pages are copies.
Tracking codes making new addresses. Links with tracking added to the end can create extra versions of a page. Google lists these as a common cause of duplicates. A self-pointing canonical tag helps.
Checking once and never again. Updates and plugins can change these settings. Check the Page indexing report each month.

When to get help from a pro

A search engine optimization (SEO) specialist or web developer: if important pages show as “not indexed” or Google picks the wrong canonical. Questions to ask:

Which of my pages are excluded from Google, and why?
Is any page set to noindex or pointing its canonical somewhere it shouldn’t?

Bill’s note

[Bill: add a short story or lesson here. For example, a site where a plugin set service pages to noindex, or a thank-you page that showed up in Google and threw off a client’s lead counts.]

If you’d rather have this done for you, SiteSmarty checks index settings as part of every website launch.

How I did this for SiteSmarty

[Date I did this:]
[What I actually did, step by step: which SiteSmarty pages I set to noindex and how I checked canonicals]
[What it cost and how long it took:]
[What surprised me or what I’d do differently:]
[Screenshot or photo to add, with private info blurred: SiteSmarty’s Page indexing report and a URL Inspection result]
[Result so far:]

Questions people ask

What does noindex mean? It’s a tag that tells search engines not to show a page in search results. The page still works for visitors.

What is a canonical tag? A tag that tells Google which address is the main version of a page when the same content shows at more than one address.

Which pages should I keep out of Google? Thank-you pages, test pages, login pages, internal search results, and empty archive pages.

Why is Google showing the wrong version of my page? Google picks a canonical when it sees duplicates. Use redirects and canonical tags to point it to the version you want.

How long does it take for a page to drop out? Google has to recrawl the page first. That can take a while, and you can request a recrawl in URL Inspection.

Audit check

Question: Are unwanted pages set to noindex and left crawlable, and does every key page point to one correct canonical address?
Pass looks like: Thank-you, test, login, and archive pages set to noindex. One main domain version with redirects from the others. Self-pointing canonicals. No key pages listed as excluded in the Page indexing report.
Fail looks like: Thank-you pages in search, noindex on service pages, noindex pages blocked in robots.txt, every canonical pointing to the home page, or several live versions of the domain.
Evidence to collect: The noindex list, Page indexing report screenshot, and URL Inspection results for key pages.

Where this fits

Do this first: 19.5.1 Crawl Access and Robots.txt

Do this next: 19.5.3 Page Speed

Sources

Google Search Central, "Block search indexing with noindex" (checked October 16, 2026)
Google Search Central, "How to specify a canonical URL with rel="canonical" and other methods" (checked October 16, 2026)
Google Search Central, "Robots.txt introduction and guide" (checked October 16, 2026)

This page explains general rules and Bill's own experience. It is not legal, tax, or insurance advice. Talk to a qualified professional about your situation.