Google: Noindexed Pages Do Not Effect Crawl Budget Plan

Posted by

Google’s Browse Relations team validates that noindexed pages don’t negatively impact a website’s crawl spending plan, no matter the number of a site has.

This topic is dealt with not once but thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Advocates John Mueller and Gary Illyes take turns responding to 3 similar questions from people worried they have too many noindexed pages on their websites.

From Mueller’s and Illyes’ actions, we discover there’s no such thing as “a lot of” indexed pages. Further, unless your website has more than a million pages, there’s no requirement to worry about crawl budget.

Here’s a fast recap of each concern and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” number of indexed pages is an issue for discovery or indexed.

Illyes states noindex is a tool to assist sites keep material out of search engines. Google motivates utilizing the noindex tag when necessary, and because of that, there are no negative impacts connected with it.

“Noindex is a really effective tool that search engines support to assist you, this website owner, keep content out of their indexes. For this factor, it does not bring any unintended effects when it comes to crawling and indexing. For example, having lots of pages with noindex will not affect how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following concern turns up at the 10:22 mark:

“Should we keep an eye on the ratio in between indexed and non-indexed pages in Browse Console in order to much better acknowledge potentially lost crawl spending plan on non-indexed pages?”

Mueller exposes that websites should try to stabilize their indexed and nonindexed pages.

To that end, crawl budget is a factor that few sites need to consider; Mueller says:

“No, there is no magic ratio to keep an eye out for. Also, for a site that’s not gigantic, with less than a million pages, perhaps, you actually do not require to worry about the crawl budget of your site. It’s great to eliminate unnecessary internal links, but for small to medium-sized sites, that’s more of a site hygiene topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern comes up about no indexed pages that’s slightly different from the previous 2.

The question checks out:

“A great deal of SEOs are grumbling about having countless URLs flagged as excluded by noindex in Google Search Console. All to nonsense internal search pages connected from spammy sites. Is this a problem for crawl spending plan?”

Ilyes reiterates the earlier point about noindex being a tool for sites to utilize as required.

Assuming the pages are purposefully noindexed, there’s no requirement to worry about Browse Console flagging them. It does not suggest you’re doing anything incorrect.

Illyes states:

“Noindex exists to assist you keep things out of the index, and it does not featured unintended negative effects, as we said formerly. If you want to make sure that those pages or their URLs, more particularly, do not end up in Google’s index, continue utilizing noindex and don’t fret about crawl budget.”

Source: Google