Mueller Asked About Lag in Google Search Console Indexing Report

  • Share

Google’s John Mueller answered a query in a Google Office Hours Hangout a few Search Console however the place URLs had been listed as excluded however when the URL is examined the online web page was listed as listed.

Google’s John Mueller mentioned that he’s seen experiences of this anomaly and that he had an thought of what it could be.

Why Was Page Crawled But Not Indexed?

An individual requested a query about a difficulty the place Google experiences that pages are usually not listed however when examined one other report says they’re listed.

This subject is making it tough for the individual to precisely observe crawling and indexing statistics for the location.

The individual asking the query defined the issue:

“We have like a very large number of Crawled Not Indexed Pages listed under Excluded.

But then when we click into them most of these seem to have been converted into indexed pages.

So we’re really unable to accurately track how improvements to our site are impacting which pages are being indexed.

And I was curious I guess about the timeline in that.

We’re concerned it’s impacting our crawling budget.”

Advertisement

Continue Reading Below

Crawl Budget Impact

The individual asking the query was involved that the crawled however not index error was inflicting a difficulty with their crawl price range.

A crawl price range is the quantity of URLs that Google allots to crawl on a web site.

The crawl price range is calculated partly on the servers skill to serve pages.  This known as the Crawl Capacity Limit.

If a server has a tough time serving pages then Google would possibly restrict how a lot it crawls in order to not impression the server’s skill to serve pages.

But if a server responds shortly and may simply deal with GoogleBot’s request for extra pages then Google could determine to lift the crawl price range and crawl extra pages.

The crawl price range can also be influenced by how usually a web site is up to date.

A web site that’s hardly ever up to date could also be crawled much less usually than a web site that’s continuously up to date.

What was happening, which the individual revealed afterward, was that the location has a whole lot of hundreds of pages.

Advertisement

Continue Reading Below

But Google was solely indexing round 2,000 per day, which means that quite a lot of pages weren’t being crawled in any respect.

The underlying concern that wasn’t but raised was actually about why aren’t these different pages getting listed and if this crawled not index subject had one thing to do with the crawling drawback.

But that query hadn’t but been requested.

So John Mueller solely answered, at this level, the query that was posed to him, which was concerning the crawled however not listed drawback and if that was impacting Google’s crawl price range.

John Mueller addressed the crawl price range subject:

“I doubt it would be affecting your crawling budget… as a side note.”

Google Crawled – Currently Not Indexed

Google’s Mueller subsequent answered why Google would possibly present {that a} web page was crawled however not listed however truly be listed.

Mueller’s response:

“It’s something where I’ve recently seen some threads like this on Twitter as well where people saw URLs that were flagged as not being indexed in Search Console.

And then when you check them individually they are actually indexed.

I don’t know exactly what is happening there yet.

My suspicion is it’s more a matter of timing in that we show them in the Search Console report and then they get indexed over time.

…Then at some point they would drop out of the report again.

And for whatever reason kind of that dropping out is taking a little bit longer than it should.

That’s kind of my guess there.”

Verify Index Coverage Issue

Mueller subsequent steered a approach to confirm whether or not or not what was being reported in Google Search Console was an actual index protection drawback or whether it is only a lag in reporting.

John Mueller steered:

“One way to kind of verify that is to see if these pages actually show up for normal searches.

So take some words from the page, search for that.

And if they do show up then I think there’s nothing you really need to do.

It’s just a report that’s kind of lagging behind.”

Lag in Index Coverage Reporting

There seems to be a lag in the indexing report. One hopes that the lag is one thing Google could check out in the close to future because it presents a poor person expertise to offer false data .

Citations

Read Google’s builders web page explainer about GoogleBot crawl price range:

Large Site Owner’s Guide to Managing Your Crawl Budget

Advertisement

Continue Reading Below

Watch John Mueller reply the query about Google Search Console indexing report lagging behind.

View it on the 22:43 minute mark:

!function(f,b,e,v,n,t,s)
{if(f.fbq)return;n=f.fbq=function(){n.callMethod?
n.callMethod.apply(n,arguments):n.queue.push(arguments)};
if(!f._fbq)f._fbq=n;n.push=n;n.loaded=!0;n.version=’2.0′;
n.queue=[];t=b.createElement(e);t.async=!0;
t.src=v;s=b.getElementsByTagName(e)[0];
s.parentNode.insertBefore(t,s)}(window,document,’script’,
‘https://connect.facebook.net/en_US/fbevents.js’);

if( typeof sopp !== “undefined” && sopp === ‘yes’ ){
fbq(‘dataProcessingOptions’, [‘LDU’], 1, 1000);
}else{
fbq(‘dataProcessingOptions’, []);
}

fbq(‘init’, ‘1321385257908563’);

fbq(‘track’, ‘PageView’);

fbq(‘trackSingle’, ‘1321385257908563’, ‘ViewContent’, {
content_name: ‘mueller-asked-about-lag-in-google-search-console-indexing-report’,
content_category: ‘news seo ‘
});

  • Share