Google: Crawl Budget Goes Across All Googlebot Crawling, Not Just Web Search
seroundtable.com -

When it comes to crawl budget and Google not crawling your site too much or too little, Google takes into account all Googlebot activity across all verticals. So that includes crawling for web search, Merchant Center, ads, and all the various crawling activities. Google's John Mueller was asked by Christian Radny, "Does merchant center crawling (automatic updates) count for crawling budget?" John Mueller replied, "Sure - it's a load on your server. The goal is to avoid breaking your server...

In related news

  • Google Search With 16 Shopping Ads

    It is good to have choices but too many choices might not be good, said some wise man. Well, here is Google giving you 16 choices of bikes in the shopping ad spot at the top of the Google Search results.This was spotted by Mike Hardaker and he shared this screenshot with me on X - here it is:I tried to replicate it, but I was unable to. I suspect this is some sort of weird bug?I mean, I was able to see the normal carousel ads:I also saw the right side ads:And those new vertical tall ads:This...

  • Google AI Writing Some Search Knowledge Panels

    Google has for a long time used AI to write some knowledge panels. But now Google is labeling some of these AI written knowledge panels with "Al overviews are experimental" as a disclaimer. This may show up for both SGE and non-SGE results, I believe.Johannes Beus at Sistrix posted about this, sharing this screenshot:You can see that one shows the AI written section and one does not. I tried it myself logged in to SGE and it did not give me the AI written knowledge panel:That being said, I do...

  • Who is Prabhakar Raghavan and why is he accused of killing Google Search?

    A study earlier this year by German academics verified what many users of Google search had long suspected: the search engine, once the gold standard for such activities, had been getting worse. The reason, the researchers concluded, is that too much low-quality content was being optimized to appear higher inRead Entire Article