Not sure if this is the place for this - none of the categories seem right... Does anybody know how to control how quickly adsbot crawls your site? It's been making multiple requests a second for the last few days (150,000 by 9am this morning) and it's having a real impact. I've tried putting crawl-delay in robots.txt (even though I'm sure it doesn't obey that) and lowering the crawl rate in webmaster tools but only because I couldn't think of anything else.
November 2015 - last edited November 2015
Hey Paul, are things?
I think you would get a better response on this by going on the official webmasters community. They usually have to deal a lot with google bots, and I know that some of the bots are the same for ads and organic stuff.
It's this way: https://productforums.google.com/forum/#!forum/webmasters
Hope this helps.
Leandro Martinez | Basta1Click
Did you find any helpful responses or answers to your query? If yes, please mark it as the ‘Best Answer.’