AdWords is now Google Ads. Our new name reflects the full range of advertising options we offer across Search, Display, YouTube, and more. Learn more

Analytics
2.7K members online now
2.7K members online now
Learn to identify referral spam traffic, as well as best practices to reduce referral spam in your Google Analytics account
 
Guide Me
star_border
Reply

Getting hit heavy by Google bots, slowing down site

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

Hi,

I am brand new here, because I don't understand any of this. It's all over my head.

 

Before I begin the very slow process of learning, I thought I'd ask a question.

 

When my site slows down (hosted by FatCow, Wordpress format), I check IPs that are hitting my site, and 9 out of 10 appear to be Google bots. I've been advised to start a "Google Webmaster Account" (haven't got that far yet, to find a way to get Google to slow or alter their crawls and stop bombarding my site. 

 

I've tried to block their IPs (most starting with 66.),but they just keep coming and some that I've blacklisted keep appearing.

 

Am I totally in the wrong place? Is there a way to stop these massive hits from where I am now? Please remember, I'm clueless and have no skills when it comes to finding my way around my own website. Everything I've just explained took me years to grasp (unfortunately, no joke).

 

Any help a two year old would understand would be greatly appreciated.

 

Cheers

W

1 Expert replyverified_user

Re: Getting hit heavy by Google bots, slowing down site

Rising Star
# 2
Rising Star
Blocking Google bots from your site would of course badly hurt your position in indexes. And blacklisting them rather than using robots.txt is the worst choice. There are a lot of bots out there besides Google's - if your site cannot handle bot traffic, then you have some pretty big problems with your WordPress installation. You should consider finding local professional WordPress consulting and switching to a WordPress hosting specialist like https://getflywheel.com/ or https://wpengine.com/

What makes you think your site is "slowing down?"
_________________________________________________________________________
Director of Marketing | Nehmedia | Partner Profile

Re: Getting hit heavy by Google bots, slowing down site

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭
Thanks for responding, Phillip.

The slow downs are real. And through dealing with what little tech help I have available to me, I've had a routine of getting a logcrunch to show me which IPs are bombarding my site. The BIG numbers. By blocking those nefarious looking IPs, it eases the strain on my site, eases the power usage, stops the timeouts and database errors and gets me running normally again within minutes.

However... in the last 2-3 months, those big hitters have been Google IPs. I still get a few nefarious foreign places, but it's mostly Google. That is, if it actually IS Google. It may be disguised bots, for all I know.

But, I still want to stop them. I'm not concerned about losing my position in indexes. My site is such that additional traffic is not all that welcomed anyway.

I'm not in a position to spend money (my host would rather try to sell me more, so their help is limited). But, I'm not going to go that route. I'd rather just close up shop than start investing a hundred bucks a month in hosting, or pay others to analyze and advise.

Right now... I just want to find a way to slow down Google's crawling on my site, and one techie told me that a "Google Webmaster Account" can help me limit that. But, as I said... I'm clueless.

So I'm looking for immediate band-aid help, before beginning to access other long term problems. That is... IF I decide to address bigger issues. I used to be on Blogger before buying my own site. I'm coming up on ten years now and don't need much pushing to find a new and different hobby.

So... do you have any advice on stopping Google IPs. Because in the last two months, I'm getting hit with Google address IPs that I had ALREADY blocked, and that's unusual.

Thanks again for your time.
W

Re: Getting hit heavy by Google bots, slowing down site

Rising Star
# 4
Rising Star

Since you indicated you have a WordPress site, it's relatively easy to set your robots.txt file to block legitimate search engines bots from crawling your site.  Go to Settings > Reading and check the "Search Engine Visibility" box. 

Reading Settings ‹ Essential Austin — WordPress.png

 This makes WordPress create a robots.txt file that will DIsallow indexing.  Once you do this, only the bad guys will continue to spider your site.

https://support.google.com/webmasters/answer/6062596?hl=en



_________________________________________________________________________
Director of Marketing | Nehmedia | Partner Profile

Re: Getting hit heavy by Google bots, slowing down site

Visitor ✭ ✭ ✭
# 5
Visitor ✭ ✭ ✭
Fantastic. I've already clicked the option and will get a logcrunch to check what IPs are hitting me in a couple of days. I appreciate the so-simple-I-should-have-already-known help... or the so-simple-my-tech-help-should-have-suggested-it-instead-of-trying-to-sell-me-something-else fix.

Many thanks for your time, Phillip

Re: Getting hit heavy by Google bots, slowing down site

A T
Participant ✭ ✭ ✭
# 6
A T
Participant ✭ ✭ ✭
Also spam / bot hits can be easily filtered out from GA.

http://www.lunametrics.com/labs/recipes/