My Business
2.7K members online now
2.7K members online now
Follow threads that discuss the latest tips on how to get your business online… for free!
Guide Me
star_border
Reply

Site's Home Page is Blocked

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

Hi I have unblocked my website from robots.txt on 5 April, 2016. Now my all pages are getting cached in Google and for home page description shows, this page is blocked by robots.txt. I have allowed whole website in robots.txt. My sitemap also not getting crawled in webmaster, shows the page is blocked in robots. You can check my website's robots at www.zoganto.com/robots.txt.

 

Please help me.

Re: Site's Home Page is Blocked

Follower ✭ ✭ ✭
# 2
Follower ✭ ✭ ✭
Hi Anil,

I just checked Google to see if your your site is index and it is. please search the following in Google site:http://www.zoganto.com/ and it shows each page of your site that is index and being crawled.

The webmaster message may not have been updated since fixing the robots.txt file but it does seem as if all is OK. You can get the search console to re crawl your site by going to the search console, crawl, fetch as Google.

Please let me know if you have any further questions and I'm happy to answer them.

Re: Site's Home Page is Blocked

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭
Hi,

I really extremely appreciate your reply.

Yeah, I understand, However, when I submit sitemap in webmaster then It
shows that sitemap contains blocked URLs by robots.

Thanks,
Anil Kumar
Marked as Best Answer.
Solution
Accepted by topic author Anil K
May 2016

Re: Site's Home Page is Blocked

Follower ✭ ✭ ✭
# 4
Follower ✭ ✭ ✭
Ah ok now that I'm on a desktop I can see your robots.txt file better!

It is missing some content

Your file states:
User-agent:*

To allow indexing of everything the file should state:
User-agent:*
Disallow:

OR

User-agent:*
Allow:/*

Let me know if this helps :)