AdWords
2.2K members online now
2.2K members online now
For questions related to Google Shopping and Merchant Center. Learn to optimize your Shopping ads
Guide Me
star_border
Reply

Product pages cannot be crawled - external resources

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

Hello. I get the "Product pages cannot be crawled with a mobile user-agent because of robots.txt restriction" message, despite the fact that all resources on my domain are allowed to robots. When I use "fetch as Google" tool it shows some blocked links, but only to external resources. Could this be a problem? 

1 Expert replyverified_user

Product pages cannot be crawled - external resources

Community Manager
# 2
Community Manager

Hi there,

Thanks posting to the Community.

 

I'm sorry to hear about the issue you've encountered. Please let us know if you're still having this issue, we're happy to help.

 

Best,

Spencer

Product pages cannot be crawled - external resources

Top Contributor Alumni
# 3
Top Contributor Alumni

Hi

Do you mean there are are external resources hotlinked in your product pages? In which case it is quite possible that the 3rd party from where you are pulling these resource might be blacking something.

 

Regards, Nik
LinkedIn  |   @nikhilparachure | My Blog