AdWords is now Google Ads. Our new name reflects the full range of advertising options we offer across Search, Display, YouTube, and more. Learn more

Ads
2.5K members online now
2.5K members online now
For questions related to Google Shopping and Merchant Center. Learn to optimize your Shopping ads
Guide Me
star_border
Reply

The robots.txt file for your page prevented us from crawling the image.

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

As the subject says, my product in a feed are being put on hold and not approved because of the error above. My robots.txt file is set up properly:

 

User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:

 

When I go to the search console as well and try to fetch an image as google bot, there is a response: ALLOWED

 

What to do?

1 Expert replyverified_user
1 ACCEPTED SOLUTION

Accepted Solutions
Marked as Best Answer.
Solution
Accepted by topic author Terra T
June

The robots.txt file for your page prevented us from crawling the image.

Rising Star
# 2
Rising Star

Below link is a list of other Google bots. Please try to enable access for all.

 

https://support.google.com/webmasters/answer/1061943?hl=en

 

or

 

Enable access for all bots

 

User-agent: *
Disallow:

 


Sunil, AdWords Rising Star, Community Profile  Rmotive Services
Did you find any helpful responses or answers to your query? If yes, please mark it as the ‘Best Answer’

View solution in original post

Marked as Best Answer.
Solution
Accepted by topic author Terra T
June

The robots.txt file for your page prevented us from crawling the image.

Rising Star
# 2
Rising Star

Below link is a list of other Google bots. Please try to enable access for all.

 

https://support.google.com/webmasters/answer/1061943?hl=en

 

or

 

Enable access for all bots

 

User-agent: *
Disallow:

 


Sunil, AdWords Rising Star, Community Profile  Rmotive Services
Did you find any helpful responses or answers to your query? If yes, please mark it as the ‘Best Answer’

The robots.txt file for your page prevented us from crawling the image.

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭

Hi, first, thanks for replay. Now, because my website was in beta testing, robots were blocked for some time, then we have allowed robots after we launched.

Now robots are fine, and as far as I can tell, any new product that i add to the shop is crawled nicely in merchant center feed, but all the products that were added before official launching are still displaying with an error above.

 

Is it maybe because google needs some time to realize that products images are now crawlable or do I need to do something now regarding the products that were entered before, when the robots were indeed blocking the bots?