AdWords is now Google Ads. Our new name reflects the full range of advertising options we offer across Search, Display, YouTube, and more. Learn more

Ads
2.8K members online now
2.8K members online now
For questions related to Google Shopping and Merchant Center. Learn to optimize your Shopping ads
Guide Me
star_border
Reply

Shopping API not crawling images

[ Edited ]
Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

We are submitting our products thru the Shopping API, the response is ok, and the product is listed in the merchant center, however image says "robots.txt file prevented it from being crawled". I ve checked this also in webmaster forums but the robots.txt file seems okay. In fact, using Google webmaster tools Robots.txt checker shows green light for the  specific image I was uploading with my product.

 

Is there an issue with images submitted thru the API? What other checks we can do?

 

Screen Shot 2015-08-03 at 9.46.32 AM.png

Screen Shot 2015-08-03 at 9.47.23 AM.png

2 Expert replyverified_user
1 ACCEPTED SOLUTION

Accepted Solutions
Marked as Best Answer.
Solution
Accepted by topic author Murat Y
September 2015

Re: Shopping API not crawling images

[ Edited ]
Top Contributor
# 2
Top Contributor


the robots message can sometimes have nothing whatever to do with robots.txt --
that message can also be triggered if any of the image_link url's are invalid
or the size of the images are too large for the web-server to keep pace with
all google's crawl requests.

also, a single disapproval message can be triggered by multiple issues.

unfortunately, forum members cannot look into the submitted data or account;
posting more exact information here in the public forum may help -- such as,
the exact image_link url value being sent.

otherwise, the best likely course would be to contact a support specialist.

View solution in original post

Marked as Best Answer.
Solution
Accepted by topic author Murat Y
September 2015

Re: Shopping API not crawling images

[ Edited ]
Top Contributor
# 2
Top Contributor


the robots message can sometimes have nothing whatever to do with robots.txt --
that message can also be triggered if any of the image_link url's are invalid
or the size of the images are too large for the web-server to keep pace with
all google's crawl requests.

also, a single disapproval message can be triggered by multiple issues.

unfortunately, forum members cannot look into the submitted data or account;
posting more exact information here in the public forum may help -- such as,
the exact image_link url value being sent.

otherwise, the best likely course would be to contact a support specialist.

Re: Shopping API not crawling images

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭
Apparently it was the image size being too big, i reduced the image size and it started accepting... Thanks.

Re: Shopping API not crawling images

Top Contributor
# 4
Top Contributor
Hi Murat, what was your original image, and what have you resized it too? I would like to know this Smiley Happy

Thanks!
Twitter | Linkedin | Community Profile | Shopping Feed Tips From FeedArmy
Did you find any helpful responses or answers to your query? If yes, please click on ‘Accept As Solution’

Re: Shopping API not crawling images

[ Edited ]
Visitor ✭ ✭ ✭
# 5
Visitor ✭ ✭ ✭

The original was about 1000x1700 pixels, I cut it down to 1/3 - apprx 300x510 pixels and it worked.

Re: Shopping API not crawling images

[ Edited ]
Top Contributor
# 6
Top Contributor

Thanks for the reply, I would like to give you a tip.

Recommended size is 800 by 800 pixels. If you go lower or higher I would recommend if possible to make it a square image.

Reference:
https://support.google.com/merchants/answer/188494?hl=en

Twitter | Linkedin | Community Profile | Shopping Feed Tips From FeedArmy
Did you find any helpful responses or answers to your query? If yes, please click on ‘Accept As Solution’

Re: Shopping API not crawling images

[ Edited ]
Top Contributor
# 7
Top Contributor


note that if the issue relates to (large) image sizes, the acceptable size
depends mainly on the server and bandwidth details where the images
are hosted and other factors, including google's size requirements --
there is no one size that would necessarily work for all use-cases.

the number of image_link values and additional_image_link values
submitted can also effect the sizes that can be properly crawled.

both the the number and size of images tends to effect crawl results --
this is especially true if a random set of disapprovals relating to images
are seen after each re-upload or random image problems are seen often.

also, a crisp photograph of the product itself should cover most of the image,
without excessive borders -- the item should cover 75%-90% of the image.

approximately 300x300 pixels is generally best.

around 300x300 pixels seems to work for the majority of server configurations,
bandwidth limits, and inventory totals, while also adhering to google's size
requirements for most types of items and showing the best results with respect
to most product-listing-ad formats.

not all severs can handle the larger recommended ~800x800 pixels consistently --
especially as inventory increases or images approach google's 4mb/64mp limits.