AdWords
1.7K members online now
1.7K members online now
Dive into advanced features like Remarketing, Flexible Bid Strategies, AdWords Editor, and AdWords Scripts
Guide Me
star_border
Reply

Dynamic Search Ads: Googlebot vs. Adsbot

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

Hi community,

 

To the best of my knowledge, Dynamic Search Ads are triggered by content on my website that is indexed via Googlebot. 

 

Now comes the tricky part: One of clients has an online shop with a huge inventory (>2mio products) but since the shop is still fairly new and all product detail pages are set to "noindex" (don't ask me why Smiley Wink )

 

However: I DO actually see product detail pages that triggered ads in the search query report of some Test-DSA Campaigns I've set up. And by sheer coincidence, I've noticed that these were product detail pages where I've sent AdWords-traffic to with campaigns there were set up manually. This seems to indicate that you can use the AdWords-Adsbot to "trick" the system.

 

Is there somebody out there who can confirm this? I will of course conduct further tests.

 

All the best,

Marcel

1 Expert replyverified_user

Re: Dynamic Search Ads: Googlebot vs. Adsbot

Top Contributor
# 2
Top Contributor
Hello, Marcel. I think you're starting with the wrong assumption about Googlebot. On this page: https://support.google.com/adwords/answer/6049664?hl=en&rd=1 it says that "Dynamic Search Ads automatically show your ad based on the content of your website."

It doesn't say which bot Google uses when they index your website. Yes, for the majority of advertisers that have not advertised a certain set of pages yet, it uses the organic index (Googlebot). But it does not say that Adsbot cannot be used.

And Google does crawl with Adsbot whenever someone decides to advertise a website, because they need data in order to evaluate landing pages for the quality scores on one hand and for website policy compliance on the other hand. So there's probably no coincidence or trick at all.

I may be wrong, but I think this is why certain pages got you traffic in spite of the fact that they were still left in the pre-release "noindex" stage.
Calin Sandici, AdWords Top Contributor | Find me on: Google+ | Twitter | LinkedIn | myBlog
Was my response helpful? If yes, please mark it as the ‘Best Answer.’ Learn how here.

Re: Dynamic Search Ads: Googlebot vs. Adsbot

[ Edited ]
Explorer ✭ ✭ ☆
# 3
Explorer ✭ ✭ ☆

Hi Marcel,

as Calin mentioned, Googlebot and AdWordsbot are not the same spiders. Although some parts could be the same, they work differently, their purpose is different and the outcome is different. Therefore "noindex" and "nofollow" have no influence on adwordsbot. Read more:

Googlebot: https://support.google.com/webmasters/answer/182072?hl=en
AdWordsbot: https://support.google.com/adwords/answer/2404197?hl=en

And for sure this old article: 

http://adwords.blogspot.com/2007/04/new-case-study-on-botnet-based-click.html

 

and this old study are very interesting:

https://www.usenix.org/legacy/events/hotbots07/tech/full_papers/daswani/daswani.pdf