AdWords
1.9K members online now
1.9K members online now
Use AdWords conversion tracking and reporting to measure your results. Have a question about Google Analytics? Post it here, on the Google Analytics Community!
Guide Me
star_border
Reply

noindex Landing pages

Follower ✭ ✭ ☆
# 1
Follower ✭ ✭ ☆

Hi, I'm new to Adwords,

 

I created separate landing pages for each Ad group. These landing pages are hosted in the same domain name where my main website is hosted. Website is www.mydomain.edu & landing pages are hosted in www.mydomain.edu/events/

 

Landing pages (www.mydomain.edu/events/) are not for search engine indexing or organic search traffic. It's only for Ad campaigns. This is a wordpress site & I chose to disallow search engines (noindex). Is this enough to stop search engines crawling my landing pages? Do I have to modify robot txt file too? Meantime I should not disallow Google Adsbot (crawler that visits landing pages for quality check). Will noindex method is enough, do I have to edit robot text? If yes, How to modify it?

 

1 Expert replyverified_user
2 ACCEPTED SOLUTIONS

Accepted Solutions
Marked as Best Answer.
Solution
Accepted by topic author Sandaruwan S
September 2015

Re: noindex Landing pages

Top Contributor
# 3
Top Contributor
Hi Sandaruwan,

The meta tag alone will not stop bots from crawling the page, but it should tell most bots not to index the page. Not all bots will honor the meta tag.

The AdsBot must be allowed to crawl the page or your ad will be disapproved. You can block other bots from crawling with robots.txt, but be sure to allow the Adsbot.

Best of Luck!

Pete
petebardo -- Deadhead doing AdWords

View solution in original post

Marked as Best Answer.
Solution
Accepted by topic author Sandaruwan S
September 2015

Re: noindex Landing pages

Explorer ✭ ✭ ✭
# 5
Explorer ✭ ✭ ✭
Hi Sandaruwan,

Articles listed below will help you understand how to allow or disallow one or all bots:
https://support.google.com/webmasters/answer/1061943?hl=en
https://developers.google.com/webmasters/control-crawl-index/docs/getting_started?csw=1

Regards,
Ashish

View solution in original post

Re: noindex Landing pages

Explorer ✭ ✭ ✭
# 2
Explorer ✭ ✭ ✭
Hi Sandaruwan,

I think, this should be enough
<meta id="Metarobots" name="Robots" content="NOINDEX, NOFOLLOW" />

Regards,
Ashish
Marked as Best Answer.
Solution
Accepted by topic author Sandaruwan S
September 2015

Re: noindex Landing pages

Top Contributor
# 3
Top Contributor
Hi Sandaruwan,

The meta tag alone will not stop bots from crawling the page, but it should tell most bots not to index the page. Not all bots will honor the meta tag.

The AdsBot must be allowed to crawl the page or your ad will be disapproved. You can block other bots from crawling with robots.txt, but be sure to allow the Adsbot.

Best of Luck!

Pete
petebardo -- Deadhead doing AdWords

Re: noindex Landing pages

Follower ✭ ✭ ☆
# 4
Follower ✭ ✭ ☆
Hello petebardo, Thanks for reply.

Can you help me to modify the robots.txt correctly
There are no other articles to get help for this. How to allow only adbot & disallow all other bots?
Marked as Best Answer.
Solution
Accepted by topic author Sandaruwan S
September 2015

Re: noindex Landing pages

Explorer ✭ ✭ ✭
# 5
Explorer ✭ ✭ ✭
Hi Sandaruwan,

Articles listed below will help you understand how to allow or disallow one or all bots:
https://support.google.com/webmasters/answer/1061943?hl=en
https://developers.google.com/webmasters/control-crawl-index/docs/getting_started?csw=1

Regards,
Ashish