AdWords
2.1K members online now
2.1K members online now
Dive into advanced features like Remarketing, Flexible Bid Strategies, AdWords Editor, and AdWords Scripts
Guide Me
star_border
Reply

guys can anyone explain what is googlebot...!! and how it works...!!

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭
Marked as Best Answer.
Solution
Accepted by topic author bhaskar c
September 2015

Re: guys can anyone explain what is googlebot...!! and how it works...

Visitor ✭ ✭ ✭
# 2
Visitor ✭ ✭ ✭
Googlebot is Google's web crawling bot (sometimes also called a "spider"). Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.
How Googlebot accesses your site

For most sites, Googlebot shouldn't access your site more than once every few seconds on average. However, due to network delays, it's possible that the rate will appear to be slightly higher over short periods. In general, Googlebot should download only one copy of each page at a time. If you see that Googlebot is downloading a page multiple times, it's probably because the crawler was stopped and restarted.

Re: guys can anyone explain what is googlebot...!! and how it works...

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭
Tanks a lot Bro Nithish ... but i jus want to know the functionality of googlebot...!!!
Marked as Best Answer.
Solution
Accepted by topic author bhaskar c
September 2015

Re: guys can anyone explain what is googlebot...!! and how it works...

Visitor ✭ ✭ ✭
# 4
Visitor ✭ ✭ ✭
Googlebot functions as a search bot to crawl content on a site and interpret the contents of a user's created robots.txt file (e.g., www.myhost.com/robots.txt). The searchable bots (robots) work by reading Web pages; then, they make the content of the pages available to all Google services (done by Google's caching proxy).

Note: Googlebot's requests to Web servers are done by a user-agent string containing "Googlebot," and requests to a host address contain "googlebot.com."

Benefits: It is used to find Web pages on the Internet. Search robots will access any file in the root directory and all its subdirectories. Of course, users can set it up to allow or disallow the robots.txt file to Control Search Engine Spiders--a program that travels the Web--to be able to retrieve every page from a Web site.

Re: guys can anyone explain what is googlebot...!! and how it works...

Visitor ✭ ✭ ✭
# 5
Visitor ✭ ✭ ✭
Happy to help! Smiley Happy