Bots [Guide]

*
*
*
*
*
*
*

Bots - Who and what are they

Post by darren1 on September 13th 2009, 12:06 am
Bots.

What are they?

Bot's, short for "Robots"
A quick definition from Wikipedia, verified by numerous sites across the web.

Wikipedia wrote: Internet bots, also known as web robots, WWW robots or simply bots, are software applications that run automated tasks over the Internet. Typically, bots perform tasks that are both simple and structurally repetitive, at a much higher rate than would be possible for a human alone. The largest use of bots is in web spidering, in which an automated script fetches, analyses and files information from web servers at many times the speed of a human. Each server can have a file called robots.txt, containing rules for the spidering of that server that the bot is supposed to obey.

In addition to their uses outlined above, bots may also be implemented where a response speed faster than that of humans is required (e.g., gaming bots and auction-site robots) or less commonly in situations where the emulation of human activity is required, for example chat bots.


What do these robot's do?

99% of Internet Bots usually just "reference" your site to increase their knowledge of it, and give the most accurate & up-to-date information about your site.
In addition, when the Google Bot visit's your site, it also is giving you a "Cache" version of your site.



That's pretty much all you need to know. ;]