Computer Co-op, CornerNET Internet Gateway, and PJR Solutions is owned by PJR Sales & Service. Quality products and online services since 1991. We can be your
Complete Computer Connection

What is the purpose of the robots file?

This file tells search engines what they should and should not index (make available as links).

You can simply create a blank file and name it robots.txt. (This will reduce site errors and allow all search engines to rank you if they want.)

If you want to stop search engines from ranking you, use this code:

#Code to not allow any search engines!
User-agent: *
Disallow: /

See more codes here:
http://www.robotstxt.org/robotstxt.html

Add to Favourites
Print this Article