Robots often visit Web sites, and they can be beneficial to you or possibly harmful. Understanding how robots work and how they interact with your site can help you rank higher in search engines and get more pageviews.
webdesign.about.com/od/promotion/a/aa020705.htm
-
Get Site Info
The easiest way to create a robots.txt file is to use the Generate robots.txt tool in Webmaster Tools. Once you've created the file, you can use the Analyze robots.txt tool to make sure that it's beha
www.google.com/support/webmasters/bin/answer.py?answer=4<br/>0362
-
Get Site Info