| SitePoint Sponsor |
|
|
User Tag List
Results 1 to 2 of 2
Thread: robots.txt
-
Feb 22, 2000, 14:25 #1mouse monkey
- Join Date
- Dec 1999
- Location
- UK
- Posts
- 656
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
What exactly is a robots.txt and what to I put in it.
Fletch
-
Feb 22, 2000, 14:37 #2********* Scotland
- Join Date
- Jan 2000
- Location
- Scotland
- Posts
- 660
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
Read
http://www.webmaster-resources.com/f...ML/000029.html
then follow this link, which is also on the post above:
http://info.webcrawler.com/mak/proje.../norobots.html
Bookmarks