SitePoint Sponsor

User Tag List

Results 1 to 2 of 2

Thread: robots.txt

  1. Feb 22, 2000 14:25 #1
    Fletch
    Fletch is offline
    mouse monkey
    Join Date
    Dec 1999
    Location
    UK
    Posts
    656
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    What exactly is a robots.txt and what to I put in it.


    Fletch
  2. Feb 22, 2000 14:37 #2
    Saltire
    Saltire is offline
    ********* Scotland Saltire's Avatar
    Join Date
    Jan 2000
    Location
    Scotland
    Posts
    660
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Read
    http://www.webmaster-resources.com/f...ML/000029.html

    then follow this link, which is also on the post above:
    http://info.webcrawler.com/mak/proje.../norobots.html
« Previous Thread | Next Thread »

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules