SitePoint Sponsor

User Tag List

Results 1 to 3 of 3
  1. #1
    SitePoint Enthusiast
    Join Date
    Nov 2000
    Posts
    92
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    On many of my statistics this shows up as a failed request. What is it and does it matter?

    Thanks

  2. #2
    SitePoint Zealot cokeman's Avatar
    Join Date
    Dec 2000
    Location
    So. California
    Posts
    173
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I believe that file is for bots such as those used by search engines. If the file exists, you can specify file paths that should not be spidered and added to the search engine's databases. Since the file doesn't exist, it shows up as an error. It shouldn't matter to you unless you want to specify paths for the search engines to skip.

  3. #3
    SitePoint Wizard
    Join Date
    Apr 2000
    Posts
    1,483
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    That is correct - seeing requests for it is a good sign because it means your site has been discovered by the Search Engines and is being spidered for more keywords.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •