SitePoint Sponsor

User Tag List

Results 1 to 2 of 2
  1. #1
    Get my greedy down dotJoon's Avatar
    Join Date
    Apr 2003
    Location
    daejeon, South Korea
    Posts
    2,223
    Mentioned
    1 Post(s)
    Tagged
    0 Thread(s)

    understanding log records

    Code:
    11/15 19:57:29 error Requested resource '/robots.txt' (%2frobots.txt) not found
    The above from logs/coldfusion-event.

    Can you interprest the above in plain English?


    I can understand only 11/15 19:57:29 part from the above.

  2. #2
    SQL Consultant gold trophysilver trophybronze trophy
    r937's Avatar
    Join Date
    Jul 2002
    Location
    Toronto, Canada
    Posts
    39,323
    Mentioned
    63 Post(s)
    Tagged
    3 Thread(s)
    see http://www.robotstxt.org/wc/exclusion.html

    it is just a simple robot, asking your site for the robots.txt file

    since there is no robots.txt file on your site, it assumes that everything it can find is okay to access

    use robots.txt to keep (well-behaved) robots out of certain parts of your site
    rudy.ca | @rudydotca
    Buy my SitePoint book: Simply SQL
    "giving out my real stuffs"


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •