understanding log records

[dotJoon]

11/15 19:57:29 error Requested resource '/robots.txt' (%2frobots.txt) not found

The above from logs/coldfusion-event.

Can you interprest the above in plain English?


I can understand only 11/15 19:57:29 part from the above.

[r937]

see http://www.robotstxt.org/wc/exclusion.html

it is just a simple robot, asking your site for the robots.txt file

since there is no robots.txt file on your site, it assumes that everything it can find is okay to access

use robots.txt to keep (well-behaved) robots out of certain parts of your site