Is there a script (I mean no .htaccess) that'd block all search engine bots (including those which don't use robots.txt) to disallow access ?
| SitePoint Sponsor |





Is there a script (I mean no .htaccess) that'd block all search engine bots (including those which don't use robots.txt) to disallow access ?
Not that I'm aware of. PHP isn't usually run as a daemon or server of any sort, and thus has no control over who connects to what. If the files you don't want accessed are strictly PHP, or you can sucessfully hide them behind a PHP file, you could do some checking on $_SERVER['HTTP_USER_AGENT'], but this can easily be fooled...Originally Posted by DarkAngelBGE
.htaccess effectively does the same thing, but without the hassle of hiding the files behind PHP. Is there something with .htacess that you can't achieve?
My name is Steve, and I'm a super-villian.





Well I never really touched .htaccess and thus have no clue on how to access that file. It's even not on my server. Maybe this is the right time to get myself familiar with .htacess ?![]()





you should the .htaccess once mastered will be one of your best friends for apacheOriginally Posted by DarkAngelBGE
![]()
i love php
.htaccess is a fantastic tool, and it's really not that hard to use.. really!
Here is a link to an advanced .htaccess tutorial. I know you've never touched .htaccess before but you're pretty "advanced" in lots of things so you should be able to pick it up easilyI also just found this, and contrary to the image you get from the URL, it's a very good page regarding spiders, what they do, where they come from, and how to stop them if you wish. A sure read and bookmark for me
![]()





great links
We are the Borg. Resistance is futile. Prepare to be assimilated.
I'm Pentium of Borg.Division is futile.Prepare to be approximated.
Bookmarks