SitePoint Sponsor |
|
User Tag List
Results 1 to 6 of 6
Thread: block from bots/spiders
-
Sep 18, 2003, 08:38 #1
- Join Date
- May 2003
- Location
- Berlin, Germany
- Posts
- 1,829
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
block from bots/spiders
Is there a script (I mean no .htaccess) that'd block all search engine bots (including those which don't use robots.txt) to disallow access ?
-
Sep 18, 2003, 10:06 #2
- Join Date
- Jun 2003
- Location
- Waterloo, ON
- Posts
- 1,517
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
Originally Posted by DarkAngelBGE
.htaccess effectively does the same thing, but without the hassle of hiding the files behind PHP. Is there something with .htacess that you can't achieve?My name is Steve, and I'm a super-villian.
-
Sep 19, 2003, 01:59 #3
- Join Date
- May 2003
- Location
- Berlin, Germany
- Posts
- 1,829
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
Well I never really touched .htaccess and thus have no clue on how to access that file. It's even not on my server. Maybe this is the right time to get myself familiar with .htacess ?
-
Oct 1, 2003, 22:10 #4
- Join Date
- Nov 2001
- Location
- Dallas, Texas
- Posts
- 1,342
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
Originally Posted by DarkAngelBGE
i love php
-
Oct 1, 2003, 22:27 #5
- Join Date
- Aug 2002
- Location
- Burpengary, Australia
- Posts
- 4,495
- Mentioned
- 0 Post(s)
- Tagged
- 1 Thread(s)
.htaccess is a fantastic tool, and it's really not that hard to use.. really!
Here is a link to an advanced .htaccess tutorial. I know you've never touched .htaccess before but you're pretty "advanced" in lots of things so you should be able to pick it up easilyI also just found this, and contrary to the image you get from the URL, it's a very good page regarding spiders, what they do, where they come from, and how to stop them if you wish. A sure read and bookmark for me
-
Oct 2, 2003, 01:35 #6
- Join Date
- Jan 2003
- Location
- Munich, Germany
- Posts
- 1,391
- Mentioned
- 0 Post(s)
- Tagged
- 0 Thread(s)
great links
We are the Borg. Resistance is futile. Prepare to be assimilated.
I'm Pentium of Borg.Division is futile.Prepare to be approximated.
Bookmarks