SitePoint Sponsor

User Tag List

Results 1 to 7 of 7
  1. #1
    SitePoint Evangelist Mr. Tech's Avatar
    Join Date
    Feb 2003
    Location
    Australia
    Posts
    562
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    PHP and spiders!

    Hey!

    Lets say I have a password protected area using PHP to protect it...

    Can a SE robot spider through those pages or is it not allowed to because its not logged in?

    Thanks

  2. #2
    Put your best practices away. The New Guy's Avatar
    Join Date
    Sep 2002
    Location
    Canada
    Posts
    2,087
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    I guess this depends on the php script. If it is a simple login then redirect to another script (or a different part of the same script) the spider will not follow because it is not direct link.

    Spiders only follow html links (<a href="blah.php"), they do not spider everything in every directory.
    "A nerd who gets contacts
    and a trendy hair cut is still a nerd"

    - Stephen Colbert on Apple Users

  3. #3
    SitePoint Zealot OtherBaggs's Avatar
    Join Date
    Apr 2003
    Location
    Surrey, UK
    Posts
    100
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    What if the login sets a cookie. There are href links on the login page. Each page (from those links) checks for a cookie and say returns to the login page if there is no cookie.

    The search engine should follow the link from the login page - would it end up back there, or would it see the protected page?

  4. #4
    Put your best practices away. The New Guy's Avatar
    Join Date
    Sep 2002
    Location
    Canada
    Posts
    2,087
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    Whatever happens to a user who is not logged in and clicks the link will happen to the spider.
    "A nerd who gets contacts
    and a trendy hair cut is still a nerd"

    - Stephen Colbert on Apple Users

  5. #5
    SitePoint Zealot OtherBaggs's Avatar
    Join Date
    Apr 2003
    Location
    Surrey, UK
    Posts
    100
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thats reassuring, thanks.

  6. #6
    SitePoint Evangelist Mr. Tech's Avatar
    Join Date
    Feb 2003
    Location
    Australia
    Posts
    562
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Yea, thanks

    I also found out that you can use robots.txt to stop SE's on certain pages...

  7. #7
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    If your "secure" area can be gotten to by search engines it can also be very easily gotten to by hackers.

    Time to redesign the application.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •