SitePoint Sponsor

User Tag List

Results 1 to 17 of 17
  1. #1
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Best way to stop a web page being indexed by Google & co?

    Hi all,

    I have created a page on my development website's root directory called 'projects.php'. The page contains a list of various projects I've done for clients, but some of those clients have requested the page does not get indexed in google due to the likelihood their competitors will still their designs and ideas.

    With that in mind, what is the best way to publish this page on my website (e.g. with a link) and ensure under no circumstances Google indexes it?

    I have of course already Googled the subject, but I wanted to run it by the experts (you guys before I publish a the link to the page on my site.

    Thanks!

  2. #2
    Life is not a malfunction gold trophysilver trophybronze trophy
    TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    5,325
    Mentioned
    214 Post(s)
    Tagged
    5 Thread(s)
    You can exclude the page in your robots.txt file, or using the robots meta tag on the page. You could also add the nofollow attribute to any links pointing to that page, as a "belt and braces" approach. Of course, this will work for Google and other search engines that obey the robots protocol, but less ethical bots will crawl it anyway.
    Don't be arrogant. Be kind to a koala that thinks it's a bear.

  3. #3
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks for your help Technobear - I will follow those approaches After all, I couldn't 'Bear' it if that page was indexed

  4. #4
    It's all Geek to me silver trophybronze trophy
    ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, AU
    Posts
    23,596
    Mentioned
    411 Post(s)
    Tagged
    6 Thread(s)
    Quote Originally Posted by johnuk View Post
    some of those clients have requested the page does not get indexed in google due to the likelihood their competitors will still their designs and ideas.
    If you are posting those designs and ideas online, then asking the search engines not to index the content is not going to prevent people from viewing the content and potentially stealing it. The real question is whether or not it should be online at all.

  5. #5
    Life is not a malfunction gold trophysilver trophybronze trophy
    TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    5,325
    Mentioned
    214 Post(s)
    Tagged
    5 Thread(s)
    Quote Originally Posted by johnuk View Post
    After all, I couldn't 'Bear' it if that page was indexed
    Aargh - are you related to ralph.m? He's usually the one with the dreadful puns.
    Don't be arrogant. Be kind to a koala that thinks it's a bear.

  6. #6
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by ralph.m View Post
    If you are posting those designs and ideas online, then asking the search engines not to index the content is not going to prevent people from viewing the content and potentially stealing it. The real question is whether or not it should be online at all.
    Not so much that I'm posting designs and ideas, its just a screenshot and description of each project Ive done recently. Ive added the meta tags, and also I've password protected the page with a php conditional statement.

    I actually only want the page to be seen by prospective new clients, not the public if that makes any sense

  7. #7
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Sadly not - but I couldn't resist that cute Bear icon

  8. #8
    It's all Geek to me silver trophybronze trophy
    ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, AU
    Posts
    23,596
    Mentioned
    411 Post(s)
    Tagged
    6 Thread(s)
    Quote Originally Posted by johnuk View Post
    I actually only want the page to be seen by prospective new clients, not the public if that makes any sense
    In that case, just make sure there are no links to that page, and Google won't know about it. (Just send a link to clients.)

    Anyhow, if it's password protected, Google won't see it anyway.

  9. #9
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by ralph.m View Post
    In that case, just make sure there are no links to that page, and Google won't know about it. (Just send a link to clients.)

    Anyhow, if it's password protected, Google won't see it anyway.
    Im double safe! You might say Ive got more than the "Bear Necessity's" BOOM BOOM.

  10. #10
    It's all Geek to me silver trophybronze trophy
    ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, AU
    Posts
    23,596
    Mentioned
    411 Post(s)
    Tagged
    6 Thread(s)
    Off Topic:

    Quote Originally Posted by johnuk View Post
    You might say Ive got more than the "Bear Necessity's" BOOM BOOM.
    To prevent this kind of humor in the forums, the FAQ needs to include a special claws.

  11. #11
    Life is not a malfunction gold trophysilver trophybronze trophy
    TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    5,325
    Mentioned
    214 Post(s)
    Tagged
    5 Thread(s)
    Off Topic:

    Quote Originally Posted by ralph.m View Post

    To prevent this kind of humor in the forums, the FAQ needs to include a special claws.
    Better cut that out, Ralph, before the admin gets furious.
    Don't be arrogant. Be kind to a koala that thinks it's a bear.

  12. #12
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Oh dear lord, the jokes are getting REALLY bad now!

  13. #13
    It's all Geek to me silver trophybronze trophy
    ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, AU
    Posts
    23,596
    Mentioned
    411 Post(s)
    Tagged
    6 Thread(s)
    Off Topic:

    Quote Originally Posted by TechnoBear View Post
    Better cut that out, Ralph, before the admin gets furious.
    Bee careful, honey.

  14. #14
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    That joke is a little Bear...

  15. #15
    Life is not a malfunction gold trophysilver trophybronze trophy
    TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    5,325
    Mentioned
    214 Post(s)
    Tagged
    5 Thread(s)
    Just bear with us while we paws to think.
    Don't be arrogant. Be kind to a koala that thinks it's a bear.

  16. #16
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    458
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Your the coolest bear I ever met.

  17. #17
    Life is not a malfunction gold trophysilver trophybronze trophy
    TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    5,325
    Mentioned
    214 Post(s)
    Tagged
    5 Thread(s)
    Don't be arrogant. Be kind to a koala that thinks it's a bear.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •