SitePoint Sponsor

User Tag List

Results 1 to 17 of 17

Thread: Best way to stop a web page being indexed by Google & co?

  1. #1
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Best way to stop a web page being indexed by Google & co?

    Hi all,

    I have created a page on my development website's root directory called 'projects.php'. The page contains a list of various projects I've done for clients, but some of those clients have requested the page does not get indexed in google due to the likelihood their competitors will still their designs and ideas.

    With that in mind, what is the best way to publish this page on my website (e.g. with a link) and ensure under no circumstances Google indexes it?

    I have of course already Googled the subject, but I wanted to run it by the experts (you guys before I publish a the link to the page on my site.

    Thanks!

  2. #2
    Life is not a malfunction gold trophysilver trophybronze trophy
    SitePoint Award Recipient TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    3,828
    Mentioned
    134 Post(s)
    Tagged
    5 Thread(s)
    You can exclude the page in your robots.txt file, or using the robots meta tag on the page. You could also add the nofollow attribute to any links pointing to that page, as a "belt and braces" approach. Of course, this will work for Google and other search engines that obey the robots protocol, but less ethical bots will crawl it anyway.
    If you're a bear made of mohair, ponder on the nature of a mo.

  3. #3
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks for your help Technobear - I will follow those approaches After all, I couldn't 'Bear' it if that page was indexed

  4. #4
    It's all Geek to me silver trophybronze trophy
    SitePoint Award Recipient ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, Australia
    Posts
    20,303
    Mentioned
    225 Post(s)
    Tagged
    3 Thread(s)
    Quote Originally Posted by johnuk View Post
    some of those clients have requested the page does not get indexed in google due to the likelihood their competitors will still their designs and ideas.
    If you are posting those designs and ideas online, then asking the search engines not to index the content is not going to prevent people from viewing the content and potentially stealing it. The real question is whether or not it should be online at all.
    Facebook | Google+ | Twitter | Web Design Tips | Free Contact Form

    Try your hand at the new JavaScript Challenge!

    If you don't like getting your feet stuck in a bog, avoid Twitter BootsTrap.

  5. #5
    Life is not a malfunction gold trophysilver trophybronze trophy
    SitePoint Award Recipient TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    3,828
    Mentioned
    134 Post(s)
    Tagged
    5 Thread(s)
    Quote Originally Posted by johnuk View Post
    After all, I couldn't 'Bear' it if that page was indexed
    Aargh - are you related to ralph.m? He's usually the one with the dreadful puns.
    If you're a bear made of mohair, ponder on the nature of a mo.

  6. #6
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by ralph.m View Post
    If you are posting those designs and ideas online, then asking the search engines not to index the content is not going to prevent people from viewing the content and potentially stealing it. The real question is whether or not it should be online at all.
    Not so much that I'm posting designs and ideas, its just a screenshot and description of each project Ive done recently. Ive added the meta tags, and also I've password protected the page with a php conditional statement.

    I actually only want the page to be seen by prospective new clients, not the public if that makes any sense

  7. #7
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Sadly not - but I couldn't resist that cute Bear icon

  8. #8
    It's all Geek to me silver trophybronze trophy
    SitePoint Award Recipient ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, Australia
    Posts
    20,303
    Mentioned
    225 Post(s)
    Tagged
    3 Thread(s)
    Quote Originally Posted by johnuk View Post
    I actually only want the page to be seen by prospective new clients, not the public if that makes any sense
    In that case, just make sure there are no links to that page, and Google won't know about it. (Just send a link to clients.)

    Anyhow, if it's password protected, Google won't see it anyway.
    Facebook | Google+ | Twitter | Web Design Tips | Free Contact Form

    Try your hand at the new JavaScript Challenge!

    If you don't like getting your feet stuck in a bog, avoid Twitter BootsTrap.

  9. #9
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by ralph.m View Post
    In that case, just make sure there are no links to that page, and Google won't know about it. (Just send a link to clients.)

    Anyhow, if it's password protected, Google won't see it anyway.
    Im double safe! You might say Ive got more than the "Bear Necessity's" BOOM BOOM.

  10. #10
    It's all Geek to me silver trophybronze trophy
    SitePoint Award Recipient ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, Australia
    Posts
    20,303
    Mentioned
    225 Post(s)
    Tagged
    3 Thread(s)
    Off Topic:

    Quote Originally Posted by johnuk View Post
    You might say Ive got more than the "Bear Necessity's" BOOM BOOM.
    To prevent this kind of humor in the forums, the FAQ needs to include a special claws.
    Facebook | Google+ | Twitter | Web Design Tips | Free Contact Form

    Try your hand at the new JavaScript Challenge!

    If you don't like getting your feet stuck in a bog, avoid Twitter BootsTrap.

  11. #11
    Life is not a malfunction gold trophysilver trophybronze trophy
    SitePoint Award Recipient TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    3,828
    Mentioned
    134 Post(s)
    Tagged
    5 Thread(s)
    Off Topic:

    Quote Originally Posted by ralph.m View Post

    To prevent this kind of humor in the forums, the FAQ needs to include a special claws.
    Better cut that out, Ralph, before the admin gets furious.
    If you're a bear made of mohair, ponder on the nature of a mo.

  12. #12
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Oh dear lord, the jokes are getting REALLY bad now!

  13. #13
    It's all Geek to me silver trophybronze trophy
    SitePoint Award Recipient ralph.m's Avatar
    Join Date
    Mar 2009
    Location
    Melbourne, Australia
    Posts
    20,303
    Mentioned
    225 Post(s)
    Tagged
    3 Thread(s)
    Off Topic:

    Quote Originally Posted by TechnoBear View Post
    Better cut that out, Ralph, before the admin gets furious.
    Bee careful, honey.
    Facebook | Google+ | Twitter | Web Design Tips | Free Contact Form

    Try your hand at the new JavaScript Challenge!

    If you don't like getting your feet stuck in a bog, avoid Twitter BootsTrap.

  14. #14
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    That joke is a little Bear...

  15. #15
    Life is not a malfunction gold trophysilver trophybronze trophy
    SitePoint Award Recipient TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    3,828
    Mentioned
    134 Post(s)
    Tagged
    5 Thread(s)
    Just bear with us while we paws to think.
    If you're a bear made of mohair, ponder on the nature of a mo.

  16. #16
    38911 Basic Bytes Free johnuk's Avatar
    Join Date
    Jul 2008
    Location
    Somerset, England
    Posts
    454
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Your the coolest bear I ever met.

  17. #17
    Life is not a malfunction gold trophysilver trophybronze trophy
    SitePoint Award Recipient TechnoBear's Avatar
    Join Date
    Jun 2011
    Location
    Argyll, Scotland
    Posts
    3,828
    Mentioned
    134 Post(s)
    Tagged
    5 Thread(s)
    If you're a bear made of mohair, ponder on the nature of a mo.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •