SitePoint Sponsor

User Tag List

Results 1 to 2 of 2

Thread: Meta Tags

  1. #1
    SitePoint Enthusiast
    Join Date
    Nov 2006
    Posts
    28
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Meta Tags

    Alright I guess I'm a bit confused. I was looking around at samples of meta tags to get an idea on what people do. While looking over the homepage coding here at sitepoint I saw

    <meta name="robots" content="all" />

    So I kind of looked it up and I understand it stops a bot from indexing a page and following links on a page, but what I don't get is does a bot not index a page or follow links without this tag? Just a bit confused why people use this tag.

    Thanks for the help
    Josh

  2. #2
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,423
    Mentioned
    2 Post(s)
    Tagged
    1 Thread(s)
    This tag is useless as it is posted here. This tag should only be used to exclude robots from crawling a page and/or following links on a page. Some webmasters try to use it to tell search engines to crawl a page which is redundant as search engines will crawl every page and follow every link by default. So, to summarize, unless you want to prevent a search engine from indexing a page or following links on a page this tag has no value.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •