SitePoint Sponsor

User Tag List

Results 1 to 2 of 2
  1. #1
    SitePoint Addict Corobori's Avatar
    Join Date
    Jun 2003
    Location
    Concepcion, Chile
    Posts
    388
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Crawler and adult sites

    I am currently working on a website for a beer company. On this website my client will be selling his products but due to the local regulation we have to ask the user if he is above 18 years of age prior of giving him access to that section of the website. This is done from the main page.

    I am wondering how to have the product's pages indexed by Google but if by any chance this page appears in the search results to make sure the visitor is above 18. I was thinking about hiding the contents of thoses pages but if I do that Google crawler might not be able to grab the text describing the products.

    Do you see what I mean ?
    Jean-Luc
    Corobori WebDesign
    Working in the Concepcion area, Chile, since 1999
    Follow us on Twitter

  2. #2
    Mouse catcher silver trophy
    Stevie D's Avatar
    Join Date
    Mar 2006
    Location
    Yorkshire, UK
    Posts
    5,825
    Mentioned
    110 Post(s)
    Tagged
    1 Thread(s)
    If the age confirmation is a simple link or Javascript link, Google should be able to follow it and crawl the "adult" part of the site. If it's a checkbox and button, Google probably won't. It probably isn't worth hiding any pages from spiders - let them read as much as they can, and anything that they can't get to, well they can't get to it.

    The more of the website you can have "open" (ie, before the age confirmation), the better your chances of success - both with search engines and with customers. Don't ask users to confirm they are over 18 until you absolutely have to - first, you run the risk of excluding search spiders from those pages, which could reduce your visibility in the search results - second, you need to get people hooked into the site first. If the first thing they see when they arrive is a "proof of age" request, they're more likely to turn away, but if they get into the content and start reading it and then get asked for proof of age, they're more likely to follow it through, because they have already "invested" in the site.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •