SitePoint Sponsor

User Tag List

Results 1 to 10 of 10
  1. #1
    SitePoint Member
    Join Date
    Nov 2004
    Location
    la
    Posts
    7
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Search results, how do I help Google crawl

    Hi,

    I have a site with thousands of products. All product pages are HTML and optimized. I have about 20 categories. When you click on each category, you get search results of products in this category that link to the product page. Each search results page display only 10 producst and there is a link "next" to display the next 10.

    The question is, will google actually follow all these "next" links and then the 10 products on each page? or will it crawl only the first page and the 10 products on that page and won't go further?

    What would be a good way to help Google crawl all the product pages?

    Thanks for your help

    Merafu

  2. #2
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,449
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    If your URLs are search engine firendly there is no reason for Google to not be able to follow those links to the next ten, etc.. However, Google may not index all of those pages if your PR is too low (let's say 4 and under might be too low). If you want to "guarantee" Google will find and follow those links, make sure you don't have long query strings in your urls, no session id's in your urls, and have a decent PR for your pages.

  3. #3
    SitePoint Member
    Join Date
    Nov 2004
    Location
    la
    Posts
    7
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks for replying stymiee

    My URLs are nice and clean and short with no variables. Which PR should be at least 4? all the product pages or the home page? Or the page with the list of categories?

  4. #4
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,449
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    Preferably all of them. Just keep getting those incomming links to your homepage. The PR will then filter thorughout your site to subpages and you should be ok. If you properly link to the pages you want indexed you can transfer a good chunk of PR to them which certainly couldn't hurt.

  5. #5
    Ranking in the $$$ tbase's Avatar
    Join Date
    Jun 2004
    Location
    OVER THERE ->
    Posts
    542
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by stymiee
    Just keep getting those incomming links to your homepage. .
    I would also have "some" incoming links to deeper pages also

    Thanks
    Tbase
    I want to BUY Google API Keys (Soap).
    PM me if you got one to sell.

  6. #6
    Tenacious T Tyhe's Avatar
    Join Date
    May 2001
    Location
    Hilversum
    Posts
    651
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by stymiee
    If your URLs are search engine firendly there is no reason for Google to not be able to follow those links to the next ten, etc.. However, Google may not index all of those pages if your PR is too low (let's say 4 and under might be too low). If you want to "guarantee" Google will find and follow those links, make sure you don't have long query strings in your urls, no session id's in your urls, and have a decent PR for your pages.
    Is there a defenition of a "Search Engine Friendly URL"?


    Thx.
    That's all folks...

  7. #7
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,449
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    The url has a short query string that does not contain a sessionID or something that looks like a sessionID (&id=12341234). SessionIDs won't be indexed by the search eniges and pages that contain query strings with &id=12341234 will have only a limited number of pages crawled as the search engines want to be sure they don't get stuck in a loop or are being fed "filler" pages.

  8. #8
    Tenacious T Tyhe's Avatar
    Join Date
    May 2001
    Location
    Hilversum
    Posts
    651
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Alright, so php is not a problem?
    That's all folks...

  9. #9
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,449
    Mentioned
    1 Post(s)
    Tagged
    1 Thread(s)
    Not at all. Any language is cool if your urls are done properly.

  10. #10
    Ranking in the $$$ tbase's Avatar
    Join Date
    Jun 2004
    Location
    OVER THERE ->
    Posts
    542
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Good informative post stymiee... Reputation added


    Thanks
    Tbase
    I want to BUY Google API Keys (Soap).
    PM me if you got one to sell.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •