SitePoint Sponsor

User Tag List

Results 1 to 7 of 7
  1. #1
    SitePoint Addict mixmastermidori's Avatar
    Join Date
    Sep 2001
    Posts
    337
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Google spidering

    Does anyone know how often Google spiders? I put up a redesign of a site a month ago, but I see that old URLs are still coming up in Google. (I made a conscious choice to rename files and not replace old URLs with redirects.)

    Thanks,
    Midori
    Nature's Sunshine herbs and supplements

  2. #2
    SitePoint Addict mixmastermidori's Avatar
    Join Date
    Sep 2001
    Posts
    337
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Never mind. I just found on their site that it takes 1-4 weeks for them to spider. Hopefully, everything will be updated soon.

    Does anyone have any suggestions for speeding this process up? Do I have to add anything to my code?

    Thanks,
    Midori
    Nature's Sunshine herbs and supplements

  3. #3
    Level 8 Chinese guy Archbob's Avatar
    Join Date
    Sep 2001
    Location
    Somewhere in this vast universe
    Posts
    3,741
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    They usually update listings at the end of every month.

  4. #4
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Google has an 4 week cycle.

    They update their index, then they spider and 3-4 weeks later update their index again off the now 3 week old data. they need to take such a large break between the spider and the update because it takes awhile to analyze the interconnectedness of billions of web pages.

    This means that it can take up to 7 or 8 weeks for your site to show up in Google. If you submit right after they spider it should be around 7 weeks before they manage to spider you and then update.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  5. #5
    Level 8 Chinese guy Archbob's Avatar
    Join Date
    Sep 2001
    Location
    Somewhere in this vast universe
    Posts
    3,741
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    The surest way to get into google is to get listed in dmoz, that can be challenge sometimes.

  6. #6
    You wanna' peice o' me! Automated's Avatar
    Join Date
    Nov 2001
    Location
    UK
    Posts
    338
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Not for me i got listed in two days
    FreelanceForums.com - Do you Freelance ?
    Visit the Freelance Forums and participate in all areas of Freelance Chat

  7. #7
    SitePoint Addict mixmastermidori's Avatar
    Join Date
    Sep 2001
    Posts
    337
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks for the info, Aspen! I'll wait until the end of next month before I start freaking out. :P

    -Midori
    Nature's Sunshine herbs and supplements


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •