Google spidering

**mixmastermidori** · Jun 19, 2002, 15:26

Does anyone know how often Google spiders? I put up a redesign of a site a month ago, but I see that old URLs are still coming up in Google. (I made a conscious choice to rename files and not replace old URLs with redirects.)

Thanks,
Midori

**mixmastermidori** · Jun 19, 2002, 15:32

Never mind. I just found on their site that it takes 1-4 weeks for them to spider. Hopefully, everything will be updated soon.

Does anyone have any suggestions for speeding this process up? Do I have to add anything to my code?

Thanks,
Midori

**Archbob** · Jun 19, 2002, 22:16

They usually update listings at the end of every month.

**aspen** · Jun 20, 2002, 09:13

Google has an 4 week cycle.

They update their index, then they spider and 3-4 weeks later update their index again off the now 3 week old data. they need to take such a large break between the spider and the update because it takes awhile to analyze the interconnectedness of billions of web pages.

This means that it can take up to 7 or 8 weeks for your site to show up in Google. If you submit right after they spider it should be around 7 weeks before they manage to spider you and then update.