What about *.asp pages? I've heard that the spider-based search engines have trouble indexing those. But I've always thought it was a rumor, since I haven't been able to find a definitive (reliable) source to confirm this.
When your Internet Access
Means Serious Business...
Some spiders have a problem indexing dynamically generated pages such as
This is because the page doesn't really exist until asked for and it throws the dumber robots off. Since most sites that want to succeed are becoming Dynamic (DHTML isn't really dynamic), the search engines are adapting and upgrading their spiders. If they didn't they would lose to competitors because they wouldn't have a viable database of sites.