SitePoint Sponsor

User Tag List

Results 1 to 3 of 3
  1. #1
    SitePoint Addict
    Join Date
    Jan 2002
    Location
    NJ/NY
    Posts
    346
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    sitemap - if I don't include url, will it still be crawled?

    Hey, I just started looking at google sitemaps. I'm wondering how comprehensive the sitemap needs to be. If I submit a sitemap and it doesn't include an url, will that url still be crawled? (I'm considering creating a sitemap only w/ the more obscure urls that are more difficult to crawl.) Thanks.

  2. #2
    SitePoint Evangelist
    Join Date
    Jul 2003
    Location
    uk
    Posts
    503
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Yep, chances are if the url you dont include is accesable from the urls you do include it should still be crawled.

  3. #3
    He's No Good To Me Dead silver trophybronze trophy stymiee's Avatar
    Join Date
    Feb 2003
    Location
    Slave I
    Posts
    23,424
    Mentioned
    2 Post(s)
    Tagged
    1 Thread(s)
    If that page can be found through incoming links it will be crawled. Google SiteMaps only compliments, not replaces current indexing mechanisms.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •