SitePoint Sponsor

User Tag List

Results 1 to 3 of 3
  1. #1
    SitePoint Zealot
    Join Date
    Oct 2009
    Posts
    111
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Updating Robots.txt and Sitemap.sml files

    This might seem like a stupid question, but do I need to update my website's Robots.txt and/or Sitemap.sml whenever I add pages to my site? Thanks.

  2. #2
    SitePoint Enthusiast
    Join Date
    Jun 2012
    Posts
    99
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    When you add new pages to your website, you must obviously update your sitemap and updating robots.txt depends on whether you want search engine spiders to crawl those new pages or not.

  3. #3
    SitePoint Zealot
    Join Date
    Oct 2009
    Posts
    111
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by timesheet View Post
    When you add new pages to your website, you must obviously update your sitemap and updating robots.txt depends on whether you want search engine spiders to crawl those new pages or not.
    Thankyou


Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •