Go Back   SitePoint Forums > Forum Index > Manage Your Site > Search Engine Optimization
Newsletter FAQ Members List Calendar Mark Forums Read

New to SitePoint Forums? Register here for free!

SitePoint Sponsor
 
 
 
Thread Tools Display Modes
Prev Previous Post   Next Post Next
Old Dec 16, 2007, 22:15   #1
thethinktank
SitePoint Member
 
Join Date: Oct 2007
Posts: 6
Should I Modify Robots.txt? What is the risk?

Hi Sitepoint fam!
I've noticed in my google webmaster account that I've got a significant number of 404s from a recent spider. Having moved hosts and made a few other changes last month, I ended up moving pages to a new folder. Google is still trying to spider those old URLs with the old folder...

I've read that I can make a change to the robots.txt file that will tell G and others to always look at the new URLs for that directory.

Question is: I'm apprehensive to play with the robots.txt file. Is there any risk to my current and future SEO standings to modify this file?

Thanks so much!

TheThinkTank
thethinktank is offline   Reply With Quote
 

Bookmarks

« Previous Thread | Next Thread »

Thread Tools
Display Modes

 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Sponsored Links
 
Forum Jump


All times are GMT -7. The time now is 01:12.


Powered by vBulletin® Version 3.7.1
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.
Copyright 1998-2009, SitePoint Pty Ltd. All Rights Reserved