SitePoint Sponsor

User Tag List

Results 1 to 6 of 6
  1. #1
    SitePoint Addict
    Join Date
    Oct 2010
    Posts
    306
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    De-Index 100's of Urls/ Move Them

    Hi all.

    I am wondering the best way to de-index URLS without causing major problems. A year after starting I feel I may have over optimized many URLS and I want to change that e.g.

    /wedding-photographers/East-Sussex/wedding-photographer-East-Sussex-adam-bronkhorst-26518/wedding-photographers-index.html
    Should I just tell robots txt not to crawl the root of the /wedding-photographers/

    Will this slowly remove things from the index? I can't face adding every URL individually in the removal tool in WT..

    Cheers.

  2. #2
    Mouse catcher silver trophy Stevie D's Avatar
    Join Date
    Mar 2006
    Location
    Yorkshire, UK
    Posts
    5,892
    Mentioned
    123 Post(s)
    Tagged
    1 Thread(s)
    That URL does look pretty spammy

    So what are you going to have in place of those URLs? Does each one refer to a unique page? Or are they all multiple routes to the same few pages?

  3. #3
    SitePoint Addict
    Join Date
    Oct 2010
    Posts
    306
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Indeed. It seemed like a good idea at the time :-)

    They are all unique page profiles.

    I can do a bit of fiddling and generate all the pages again but in a folder :

    /wedding-photographers/{Profile Name}

    A pain, but a lot easier than de-indexing around 500 pages like the above.

  4. #4
    SitePoint Addict
    Join Date
    Oct 2010
    Posts
    306
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    These are all static pages. I could also deindex them all and then let google follow the php generated version, which I block at the moment as I liked (again, back then) the idea of static pages other than dynamic.

    Google would have to crawl the url for example view-profile.php?ID=100

  5. #5
    Non-Member
    Join Date
    Nov 2011
    Location
    India
    Posts
    12
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Go to Google Webmaster Tools-->Optimization-->Block URLs and block all those pages you don't want to be indexed .

  6. #6
    SitePoint Addict
    Join Date
    Oct 2010
    Posts
    306
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by inflexi View Post
    Go to Google Webmaster Tools-->Optimization-->Block URLs and block all those pages you don't want to be indexed .

    That will block the URLs. I could probably block the folder, but will this then de-index the pages and how long will that take???

    Thanks


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •