A problem with duplicate content

[lee_vhoi_ol]

Here's a situation.

Site A is a more general site, Site B is more specific but it in the same niche. I own both sites.

Site A and Site B both contain technical information, however, site A is very detailed, while Site B is less so.

I am worrying about duplicate content, as although Site B has a shorter version of the information, the SEs might still see it as duplicate content.

I can think of two options:
1. Put a robots.txt on my site to block the information pages on Site B, (question: do I have to use rel="nofollow" for backlinks from external sites to the technical information pages?)

2. Completely change the information in Site B, which might be troublesome as there would be a lot of information to change. (question: to what extent should I rewrite the information so that it won't be seen as duplicate content?)

Which would you suggest? What are other (better) options?

[rcj662]

The robot txt should stop google from listing it. I would make new content but you can use the robot txt

[lee_vhoi_ol]

Yes, I think making new content is the best thing too. But in my case, it's hard to do, with lots of material to rewrite, and these are technical reference material to speak of.

But if ever I decide to rewrite the content on Site B, what are the tips you could give? To what extent should I make the changes that it won't be seen as duplicate content??

[shakir]

me suggest to change the content. subject is same not good. Better read site A and B then take the full idea from both then just type the content by yourself . So it will be different . Copy paste will be duplicate . But in the case of typing the content will be different.

[DaveWoods]

What is the purpose of having two sites? You say that one is more generic while the other is specialized but why not combine the two?

At the moment you're spending time and effort maintaining two sites whilst inbound links and any marketing effort will be split between the two sites.

If all the content is related then I'd personally look at combining the two sites into one resource where people can come for the basic information and the specialist content unless there's really a good reason for having two separate sites?

[Poiesis01]

A robot.txt file isn't going to block search engines from indexing SiteB if someone links to pages on SiteB. It would be better to add a robots metatag in the header of each page you want to block.

[WEBLAUNCHPHXX]

It would be better to change your content on site B for better SERPs.

Best of luck!

[JJMcClure]

What is the purpose of having two sites? You say that one is more generic while the other is specialized but why not combine the two?

At the moment you're spending time and effort maintaining two sites whilst inbound links and any marketing effort will be split between the two sites.

If all the content is related then I'd personally look at combining the two sites into one resource where people can come for the basic information and the specialist content unless there's really a good reason for having two separate sites?

This suggestion gets my vote.

[lee_vhoi_ol]

What is the purpose of having two sites? You say that one is more generic while the other is specialized but why not combine the two?

At the moment you're spending time and effort maintaining two sites whilst inbound links and any marketing effort will be split between the two sites.

If all the content is related then I'd personally look at combining the two sites into one resource where people can come for the basic information and the specialist content unless there's really a good reason for having two separate sites?

The situation is that the sites are both generating profit. That's why the more specialized site shouldn't be shut down. Also, the specialized site is a subset of the general site, however, it is not a proper subset. That is, the specialized site also contains some contents not found in the more general site.

[lee_vhoi_ol]

A robot.txt file isn't going to block search engines from indexing SiteB if someone links to pages on SiteB. It would be better to add a robots metatag in the header of each page you want to block.

i just want a second opinion on this. is this true that robots meta tag is better than robots.txt for blocking search engines from indexing the page?

[stymiee]

i just want a second opinion on this. is this true that robots meta tag is better than robots.txt for blocking search engines from indexing the page?

That's not true at all. Robots.txt is equally effective and probably better because the search engine won't even attempt to access the page if it is listed there as opposed to having to pull and parse the page to find that meta tag.

[lee_vhoi_ol]

Thanks stymiee.

[lee_vhoi_ol]

ok, so how much should I change so that it won't pass as duplicate content? Is it enough to change some words, without much restructuring?

[JJMcClure]

ok, so how much should I change so that it won't pass as duplicate content? Is it enough to change some words, without much restructuring?

Dare I suggest that you go for a different keyword density? Target a different keyword phrase and re-write the copy. Use it in all the right places, get links with that keyword phrase in the anchor test.

If it's still regarded as duplicate content by Google (and by you) then perhaps you should merge the two sites because you won't be considered as offering something useful to the user.

Don't try to con Google into thinking it's different content, that way lies the dark side Provide two quality sites.