Results 1 to 5 of 5
Sep 4, 2012, 23:02 #1
- Join Date
- Oct 2011
- 0 Post(s)
- 0 Thread(s)
Block search engines indexing a few pages
I use SEOMoz. This is alerting me to some 'no meta data found' errors on a few pages. Its actually just one page, but it displays different data depending on whats coming out of the db:
eg: mydomain.com/mypage/var-value-1, mydomain.com/mypage/var-value-2, mydomain.com/mypage/var-value-3 etc...
Can I use robots.txt to block all search engines from listing all pages after mydomain.com/mypage/ ? ie some kind of wildcard command?
I hope that makes sense. Please dont suggest I use a canonical tag. Its a long story, but because of the code thats on the page this is not an option.