Block search engines indexing a few pages
I use SEOMoz. This is alerting me to some 'no meta data found' errors on a few pages. Its actually just one page, but it displays different data depending on whats coming out of the db:
eg: mydomain.com/mypage/var-value-1, mydomain.com/mypage/var-value-2, mydomain.com/mypage/var-value-3 etc...
Can I use robots.txt to block all search engines from listing all pages after mydomain.com/mypage/ ? ie some kind of wildcard command?
I hope that makes sense. Please dont suggest I use a canonical tag. Its a long story, but because of the code thats on the page this is not an option.