I have a subdomain, say sub.maindomain.com and all the content is coming from a database and the content pages look like the following URL.
sub.maindomain.com/name/content-name-url-here
My challenge is that /name/ is not a folder on the sub.domain.com site.
Do I simply exclude all the folders in sub.maindomain.com in robots.text?
Thank you