Robots.txt Code check

Marketing
1

I am using this code on my site.I have added this under root.

User-Agent: *
Allow: /

User-Agent: msnbot
Disallow: /ppc/
Allow: /

User-Agent: Slurp
Disallow: /ppc/
Allow: /

User-Agent: Googlebot
Disallow: /ppc/
Allow: /

trying to exclude ppc folder from search engines.is this correct?

2-also i have a subdomain in which i do not want search engines crawling.I have added this 2nd robots.txt under subdomain.maindomain.com

User-Agent: *
Disallow: /

will these 2 robots.txt work?

thank you

2

[FONT=Verdana]To exclude the folder ppc from all bots, all you need is

User-agent: *
Disallow: /ppc/

I read somewhere (and I can’t now remember where) that Googlebot likes to be called by name, and therefore one should add

User-Agent: Googlebot
Disallow: /ppc/

I always keep to that practice and have run into no problems, but it’s probably redundant. :slight_smile:

The robots.txt protocol does not include “Allow”, only “Disallow”. By default, the whole site will be crawled unless folders/files are specifically excluded.

This page may help.[/FONT]

3

thank you for your help