My site has been crawled according to Google Webmaster Tools
But it has not been indexed, no site data is available in Webmaster Tools
<snip/>
the robot txt file is:
User-agent: *
Disallow: /admin/
Disallow: /templates/
Disallow: /temp/
Disallow: /db_backup/
Disallow: periodic.php
I have a 2nd site created at the same time, added to Webmaster Tools at the same time, with the same robot txt file,
That 2nd site has been indexed for 2 weeks now,
Should I just wait ?
Have you tried doing a site:yourdomain search in Google? This will show you which pages - if any - have been indexed.
I’ve found that what shows up when in GWT varies considerably from site to site, and I’ve never yet worked out why.
Also, keep in mind that it can take a while for the site data to show up in Google Webmaster Tools. If you have only recently registered the site with GWT, you might need to wait a week or two.
Mike
Hello TechnoBear 
Thank you for your reply,
yes a site:mydomain search shows many many indexed pages,
Hello Miki,
ok so in time the data will show in GWT,
thank you both for your replies, best wishes
You have to remember that google will index what they deem quality content.
I know that a lot of bad sites get indexed, but they also get dropped fairly quick after some manual reviews.
Try building a few quality backlinks to you site and see if that helps indexing it. You can always try pinging your site to bring the spiders around.
I don’t think that’s true. Virutally all sites get indexed, regardless of quality. The only significant exceptions are sites that violate the law in some way, or are deemed offensive or anti-social - and then often only extreme cases.
It’s true that Google take quality into account when ranking a site. In general, a site that Google deems to be of high quality will outrank a lower-quality site - all other things being equal. But that’s a far cry from saying the low-quality site won’t be indexed at all.
Mike