I have excluded a directory in my robots.txt and site map. But I would like Google to index those pages but if the pages have any secure documents linked on them such as PDF/Word files on my server I do not want that directory access. As an interim solution I am not indexing a large part of my member-only site. How can I secure the folder yet have the member pages indexed? I have read the solution of putting my /folder/ outside the Web accessible folder but i do not know how to configure this. My member pages have an authentication script with checked for cookies and passes variables. Will the Google spider get to these pages regardless? I have an IIS server.