Robots blocking Googlebot

When using Fetch and Render tool in Google search console some scripts and images were found to be blocked by robots.txt file of my website when Googlebot tried to reach them. It is to mention here that my robots.txt file doesn’t contain any code. Its a blank file. I couldn’t find why it’s happening so. Can anyone help me out! It is to be noted here that I am using Yoast SEO, Wordfence security, WP Super Cache and Cloudflare CDN free subscription.

Are those scripts and images hosted on your site, or are you linking to them on another site? If so, could it be the other site’s robot.txt which is blocking them?

I can’t think of any reason why you would want scripts crawled and indexed, so those I wouldn’t worry about at all.

This topic was automatically closed 91 days after the last reply. New replies are no longer allowed.