WordPress Robots.txt Integration

WordPress Robots.txt Integration extension allows you to update your WordPress robots.txt content with new rules for better SEO and security.

Our Prevent Direct Access Gold, S3 and Protect Pages & Posts plugins make use of WordPress virtual robots.txt and dynamically update its rules to stop Google and other search engines from indexing your protected files and images.

You may also want to optimize your robots.txt file with new rules on top of ours for better SEO and security, i.e. defining your sitemaps and blocking a specific bot from crawling your website search results.

Please refer to our WordPress robos.txt guide for more information.

It's worth noticing that if your WordPress installation is on a subdirectory (subfolder), our virtual robots.txt won't be working as it should be in the root directory of your domain server. That's also when our extension comes in handy. With this extension, you can automatically update your domain's robots.txt with our dynamic rules without having to touch any codes.

Features

• Create a new physical robots.txt for your domain if there isn't one
• Put your own robots.txt rules on top of ours
• Automatically update our robots.txt disallow rules that stop Google and other search engines from indexing your WordPress files on our private folder especially if your website is installed on a subdirectory