• Introducing WebPros Cloud - a fully managed infrastructure platform purpose-built to simplify the deployment of WebPros products !  WebPros Cloud enables you to easily deliver WebPros solutions — without the complexity of managing the infrastructure.
    Join the pilot program today!
  • Support for BIND DNS has been removed from Plesk for Windows due to security and maintenance risks.
    If a Plesk for Windows server is still using BIND, the upgrade to Plesk Obsidian 18.0.70 will be unavailable until the administrator switches the DNS server to Microsoft DNS.

robots.txt

  1. D

    Issue Robots.txt redirects to home (using WPMUDEV)

    Hello .. new to the forum, I hope I am posting correctly: We use WMPUDEV to improve our sites. One tool (SmartCrawl) manages the robots.txt. However, the file (being setup bij WPMUDEV) is being redirected to the homepage. WPMUDEV says it has to do with certain rules in NGINX. As these...
  2. D

    Issue googlebot being blocked by 301

    I'm having a strange issue where google can see robot.txt exists but cannot always read it. I've tried all of the obvious like encoding, permissions etc etc, but no joy. I look in /var/log/nginx/access.log and I find 66.249.69.26 - - [23/Jul/2018:05:36:36 +0000] "GET /robots.txt HTTP/1.1"...
  3. WhatWouldJesusDo

    Virtual robots.txt in wordpress toolkit...where is it?

    The default setting is the following... User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php First of all, there is NO documentation on this file ANYWHERE. Where is it? How do you change it or disable it? Why does it replace the robots.txt file I already have? Any answers would...
Back
Top