• Plesk Uservoice will be deprecated by October. Moving forward, all product feature requests and improvement suggestions will be managed through our new platform Plesk Productboard.
    To continue sharing your ideas and feedback, please visit features.plesk.com

robots.txt

  1. D

    Issue Robots.txt redirects to home (using WPMUDEV)

    Hello .. new to the forum, I hope I am posting correctly: We use WMPUDEV to improve our sites. One tool (SmartCrawl) manages the robots.txt. However, the file (being setup bij WPMUDEV) is being redirected to the homepage. WPMUDEV says it has to do with certain rules in NGINX. As these...
  2. D

    Issue googlebot being blocked by 301

    I'm having a strange issue where google can see robot.txt exists but cannot always read it. I've tried all of the obvious like encoding, permissions etc etc, but no joy. I look in /var/log/nginx/access.log and I find 66.249.69.26 - - [23/Jul/2018:05:36:36 +0000] "GET /robots.txt HTTP/1.1"...
  3. WhatWouldJesusDo

    Virtual robots.txt in wordpress toolkit...where is it?

    The default setting is the following... User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php First of all, there is NO documentation on this file ANYWHERE. Where is it? How do you change it or disable it? Why does it replace the robots.txt file I already have? Any answers would...
Back
Top