• If you are still using CentOS 7.9, it's time to convert to Alma 8 with the free centos2alma tool by Plesk or Plesk Migrator. Please let us know your experiences or concerns in this thread:
    CentOS2Alma discussion

robots.txt

  1. D

    Issue Robots.txt redirects to home (using WPMUDEV)

    Hello .. new to the forum, I hope I am posting correctly: We use WMPUDEV to improve our sites. One tool (SmartCrawl) manages the robots.txt. However, the file (being setup bij WPMUDEV) is being redirected to the homepage. WPMUDEV says it has to do with certain rules in NGINX. As these...
  2. D

    Issue googlebot being blocked by 301

    I'm having a strange issue where google can see robot.txt exists but cannot always read it. I've tried all of the obvious like encoding, permissions etc etc, but no joy. I look in /var/log/nginx/access.log and I find 66.249.69.26 - - [23/Jul/2018:05:36:36 +0000] "GET /robots.txt HTTP/1.1"...
  3. WhatWouldJesusDo

    Virtual robots.txt in wordpress toolkit...where is it?

    The default setting is the following... User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php First of all, there is NO documentation on this file ANYWHERE. Where is it? How do you change it or disable it? Why does it replace the robots.txt file I already have? Any answers would...
Back
Top