Username:
TITLE
Better use robots meta tag instead of robots.txt to hide Plesk
PRODUCT, VERSION, OPERATING SYSTEM, ARCHITECTURE
Plesk Obsidian 18.0.81 Update #3 Web Admin Edition, Ubuntu 24.04.5 LTS
PROBLEM DESCRIPTION
This is not really a bug, but a technical design flaw. I'm pretty sure that having a robots.txt file with the content
will not prevent Google and other crawlers from indexing the page itself (or the domain name), but only the content of the page.
Which means that the URL of my Plesk installation might be revealed to the public via Google.
That's why I would like to suggest to use the robots meta tag on the page instead.
The file I mean is this:
/opt/psa/admin/htdocs/robots.txt
There are also these files, but I guess they are part of the third-party tools and are not directly reachable anyway:
/opt/psa/phpMyAdmin/robots.txt
/usr/share/grafana/public/robots.txt
STEPS TO REPRODUCE
See robots.txt in root folder and HTML code of login page of Plesk.
ACTUAL RESULT
robots.txt blocks everything, HTML page does not prevent actual indexing.
EXPECTED RESULT
Empty robots.txt file, this added to HTML code of Plesk (at least to the login page):
ANY ADDITIONAL INFORMATION
(DID NOT ANSWER QUESTION)
YOUR EXPECTATIONS FROM PLESK SERVICE TEAM
Confirm bug
TITLE
Better use robots meta tag instead of robots.txt to hide Plesk
PRODUCT, VERSION, OPERATING SYSTEM, ARCHITECTURE
Plesk Obsidian 18.0.81 Update #3 Web Admin Edition, Ubuntu 24.04.5 LTS
PROBLEM DESCRIPTION
This is not really a bug, but a technical design flaw. I'm pretty sure that having a robots.txt file with the content
Code:
User-agent: *
Disallow: /
Which means that the URL of my Plesk installation might be revealed to the public via Google.
That's why I would like to suggest to use the robots meta tag on the page instead.
The file I mean is this:
/opt/psa/admin/htdocs/robots.txt
There are also these files, but I guess they are part of the third-party tools and are not directly reachable anyway:
/opt/psa/phpMyAdmin/robots.txt
/usr/share/grafana/public/robots.txt
STEPS TO REPRODUCE
See robots.txt in root folder and HTML code of login page of Plesk.
ACTUAL RESULT
robots.txt blocks everything, HTML page does not prevent actual indexing.
EXPECTED RESULT
Empty robots.txt file, this added to HTML code of Plesk (at least to the login page):
HTML:
<meta name="robots" content="noindex, nofollow">
ANY ADDITIONAL INFORMATION
(DID NOT ANSWER QUESTION)
YOUR EXPECTATIONS FROM PLESK SERVICE TEAM
Confirm bug