I have no idea, how it is possible to enter the manual (Plesk on Unbuntu 16.04).
How can I do this?
The googlebot does it every day successfully:
2019-04-11 16:49:12 Access 66.249.66.197 200 GET /manual/de/mod/mod_lbmethod_bytraffic.html HTTP/1.0 2.87 K Apache Access
I found this only in the logs of one of two Domains.
Both have the same robots.txt:
User-agent: *
Disallow: /cgi-bin/
Disallow: /class/
How can I stop the access to the manual?
Thanks OTTO
How can I do this?
The googlebot does it every day successfully:
2019-04-11 16:49:12 Access 66.249.66.197 200 GET /manual/de/mod/mod_lbmethod_bytraffic.html HTTP/1.0 2.87 K Apache Access
I found this only in the logs of one of two Domains.
Both have the same robots.txt:
User-agent: *
Disallow: /cgi-bin/
Disallow: /class/
How can I stop the access to the manual?
Thanks OTTO