• The APS Catalog has been deprecated and removed from all Plesk Obsidian versions.
    Applications already installed from the APS Catalog will continue working. However, Plesk will no longer provide support for APS applications.
  • Please be aware: with the Plesk Obsidian 18.0.78 release, the support for the ngx_pagespeed.so module will be deprecated and removed from the sw-nginx package.

Question Block selected UserAgents for all vhosts

Azurel

Silver Pleskian
I want block a few bots and crawlers, which not respect robots.txt.
I think the best way is to create a new apache config-file in "/etc/httpd/conf.d/block_useragents.conf" and reload apache?

Content of block_useragents.conf:
<Directory "/var/www/vhosts/">
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^(Agent1|Agent2|Agent3) [NC]
RewriteRule .* - [F]
</Directory>

Would this work for all vhosts? Is here a better way?
 
Last edited:
 
Thanks for this link. Helps a lot.
BUT what about "missing" user-agents? In my log files I found dozens of requests with "no" or "unknown" user-agent. How to add this to the linked list?
 
Back
Top