• Plesk Uservoice will be deprecated by October. Moving forward, all product feature requests and improvement suggestions will be managed through our new platform Plesk Productboard.
    To continue sharing your ideas and feedback, please visit features.plesk.com

Question Block selected UserAgents for all vhosts

Azurel

Silver Pleskian
I want block a few bots and crawlers, which not respect robots.txt.
I think the best way is to create a new apache config-file in "/etc/httpd/conf.d/block_useragents.conf" and reload apache?

Content of block_useragents.conf:
<Directory "/var/www/vhosts/">
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^(Agent1|Agent2|Agent3) [NC]
RewriteRule .* - [F]
</Directory>

Would this work for all vhosts? Is here a better way?
 
Last edited:
 
Thanks for this link. Helps a lot.
BUT what about "missing" user-agents? In my log files I found dozens of requests with "no" or "unknown" user-agent. How to add this to the linked list?
 
Back
Top