Azurel
Silver Pleskian
I found this feature request
block bad bots by default
Alternatively, a tutorial on how to protect yourself with Plesk would be nice. IgorG wrote a little one
Instruction - Blocking extra bots using nginx
It would be nice if this becomes an official support example (plesk help center) with current agents and a little better explanation. The tutorial is already one year old and surely new agents appeared. See
atmire/COUNTER-Robots
or
monperrus/crawler-user-agents
or
- Bad Bots Bad Bots user-agent / bot
- Crawlers Crawlers user-agent / bot
- Scrapers Scrapers user-agent / bot
Where exactly should the entry be added, so that this block is for all domains?
So? Create a new "bad_bots.conf" in /etc/nginx/conf.d with
block bad bots by default
Alternatively, a tutorial on how to protect yourself with Plesk would be nice. IgorG wrote a little one
Instruction - Blocking extra bots using nginx
It would be nice if this becomes an official support example (plesk help center) with current agents and a little better explanation. The tutorial is already one year old and surely new agents appeared. See
atmire/COUNTER-Robots
or
monperrus/crawler-user-agents
or
- Bad Bots Bad Bots user-agent / bot
- Crawlers Crawlers user-agent / bot
- Scrapers Scrapers user-agent / bot
Where exactly should the entry be added, so that this block is for all domains?
So? Create a new "bad_bots.conf" in /etc/nginx/conf.d with
Code:
server {
# List of scrapers and crawlers
if ($http_user_agent ~ VALUE1|VALUE2) {
return 444;
}
}
Last edited: