Question Ban bad bots in Plesk Admin?

[TinaBura]

I would like to ban/block bad bots like PetalBot. I have IPs and IP ranges that should not crawl my sites.

The question is: Is it possible to do it in Plesk Admin panel somehow? I am not a Linux expert and do not trust myself to make changes in the console.

 

[Maarten.]

Hi,

If you're using nginx, you might want to try this. It should be entered in the Apache & nginx Settings -> Additional nginx directives field:

#block Petalbot bot nginx
if ($http_user_agent ~* (petalbot) ) {
return 403;
}

 

[IgorG]

Instruction - Blocking extra bots using nginx

Very often our sites are visited by absolutely useless bots, which only create unnecessary load on the server. I don't understand why some people use .htaccess for this purpose because Apache consumes much more resources to solve this problem. In...

talk.plesk.com

 

[DieterWerner]

Instruction - Blocking extra bots using nginx

Very often our sites are visited by absolutely useless bots, which only create unnecessary load on the server. I don't understand why some people use .htaccess for this purpose because Apache consumes much more resources to solve this problem. In...

talk.plesk.com

So, the f2b jail 'plesk-apache-badbot' is useless?

 

[Maarten.]

It's kinda old:

...
# DEV Notes:
# List of bad bots fetched from http://www.user-agents.org
# Generated on Thu Nov  7 14:23:35 PST 2013 by files/gen_badbots.
#
# Author: Yaroslav Halchenko

 

[DieterWerner]

It's kinda old:

...
# DEV Notes:
# List of bad bots fetched from http://www.user-agents.org
# Generated on Thu Nov  7 14:23:35 PST 2013 by files/gen_badbots.
#
# Author: Yaroslav Halchenko

And what should told me your comment?

 

[Maarten.]

That it's outdated and useless.
There are better and more up2date lists of bad bots, i.e.:

GitHub - mitchellkrogza/apache-ultimate-bad-bot-blocker: Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders

Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders - mitc...

github.com

 

[Maarten.]

It's already reported:

Forwarded to devs - Fail2ban: Filter"apache-badbots" updates?

Username: TITLE Fail2ban: Filter"apache-badbots" updates? PRODUCT, VERSION, OPERATING SYSTEM, ARCHITECTURE All PROBLEM DESCRIPTION Were there ever any updates for this filter? Where did the current useragents (badbots) come from? Can I make suggestions for a update? Maybe you...

talk.plesk.com