Hi,
I got a server running with ~100 domains. Some times i notice that there is a lot of httpd processes running at the same time and this is causing a very high server load (up to ~70,00 sometimes). My guess is that there are some bad spiders crawling my server. So, i'am wondering if there is a way to detect spiders like this and automatically block them out?
I got a server running with ~100 domains. Some times i notice that there is a lot of httpd processes running at the same time and this is causing a very high server load (up to ~70,00 sometimes). My guess is that there are some bad spiders crawling my server. So, i'am wondering if there is a way to detect spiders like this and automatically block them out?