Issue Apache & PHP-FPM running out of memory

[excede]

Server operating system version

CentOS Linux 7.9.2009 (Core)

Plesk version and microupdate number

Plesk Obsidian v18.0.43_build1800220414.18 os_CentOS 7

We need help, and happy to pay for an expert!
Our Apache & PHP-FPM memory usage is constantly being exceeded and we cant see why. We are running wordpress/woocommerce and the server keeps on going down requiring a reboot to refresh the memory. We are on a very fast server with loads of RAM and have tried increasing the limits significantly in the PHP.INI and Plesk setting but same problem prevails.

If anyone can make suggestions to fix this it would be appreciated but we also need an expert to look at the whole server setup, if that's you please get in touch.

 

[Maarten]

Hi,

We need a little more info.

- what are the PHP-settings?
- which PHP-handler do you use?
- do you use Apache with nginx?
- what are the PHP-FPM-settings, like pm.max_children?
- do you use a cache plugin for the WP sites like W3 Total Cache?
- have you checked the access_ssl_log for bots or lots of POSTs coming from the same IP address?
- have you checked the error_logs for AH0XXXX errors?

 

[Bitpalast]

have tried increasing the limits significantly in the PHP.INI and Plesk setting

Wrong approach. Set it to a reasonable limit. Normally no more than 512 MB, better less. Only very few scripts need more RAM per script execution. The RAM you set in PHP is always "per execution". So if you allow a script to consume a lot of RAM and that script is faulty, it will consume a lot of RAM so that others don't have enough left. The same is true for execution time limits. Make sure that run-away scripts are stopped by setting short execution time limits, such as 10 to 20 seconds. For normal scripts this is sufficient.

Else as said before, more details are needed to get to the root cause. Have you checked your access_ssl_log whether your server receives many requests from bad bots or maybe is under attack?

 

[excede]

Hi,

We need a little more info.

- what are the PHP-settings?
- which PHP-handler do you use?
- do you use Apache with nginx?
- what are the PHP-FPM-settings, like pm.max_children?
- do you use a cache plugin for the WP sites like W3 Total Cache?
- have you checked the access_ssl_log for bots or lots of POSTs coming from the same IP address?
- have you checked the error_logs for AH0XXXX errors?

Hi There, I appreciate you taking the time to respond but I am not technical enough to answer all of those questions which is why I am offering to pay for an expert to look into and diagnose the issue. Here are my best answers:

- what are the PHP-settings?
attached

- which PHP-handler do you use?
?

- do you use Apache with nginx?
yes

- what are the PHP-FPM-settings, like pm.max_children?
attached

- do you use a cache plugin for the WP sites like W3 Total Cache?
no

- have you checked the access_ssl_log for bots or lots of POSTs coming from the same IP address?
no

- have you checked the error_logs for AH0XXXX errors?
no

 

[excede]

Hi There, I appreciate you taking the time to respond but I am not technical enough to answer all of those questions which is why I am offering to pay for an expert to look into and diagnose the issue. Here are my best answers:

- what are the PHP-settings?
attached

- which PHP-handler do you use?
?

- do you use Apache with nginx?
yes

- what are the PHP-FPM-settings, like pm.max_children?
attached

- do you use a cache plugin for the WP sites like W3 Total Cache?
no

- have you checked the access_ssl_log for bots or lots of POSTs coming from the same IP address?
no

- have you checked the error_logs for AH0XXXX errors?
no

I just updated the setting to this but I have no clue what I'm doing!

 

[excede]

Here is a screenshot of the memory usage over 12 months, you can see the steady growth over that time and the limit being reached which is causing the issues we have now.

So my question is (and I've tried): how do I increase the red line to 20 Gib?

 

[Quinten]

You can increase the threshold settings by going to
Monitoring -> Memory -> top right settings -> threshold and adjust the "Apache & PHP-FPM memory usage"

 

[excede]

You can increase the threshold settings by going to
Monitoring -> Memory -> top right settings -> threshold and adjust the "Apache & PHP-FPM memory usage"

View attachment 20826

Ok thanks for that. Is there a way to stop the memory climbing or excessive memory usage? It seems the server just stops working when the threshold is exceeded.

 

[Bitpalast]

I just updated the setting to this but I have no clue what I'm doing!

max.children: If all are busy and an additional request comes in, the server won't be able to respond to that request. For that reason it is important to make sure that running processes are not running very long. You can (and should) increase the max.children number a bit, e.g. to 15 or 25 or so, so that your server can still respond to further incoming requests even if it is quite busy with existing requests.

max.requests: A child process will get killed when this number is reached, then a new child instance will be created (until max.children in concurrent children is reached). A single PHP-FPM instance (child) can handle several thousand requests before it needs to get killed. You can set this to a high value such as 5000 or 10000. Too frequent instance-killings only costs valuable cpu slices. A number too high however will give less protection against memory leaks. 100 is too small though, rather start off with a few thousand.

Logs need to be checked for bad bots.

Are you using Fail2Ban on this server? Maybe it is not on or a jail is not on so that brute-force attacks can continue and can cause the high load. Also I recommend to block bad bots. The simple way is adding these lines to the beginning of the .htaccess file of your website:

RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} (seocompany|LieBaoFast|SEOkicks|Uptimebot|Cliqzbot|ssearch_bot|domaincrawler|AhrefsBot|spot|DigExt|Sogou|MegaIndex.ru|majestic12|80legs|SISTRIX|HTTrack|Semrush|MJ12|MJ12bot|MJ12Bot|Ezooms|CCBot|TalkTalk|Ahrefs|BLEXBot) [NC]
RewriteRule .* - [F]

But there are better ways, e.g. blocking them via Fail2Ban or via Nginx. More complicated though, leave that to an expert on your server.

 

[excede]

Thanks Peter, I appreciate the detail as it gives me more of an idea and will try to work with that information as best I can. I definitely will use your expert though as it is out of my depth!