• If you are still using CentOS 7.9, it's time to convert to Alma 8 with the free centos2alma tool by Plesk or Plesk Migrator. Please let us know your experiences or concerns in this thread:
    CentOS2Alma discussion

Service named high cpu !

J

Jean-francois_Chauveau

New Pleskian
Hello,
I installed Plesk 12 on a distribution centos 6 .
I configured the 25 web domains that work well.
I have a problem , the response time of the server are long ...
So, by typing top command in ssh shell , I noticed that the service ' named' was still over 120 %!
Do you know why ?
And also , what all the commands 'perl' executed?
Thank you in advance!
Jeff

ps : I turned off the stuff and it's always the same
ps2 : I restarted the named service and it's always the same ...


Code: 
 PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
14170 named     20   0  278m  75m 2652 S 121.9  0.1 144:02.75 named
4802 apache    20   0  477m  53m 6784 R 49.1  0.1   0:05.97 httpd
4126 chauveau  20   0 58564  17m 1228 S 13.8  0.0  12:37.33 perl
4142 chauveau  20   0 58564  17m 1228 S 13.8  0.0  12:40.69 perl
11582 chauveau  20   0 76176  22m 1040 S 13.8  0.0  96:47.71 perl
13233 chauveau  20   0 58564  17m 1228 S 13.8  0.0  14:26.83 perl
15280 chauveau  20   0 73248  22m 1044 S 13.8  0.0 894:16.17 perl
24814 chauveau  20   0 76176  22m 1040 S 13.8  0.0  30:29.39 perl
26573 chauveau  20   0 76176  22m 1040 R 13.8  0.0  82:27.20 perl
31512 chauveau  20   0 76176  22m 1040 R 13.8  0.0  51:52.97 perl
13249 chauveau  20   0 58564  17m 1228 S 11.8  0.0  14:20.91 perl
13870 chauveau  20   0 76176  22m 1040 S 11.8  0.0 174:13.34 perl
13893 chauveau  20   0 76176  22m 1040 S 11.8  0.0  42:32.13 perl
13908 chauveau  20   0 76176  22m 1040 S 11.8  0.0  42:37.78 perl
14451 chauveau  20   0 76176  22m 1040 S 11.8  0.0 121:12.76 perl
16918 chauveau  20   0 76176  22m 1040 S 11.8  0.0  73:24.28 perl
16932 chauveau  20   0 76176  22m 1040 S 11.8  0.0  73:40.64 perl
20278 chauveau  20   0 76176  22m 1040 S 11.8  0.0  65:32.46 perl
21638 chauveau  20   0 76176  22m 1040 R 11.8  0.0  14:32.97 perl
21654 chauveau  20   0 76176  22m 1040 S 11.8  0.0  14:42.60 perl
22609 chauveau  20   0 58564  17m 1228 S 11.8  0.0   9:25.55 perl
22623 chauveau  20   0 58564  17m 1228 R 11.8  0.0   9:27.33 perl
25426 chauveau  20   0 76176  22m 1040 S 11.8  0.0  86:35.49 perl
25440 chauveau  20   0 76176  22m 1040 S 11.8  0.0  86:12.81 perl
26266 chauveau  20   0 76176  22m 1040 S 11.8  0.0  59:04.92 perl
26280 chauveau  20   0 76176  22m 1040 S 11.8  0.0  59:13.92 perl
26587 chauveau  20   0 76176  22m 1040 S 11.8  0.0  82:35.53 perl
30003 chauveau  20   0 76176  22m 1012 S 11.8  0.0   5:39.10 perl
30017 chauveau  20   0 76176  22m 1012 R 11.8  0.0   5:38.19 perl
31526 chauveau  20   0 76176  22m 1040 S 11.8  0.0  51:56.53 perl
 
Hi
Sorry, I was not present .. :(

I restarded the server ... and it was good ... not problem with the named service and not perl script in action.
But today, at 11h03am, the problem reappeared !!! (service named with high cpu, many perl script in action ...)

watch log in message file below ...
what's happen at 11h03 in my plesk server ???
thanks ...


Code: 
Mar 27 11:03:25 ns511596 proftpd[26163]: 167.114.116.195 (127.0.0.1[127.0.0.1]) - FTP session opened.
Mar 27 11:03:26 ns511596 proftpd[26163]: 167.114.116.195 (127.0.0.1[127.0.0.1]) - FTP session closed.
Mar 27 11:03:26 ns511596 xinetd[3867]: EXIT: ftp status=0 pid=26163 duration=1(sec)
Mar 27 11:03:28 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'skytechnology.pl/A/IN': 2001:6d8:1001:1::252#53
Mar 27 11:03:30 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:31 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:31 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:32 ns511596 named[3790]: error (unexpected RCODE REFUSED) resolving 'esfa.iua.edu.ar/A/IN': 200.16.16.2#53
Mar 27 11:03:32 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:33 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:33 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:34 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:35 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:35 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:36 ns511596 named[3790]: error (connection refused) resolving 'pampero.crytic.mcye.gov.ar/A/IN': 168.83.80.4#53
Mar 27 11:03:36 ns511596 named[3790]: error (connection refused) resolving 'lombriz.me.gov.ar/AAAA/IN': 168.83.80.4#53
Mar 27 11:03:36 ns511596 named[3790]: error (connection refused) resolving 'lombriz.me.gov.ar/A/IN': 168.83.80.4#53
Mar 27 11:03:36 ns511596 named[3790]: error (connection refused) resolving 'pampero.crytic.mcye.gov.ar/AAAA/IN': 168.83.80.4#53
Mar 27 11:03:36 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:37 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:38 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:38 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:39 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:40 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:40 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:41 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:42 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
Mar 27 11:03:42 ns511596 kernel: net_ratelimit: 189 callbacks suppressed
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 kernel: nf_conntrack: table full, dropping packet
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'ns1.web4.sd.eurovps.com/A/IN': 192.33.14.30#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'ns1.web4.sd.eurovps.com/AAAA/IN': 192.33.14.30#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'ns1.web4.sd.eurovps.com/A/IN': 192.52.178.30#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'ns1.web4.sd.eurovps.com/AAAA/IN': 192.52.178.30#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'ns1.web4.sd.eurovps.com/AAAA/IN': 192.12.94.30#53
Mar 27 11:03:42 ns511596 named[3790]: error (unexpected RCODE SERVFAIL) resolving 'www.ungs.edu.ar/A/IN': 170.210.0.18#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'www.ungs.edu.ar/A/IN': 170.210.52.72#53
Mar 27 11:03:42 ns511596 named[3790]: error (host unreachable) resolving 'www.ungs.edu.ar/A/IN': 2800:110:fe::aad2:12#53
 
It seems to me that problem related to nf_conntrack of iptables. All its data is stored in tables nf_conntrack, and the above message indicates that the tables are full.
Check default settings with following command, for example:

# sysctl -a | grep conntrack_max
net.netfilter.nf_conntrack_max = 65536
net.nf_conntrack_max = 65536

Increase size of tables with:

# echo "net.netfilter.nf_conntrack_max=1048576" >> /etc/sysctl.conf
# sysctl -p

and check again:

# sysctl -a | grep conntrack_max
net.netfilter.nf_conntrack_max = 1048576
net.nf_conntrack_max = 1048576
 
Thanks for your reply !
The problem happens once a day ( at random ) and, when it occurs, the only solution is to restart the server ...
Should I apply on your solution or wait until the problem is ?
Thank you again ...
 
[root@nsXXXXXX etc]# sysctl -a | grep conntrack_max
net.ipv4.netfilter.ip_conntrack_max = 1048576
net.netfilter.nf_conntrack_max = 1048576
net.nf_conntrack_max = 1048576

Ok I just made the change :)
I hold you aware if the problem returns .
Thank you again :)
 
I would check into those perl scripts... seeing the nf_conntrack getting full is a red flag.

ps aux | grep perl
The above command should give more info on where these perl scripts are being run out of. Judging from the previous output you gave, they are running as the user chauveau
 
Hello,
I'm sorry but the problem is triggered tonight ... (see below) . Yet "Perl" scripts seem to work for some time . Why suddenly they turn around?
I think it's scripts just the Plesk interface , since they are associated with my user " chauveau ."
The command " ps aux | grep perl " gives nothing about scripting ..
"root 3966 0.0 0.0 105360 884 pts / 0 + R 7:39 0:00 grep perl
"
I confess that I am very concerned about this problem, with dozens of clients on this server :(
Thank you for your help!

Code: 
top - 07:30:14 up 1 day,  8:27,  1 user,  load average: 8.54, 8.07, 7.72
Tasks: 296 total,   6 running, 289 sleeping,   0 stopped,   1 zombie
Cpu(s): 54.4%us, 19.4%sy,  0.0%ni, 22.7%id,  0.2%wa,  0.0%hi,  3.3%si,  0.0%st
Mem:  66003632k total, 39679160k used, 26324472k free,   897712k buffers
Swap:  1046520k total,        0k used,  1046520k free, 35853280k cached
Unknown command - try 'h' for help
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
3379 named     20   0  274m  69m 2660 S 136.4  0.1 163:16.95 named
31356 chauveau  20   0  199m  16m 9416 S 59.5  0.0   0:01.79 php-cgi
22599 chauveau  20   0 62440  17m 1024 R 44.6  0.0  16:20.23 perl
18685 chauveau  20   0 62440  17m 1024 S 43.6  0.0  29:22.04 perl
18671 chauveau  20   0 62440  17m 1024 R 42.9  0.0  29:23.07 perl
22900 chauveau  20   0 62444  17m 1024 R 41.9  0.0  73:24.13 perl
16844 chauveau  20   0 62440  17m 1024 S 41.6  0.0  33:50.09 perl
16830 chauveau  20   0 62440  17m 1024 R 41.2  0.0  33:52.98 perl
22584 chauveau  20   0 62440  17m 1024 S 41.2  0.0  16:19.46 perl
22886 chauveau  20   0 62440  17m 1024 S 40.9  0.0  73:23.02 perl
32225 chauveau  20   0 62440  17m 1024 R 40.9  0.0  53:56.09 perl
32239 chauveau  20   0 62440  17m 1024 S 40.6  0.0  53:56.98 perl
3727 mysql     20   0 1252m  80m 6968 S  1.0  0.1 144:06.82 mysqld
31291 root      20   0  108m 4840 3652 S  0.7  0.0   0:00.04 sshd
    7 root      20   0     0    0    0 S  0.3  0.0   1:37.12 rcu_sched
   11 root      20   0     0    0    0 S  0.3  0.0   0:08.15 ksoftirqd/1
   27 root      20   0     0    0    0 S  0.3  0.0   0:07.17 ksoftirqd/5
   35 root      20   0     0    0    0 S  0.3  0.0   0:07.20 ksoftirqd/7
18004 chauveau  20   0 62440  17m  620 S  0.3  0.0   0:04.67 perl
31360 root      20   0 52244 5140 2900 S  0.3  0.0   0:00.01 in.proftpd
32227 chauveau  20   0 62572  17m  956 S  0.3  0.0   0:01.25 perl
    1 root      20   0 19280 1516 1232 S  0.0  0.0   0:02.09 init
    2 root      20   0     0    0    0 S  0.0  0.0   0:00.01 kthreadd
    3 root      20   0     0    0    0 S  0.0  0.0   0:08.36 ksoftirqd/0
    5 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 kworker/0:0H
    8 root      20   0     0    0    0 S  0.0  0.0   0:00.00 rcu_bh
    9 root      RT   0     0    0    0 S  0.0  0.0   0:00.09 migration/0
 
You must log in or register to reply here.

Similar threads

T
Issue Mysql server under pressure (too much ?)
2
Replies
27
Views
3K
Teal_cfr
T
Q
Resolved problem with ram server
Replies
8
Views
1K
Qusay
Q
R
Issue after the plesk installation my cpu utilization 99%
Replies
6
Views
2K
AYamshanov
AYamshanov
F
Resolved Hard Drive - Status Red??
Replies
2
Views
883
Filipe Silva
F
T
Issue my Server health parameter "Services > MySQL CPU usage" changed its status from "green" to "red".
Replies
13
Views
2K
tomer628
T
Back
Top