Services Shut Down Every 5 Minutes

[steelz09]

All,

I am running into an issue where my "services" appear to be shutting down every 5 minutes or so and I can't figure out the resolution. Could someone please provide some expertise on this matter. For example, I notice that the following is happening:

The DNS server service is switched off.
Solutions:
Restart the DNS server service.
The IMAP/POP3 server service is switched off.
Solutions:
Restart the IMAP/POP3 server service.
The Plesk Control Panel service is switched off.
Solutions:
Restart the Plesk Control Panel service.
The SMTP server service is switched off.
Solutions:
Restart the SMTP server service.
The Web server service is switched off.
Solutions:
Restart the Web server service.

I restart the container, or I restart each service individually and everything seems to be working as expected. However, in 5 minutes or so ... all services "switch to" off, and of course the website goes down.

Does anyone have any suggestions. Any help would be greatly appreciated.

 

[ziba@]

Hi,

If it is a Virtuozzo container then it may be caused by resource limit violation.
Check the following file:
cat /proc/user_beancounters

If you see there non zero value in 'failcnt' column for a resource then this resource limit should be increased from hardware node.

Also, do you have any errors related to service restart in the following logs:
/var/log/messages
/usr/local/psa/admin/logs/httpsd_error_log
/usr/local/psa/var/log/maillog

 

[steelz09]

Still No Luck.

I'm still having the same problems. The services seem to be automatically shutting themselves down for no apparent reason. I would greatly appreciate any help you all could offer. I went in the the shell prompt and did the recommended commands although I really don't know what I'm looking at. These are the outputs of the recommended commands. Can someone please help me figure these out and see if these logs are displaying what could cause my services to shut down??? Thank you.

OUTPUT OF cat /proc/user_beancounters
-----------------------------------------

Version: 2.5
uid resource held maxheld barrier limit failcnt
4906: kmemsize 5794698 6082184 9223372036854775807 9223372036854775807 0
lockedpages 0 0 9223372036854775807 9223372036854775807 0
privvmpages 65068 67679 9223372036854775807 9223372036854775807 0
shmpages 5799 5799 9223372036854775807 9223372036854775807 0
dummy 0 0 9223372036854775807 9223372036854775807 0
numproc 51 53 2048 4096 0
physpages 20512 22359 0 9223372036854775807 0
vmguarpages 0 0 66339 9223372036854775807 0
oomguarpages 20512 22359 9223372036854775807 9223372036854775807 0
numtcpsock 19 21 9223372036854775807 9223372036854775807 0
numflock 9 10 9223372036854775807 9223372036854775807 0
numpty 1 1 128 128 0
numsiginfo 0 1 1024 1024 0
tcpsndbuf 365536 407296 9223372036854775807 9223372036854775807 0
tcprcvbuf 311296 327680 9223372036854775807 9223372036854775807 0
othersockbuf 29792 89760 9223372036854775807 9223372036854775807 0
dgramrcvbuf 0 0 9223372036854775807 9223372036854775807 0
numothersock 25 25 9223372036854775807 9223372036854775807 0
dcachesize 808759 824722 9223372036854775807 9223372036854775807 0
numfile 2837 2878 9223372036854775807 9223372036854775807 0
dummy 0 0 0 0 0
dummy 0 0 0 0 0
dummy 0 0 0 0 0
numiptent 14 14 9223372036854775807 9223372036854775807


I see a few of the following when I output /var/log/messages
-----------------------------------------------------------

Oct 20 04:57:04 planetst1 syslogd 1.4.1#18: restart.

Oct 20 08:14:15 planetst1 shutdown[21942]: shutting down for system reboot
Oct 20 08:14:20 planetst1 exiting on signal 15
Oct 20 08:14:28 planetst1 syslogd 1.4.1#18: restart


Output of /usr/local/psa/admin/logs/httpsd_error_log
----------------------------------------------------

[Sun Oct 19 15:20:31 2008] [notice] caught SIGTERM, shutting down
Processing config directory: /opt/psa/admin/conf/httpsd.*.include
[Sun Oct 19 15:20:49 2008] [notice] Apache configured -- resuming normal operations
[Sun Oct 19 15:20:49 2008] [notice] Accept mutex: sysvsem (Default: sysvsem)
[Sun Oct 19 22:21:20 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/soa_serial_number_format
[Sun Oct 19 22:21:20 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/select_db_server_permission
[Sun Oct 19 22:21:20 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/plesk_billing_bundle
[Sun Oct 19 22:21:20 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/ubuntu_804_support
[Sun Oct 19 22:21:59 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/soa_serial_number_format
[Sun Oct 19 22:21:59 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/ubuntu_804_support
[Sun Oct 19 22:21:59 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/select_db_server_permission
[Sun Oct 19 22:22:00 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/plesk_billing_bundle
[Mon Oct 20 08:14:05 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/soa_serial_number_format
[Mon Oct 20 08:14:05 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/select_db_server_permission
[Mon Oct 20 08:14:05 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/plesk_billing_bundle
[Mon Oct 20 08:14:05 2008] [error] [client 192.168.101.195] File does not exist: /opt/psa/admin/htdocs/images/news/ubuntu_804_support
[Mon Oct 20 08:14:16 2008] [notice] caught SIGTERM, shutting down
Processing config directory: /opt/psa/admin/conf/httpsd.*.include
[Mon Oct 20 08:14:34 2008] [notice] Apache configured -- resuming normal operations
[Mon Oct 20 08:14:34 2008] [notice] Accept mutex: sysvsem (Default: sysvsem)

 

[steelz09]

I get a a BUNCH of stuff from the maillog so I had to remove a lot but I still posted a section of it below. I don't even recognize these emails listed in this file.. not sure what all of this means, thanks,

Output of /usr/local/psa/var/log/maillog
--------------------------------------

Oct 20 04:59:11 planetst1 qmail: 1224493151.314698 starting delivery 198: msg 150798360 to remote [email protected]
Oct 20 04:59:11 planetst1 qmail: 1224493151.314789 status: local 0/10 remote 1/20
Oct 20 04:59:11 planetst1 qmail-remote-handlers[3853]: Handlers Filter before-remote for qmail started ...
Oct 20 04:59:11 planetst1 qmail-remote-handlers[3853]: [email protected]
Oct 20 04:59:11 planetst1 qmail: 1224493151.320070 delivery 198: deferral:
Oct 20 05:06:09 planetst1 qmail: 1224493569.306470 status: local 0/10 remote 14/20
Oct 20 05:06:09 planetst1 qmail: 1224493569.306498 starting delivery 213: msg 150798344 to remote [email protected]
Oct 20 05:06:09 planetst1 qmail-remote-handlers[18287]: [email protected]
Oct 20 05:06:09 planetst1 qmail-remote-handlers[18284]: [email protected]
Oct 20 05:06:09 planetst1 qmail-remote-handlers[18289]: [email protected]
Oct 20 05:06:09 planetst1 qmail-remote-handlers[18281]: [email protected]

Oct 20 05:06:09 planetst1 qmail: 1224493569.384253 status: local 0/10 remote 0/20
Oct 20 05:07:55 planetst1 qmail: 1224493675.540016 starting delivery 254: msg 150798362 to remote [email protected]
Oct 20 05:07:55 planetst1 qmail: 1224493675.540094 status: local 0/10 remote 1/20
Oct 20 05:07:55 planetst1 qmail-remote-handlers[20143]: Handlers Filter before-remote for qmail started ...
Oct 20 05:07:55 planetst1 qmail-remote-handlers[20143]: [email protected]
Oct 20 05:07:55 planetst1 qmail: 1224493675.545754 delivery 254: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:07:55 planetst1 qmail: 1224493675.545801 status: local 0/10 remote 0/20
Oct 20 05:08:49 planetst1 qmail: 1224493729.544169 starting delivery 255: msg 150798364 to remote [email protected]
Oct 20 05:08:49 planetst1 qmail: 1224493729.544230 status: local 0/10 remote 1/20
Oct 20 05:08:49 planetst1 qmail-remote-handlers[21533]: Handlers Filter before-remote for qmail started ...
Oct 20 05:08:49 planetst1 qmail-remote-handlers[21533]: [email protected]
Oct 20 05:08:49 planetst1 qmail: 1224493729.549994 delivery 255: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:08:49 planetst1 qmail: 1224493729.550036 status: local 0/10 remote 0/20
Oct 20 05:10:41 planetst1 qmail: 1224493841.545124 starting delivery 256: msg 150798428 to remote [email protected]
Oct 20 05:10:41 planetst1 qmail: 1224493841.545197 status: local 0/10 remote 1/20
Oct 20 05:10:41 planetst1 qmail-remote-handlers[26589]: Handlers Filter before-remote for qmail started ...
Oct 20 05:10:41 planetst1 qmail-remote-handlers[26589]: [email protected]
Oct 20 05:10:41 planetst1 qmail: 1224493841.551521 delivery 256: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:10:41 planetst1 qmail: 1224493841.551556 status: local 0/10 remote 0/20
Oct 20 05:22:44 planetst1 qmail: 1224494564.552954 starting delivery 257: msg 150798426 to remote [email protected]
Oct 20 05:22:44 planetst1 qmail: 1224494564.553014 status: local 0/10 remote 1/20
Oct 20 05:22:44 planetst1 qmail: 1224494564.553043 starting delivery 258: msg 150798440 to remote [email protected]
Oct 20 05:22:44 planetst1 qmail: 1224494564.553070 status: local 0/10 remote 2/20
Oct 20 05:22:44 planetst1 qmail-remote-handlers[23700]: Handlers Filter before-remote for qmail started ...
Oct 20 05:22:44 planetst1 qmail-remote-handlers[23701]: Handlers Filter before-remote for qmail started ...
Oct 20 05:22:44 planetst1 qmail-remote-handlers[23700]: [email protected]
Oct 20 05:22:44 planetst1 qmail-remote-handlers[23701]: [email protected]
Oct 20 05:22:44 planetst1 qmail: 1224494564.561504 delivery 257: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:22:44 planetst1 qmail: 1224494564.561563 status: local 0/10 remote 1/20
Oct 20 05:22:44 planetst1 qmail: 1224494564.561627 delivery 258: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:22:44 planetst1 qmail: 1224494564.561657 status: local 0/10 remote 0/20
Oct 20 05:48:25 planetst1 qmail: 1224496105.557791 starting delivery 259: msg 150798358 to remote [email protected]
Oct 20 05:48:25 planetst1 qmail: 1224496105.557861 status: local 0/10 remote 1/20

Oct 20 05:48:25 planetst1 qmail-remote-handlers[32171]: Handlers Filter before-remote for qmail started ...
Oct 20 05:48:25 planetst1 qmail-remote-handlers[32171]: [email protected]
Oct 20 05:48:25 planetst1 qmail: 1224496105.564808 delivery 259: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 05:48:25 planetst1 qmail: 1224496105.564865 status: local 0/10 remote 0/20
Oct 20 06:02:15 planetst1 qmail: 1224496935.573411 starting delivery 260: msg 363533490 to remote [email protected]
Oct 20 06:02:15 planetst1 qmail: 1224496935.573484 status: local 0/10 remote 1/20
Oct 20 06:02:15 planetst1 qmail-remote-handlers[26093]: Handlers Filter before-remote for qmail started ...
Oct 20 06:02:15 planetst1 qmail-remote-handlers[26093]: [email protected]
Oct 20 06:02:15 planetst1 qmail: 1224496935.580557 delivery 260: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 06:02:15 planetst1 qmail: 1224496935.580595 status: local 0/10 remote 0/20
Oct 20 06:22:09 planetst1 qmail: 1224498129.528242 starting delivery 261: msg 150798364 to remote [email protected]
Oct 20 06:34:35 planetst1 qmail: 1224498875.445390 starting delivery 262: msg 150798362 to remote [email protected]
Oct 20 06:34:35 planetst1 qmail: 1224498875.445462 status: local 0/10 remote 1/20
Oct 20 06:34:35 planetst1 qmail-remote-handlers[24121]: Handlers Filter before-remote for qmail started ...
Oct 20 06:34:35 planetst1 qmail-remote-handlers[24121]: [email protected]
Oct 20 06:34:35 planetst1 qmail: 1224498875.451254 delivery 262: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 06:34:35 planetst1 qmail: 1224498875.451296 status: local 0/10 remote 0/20
Oct 20 06:39:11 planetst1 qmail: 1224499151.450298 starting delivery 263: msg 150798360 to remote [email protected]
Oct 20 06:39:11 planetst1 qmail: 1224499151.450377 status: local 0/10 remote 1/20
Oct 20 06:39:11 planetst1 qmail-remote-handlers[5822]: Handlers Filter before-remote for qmail started ...
Oct 20 06:39:11 planetst1 qmail-remote-handlers[5822]: [email protected]
Oct 20 06:39:11 planetst1 qmail: 1224499151.457311 delivery 263: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 06:39:11 planetst1 qmail: 1224499151.457348 status: local 0/10 remote 0/20
Oct 20 06:40:42 planetst1 qmail: 1224499242.456395 starting delivery 264: msg 150798356 to remote [email protected]
Oct 20 06:40:42 planetst1 qmail: 1224499242.456479 status: local 0/10 remote 1/20
Oct 20 06:40:42 planetst1 qmail-remote-handlers[10044]: Handlers Filter before-remote for qmail started ...
Oct 20 06:40:42 planetst1 qmail-remote-handlers[10044]: [email protected]
Oct 20 06:40:42 planetst1 qmail: 1224499242.462601 delivery 264: deferral: CNAME_lookup_failed_temporarily._(#4.4.3)/
Oct 20 06:40:42 planetst1 qmail: 1224499242.462645 status: local 0/10 remote 0/20
Oct 20 07:48:49 planetst1 qmail: 1224503329.229268 starting delivery 265: msg 150798364 to remote [email protected]
Oct 20 07:48:49 planetst1 qmail: 1224503329.229347 status: local 0/10 remote 1/20
Oct 20 07:48:49 planetst1 qmail-remote-handlers[13870]: Handlers Filter before-remote for qmail started ...
Oct 20 07:48:49 planetst1 qmail-remote-handlers[13870]: [email protected]
Oct 20 07:48:49 planetst1 qmail: 1224503329.236035 delivery 265: deferral:
Oct 20 08:32:31 planetst1 qmail-remote-handlers[20346]: [email protected]
Oct 20 08:32:31 planetst1 qmail: 1224505951.499809 delivery 2: deferral: 205.188.159.216_failed_after_I_sent_the_message./Remote_host_said:_421-:__(DNS:NR)__http://postmaster.info.aol.com/errors/421dnsnr.html/421_SERVICE_NOT_AVAILABLE/
Oct 20 08:32:31 planetst1 qmail: 1224505951.499886 status: local 0/10 remote 0/20
Oct 20 08:38:51 planetst1 qmail-queue-handlers[28649]: Handlers Filter before-queue for qmail started ...
Oct 20 08:38:51 planetst1 qmail-queue-handlers[28649]: [email protected]
Oct 20 08:38:51 planetst1 qmail-queue-handlers[28649]: hook_dir = '/var/qmail//handlers/before-queue'
Oct 20 08:38:51 planetst1 qmail-queue-handlers[28649]: recipient[3] = '[email protected]'
Oct 20 08:38:51 planetst1 qmail-queue-handlers[28649]: handlers dir = '/var/qmail//handlers/before-queue/recipient/[email protected]'
28650 uid 33
Oct 20 08:38:51 planetst1 qmail: 1224506331.603290 starting delivery 3: msg 150798362 to remote
Oct 20 09:30:45 planetst1 qmail: 1224509445.727429 delivery 8: deferral: Sorry,_I_wasn't_able_to_establish_an_SMTP_connection._(#4.4.1)/
Oct 20 09:30:45 planetst1 qmail: 1224509445.727496 status: local 0/10 remote 0/20


Thanks again for help. I'm really at a loss for this problem. Let me know if you I should provide more info.