• If you are still using CentOS 7.9, it's time to convert to Alma 8 with the free centos2alma tool by Plesk or Plesk Migrator. Please let us know your experiences or concerns in this thread:
    CentOS2Alma discussion

Server unresponsive everyday at the same time

G

GustavoO

Guest
Hi!

I'm having an annoying issue with my server.

It happens that, every day my system gets unresponsive at 7am-8am and the only thing i can do to save it is to force a reboot (it's hosted in a external Data Center).

So, today when i could login while it was happening, i've noticed that there was a lot of 'crond' processes running.

As seen:

Code:
   1.
      root 29369 0.0 0.1 10208 2280 ? S 07:04 0:00 crond
   2.
      root 29371 0.0 0.0 10204 1088 ? S 07:04 0:00 crond
   3.
      root 29413 0.0 0.1 10208 2280 ? S 07:05 0:00 crond
   4.
      root 29414 0.0 0.1 10208 2280 ? S 07:05 0:00 crond
   5.
      cobranca 29415 0.0 0.1 10208 2280 ? S 07:05 0:00 crond
   6.
      root 29416 0.0 0.0 10204 1088 ? S 07:05 0:00 crond
   7.
      root 29417 0.0 0.0 10204 1088 ? S 07:05 0:00 crond
   8.
      cobranca 29418 0.0 0.0 10204 1088 ? S 07:05 0:00 crond
   9.
      root 29435 0.0 0.1 10208 2280 ? S 07:06 0:00 crond
  10.
      root 29436 0.0 0.1 10208 2280 ? S 07:06 0:00 crond
  11.
      root 29437 0.0 0.0 10204 1084 ? S 07:06 0:00 crond
  12.
      root 29438 0.0 0.0 10204 1088 ? S 07:06 0:00 crond
  13.
      root 29456 0.0 0.1 10208 2280 ? S 07:07 0:00 crond
  14.
      root 29457 0.0 0.1 10208 2280 ? S 07:07 0:00 crond
  15.
      root 29458 0.0 0.0 10204 1088 ? S 07:07 0:00 crond
  16.
      root 29459 0.0 0.0 10204 1084 ? S 07:07 0:00 crond
  17.
      root 29465 0.0 0.1 10208 2280 ? S 07:08 0:00 crond
  18.
      root 29466 0.0 0.1 10208 2280 ? S 07:08 0:00 crond
  19.
      root 29467 0.0 0.0 10204 1088 ? S 07:08 0:00 crond
  20.
      root 29468 0.0 0.0 10204 1084 ? S 07:08 0:00 crond
  21.
      root 29480 0.0 0.1 10208 2280 ? S 07:09 0:00 crond
  22.
      root 29481 0.0 0.1 10208 2280 ? S 07:09 0:00 crond
  23.
      root 29482 0.0 0.0 10204 1088 ? S 07:09 0:00 crond
  24.
      root 29483 0.0 0.0 10204 1084 ? S 07:09 0:00 crond
  25.
      root 29493 0.0 0.1 10208 2280 ? S 07:10 0:00 crond
  26.
      root 29494 0.0 0.1 10208 2280 ? S 07:10 0:00 crond
  27.
      root 29495 0.0 0.1 10208 2280 ? S 07:10 0:00 crond
  28.
      cobranca 29496 0.0 0.1 10208 2280 ? S 07:10 0:00 crond
  29.
      root 29497 0.0 0.0 10204 1088 ? S 07:10 0:00 crond
  30.
      root 29498 0.0 0.0 10204 1088 ? S 07:10 0:00 crond
  31.
      root 29499 0.0 0.0 10204 1084 ? S 07:10 0:00 crond
  32.
      cobranca 29500 0.0 0.0 10204 1088 ? S 07:10 0:00 crond
  33.
      root 29503 0.0 0.1 10208 2280 ? S 04:02 0:00 crond


All the jobs from users:

Code:
  GNU nano 1.3.12                                            File: teste                                                                                              

*/5     *	*	*	*	/var/www/vhosts/regenteimoveis.com.br/web_users/cobranca/.integra/prestconta.pl >/dev/null 2>&1
35	3,8,13,18,23  *       *       *       /opt/drweb/update.pl
14,29,44,59     *	*	*	*	/usr/local/psa/admin/sbin/backupmng >/dev/null 2>&1
0	1	*	*	1	/usr/local/psa/libexec/modules/watchdog/cp/secur-check
0	1	*	*	1	/usr/local/psa/libexec/modules/watchdog/cp/send-report weekly
10	1	*	*	*	/usr/local/psa/libexec/modules/watchdog/cp/clean-sysstats
15	1	*	*	*	/usr/local/psa/libexec/modules/watchdog/cp/pack-sysstats day
15	1	*	*	1	/usr/local/psa/libexec/modules/watchdog/cp/pack-sysstats week
15	1	1	*	*	/usr/local/psa/libexec/modules/watchdog/cp/pack-sysstats month
15	1	1	*	*	/usr/local/psa/libexec/modules/watchdog/cp/pack-sysstats year
20	1	*	*	*	/usr/local/psa/libexec/modules/watchdog/cp/clean-events
0	3	*	*	7	/usr/local/psa/libexec/modules/watchdog/cp/clean-reports
*	*	*	*	*	/usr/local/bin/pop-before-smtp >/dev/null 2>&1
*/1     *	*	*	*	/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1
47	23	*	*	*	/usr/sbin/ntpdate -b -s ntp.ansp.br
00 01 * * * cd /usr/local/sso && /usr/bin/sw-engine /usr/local/sso/process/DBcleanup.php /etc/sso/sso_config.ini

Others crons are:

Code:
[root@qx01 ~]# ls -la /etc/cron.daily/

total 84
drwxr-xr-x   2 root root  4096 Oct 20 17:34 .
drwxr-xr-x 107 root root 12288 Oct 20 22:59 ..
-rwxr-xr-x   1 root root   133 Jan  9  2007 00webalizer

-rwxr-xr-x   1 root root   379 Mar 28  2007 0anacron
lrwxrwxrwx   1 root root    39 Jul 27  2008 0logwatch -> /usr/share/logwatch/scripts/logwatch.pl
-rwxr-xr-x   1 root root   344 Oct 16 09:24 50plesk-daily
-rwxr-xr-x   1 root root   152 May 23  2007 awstats
-rwxr-xr-x   1 root root  1042 May 24  2008 certwatch
-rwxr-xr-x   1 root root   118 Jun  3 17:44 cups
-rwxr-xr-x   1 root root   180 Feb 26  2009 logrotate
-rwxr-xr-x   1 root root   418 Jan  6  2007 makewhatis.cron
-rwxr-xr-x   1 root root   137 Feb 26  2009 mlocate.cron
-rwxr-xr-x   1 root root  2181 Jun 21  2006 prelink
-rwxr-xr-x   1 root root   296 Jan 21  2009 rpm
-rwxr-xr-x   1 root root   328 Feb 26  2009 tmpwatch


----------------------------------

[root@qx01 ~]# ls -la /etc/cron.monthly/
total 36
drwxr-xr-x   2 root root  4096 Oct 20 17:34 .
drwxr-xr-x 107 root root 12288 Oct 20 22:59 ..
-rwxr-xr-x   1 root root   381 Mar 28  2007 0anacron
-rwxr-xr-x   1 root root   148 Oct 16 09:24 50plesk-monthly

------------------------------------------------

[root@qx01 ~]# ls -la /etc/cron.weekly/
total 44
drwxr-xr-x   2 root root  4096 Oct 20 17:34 .
drwxr-xr-x 107 root root 12288 Oct 20 22:59 ..
-rwxr-xr-x   1 root root   380 Mar 28  2007 0anacron
-rwxr-xr-x   1 root root   146 Oct 16 09:24 50plesk-weekly
-rwxr-xr-x   1 root root   414 Jan  6  2007 makewhatis.cron

Some related configs:

Code:
[root@qx01 ~]# cat /etc/anacrontab 
# /etc/anacrontab: configuration file for anacron

# See anacron(8) and anacrontab(5) for details.

SHELL=/bin/sh
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root

1	65	cron.daily		run-parts /etc/cron.daily
7	70	cron.weekly		run-parts /etc/cron.weekly
30	75	cron.monthly		run-parts /etc/cron.monthly


---------------------------------

[root@qx01 ~]# cat /etc/crontab
SHELL=/bin/bash
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root
HOME=/

# run-parts
01 * * * * root run-parts /etc/cron.hourly
02 4 * * * root run-parts /etc/cron.daily
22 4 * * 0 root run-parts /etc/cron.weekly
42 4 1 * * root run-parts /etc/cron.monthly


/etc/cron.d/ File:

Code:
[root@qx01 ~]# ls -la /etc/cron.d/
total 40
drwx------   2 root root  4096 Oct  7 19:58 .
drwxr-xr-x 107 root root 12288 Oct 20 22:59 ..
-rw-r--r--   1 root root    40 Jul  3 03:36 drweb-update
-rw-r--r--   1 root root   170 May 24  2008 mailman
-rw-------   1 root root   366 Jan 21  2009 sa-update
-rw-r--r--   1 root root   188 Feb 26  2009 sysstat

I will post the cron log in the next post...

I need some assistance, please!

Thanks in advance,
Gustavo.
 
same was happened to me many times, i modified the time of plesk cron jobs at off peak time when my server is not much loaded. Mostly it was after calculation of statisctics.
 
The 'S' state in the process list means Sleep, a.k.a. waiting for something. Do you have any network file shares it may be trying to access?
 
Updating the thread, here goes the cron log:

Code:
[code]
Oct 21 07:00:01 qx01 crond[29281]: (root) CMD (/usr/lib/sa/sa1 1 1)
Oct 21 07:00:01 qx01 crond[29282]: (drweb) CMD (/opt/drweb/update.pl)
Oct 21 07:00:01 qx01 crond[29283]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:00:01 qx01 crond[29285]: (cobranca) CMD (/var/www/vhosts/regenteimoveis.com.br/web_users/cobranca/.integra/prestconta.pl >/dev/null 2>&1)
Oct 21 07:01:01 qx01 crond[29318]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:00:01 qx01 crond[29284]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:01:01 qx01 crond[29317]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 06:51:02 qx01 crond[28980]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 06:57:01 qx01 crond[29183]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:02:01 qx01 crond[29334]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:02:01 qx01 crond[29335]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:03:01 qx01 crond[29351]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:03:01 qx01 crond[29352]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 06:54:01 qx01 crond[29076]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 06:53:01 qx01 crond[29052]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:04:01 qx01 crond[29372]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:01:01 qx01 crond[29316]: (root) CMD (run-parts /etc/cron.hourly)
Oct 21 07:05:01 qx01 crond[29416]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:47:35 qx01 crontab[2699]: (root) BEGIN EDIT (root)
Oct 21 07:49:14 qx01 crontab[2699]: (root) END EDIT (root)
Oct 21 07:50:39 qx01 crond[3530]: (CRON) STARTUP (V5.0)
Oct 21 07:51:01 qx01 crond[3676]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:51:01 qx01 crond[3677]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:52:01 qx01 crond[3960]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:52:01 qx01 crond[3961]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:52:57 qx01 crontab[4159]: (root) BEGIN EDIT (root)
Oct 21 07:53:01 qx01 crond[4184]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:53:01 qx01 crond[4185]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:53:20 qx01 crontab[4159]: (root) END EDIT (root)
Oct 21 07:54:01 qx01 crond[4481]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:54:01 qx01 crond[4482]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:55:01 qx01 crond[4911]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:55:01 qx01 crond[4913]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:55:01 qx01 crond[4916]: (cobranca) CMD (/var/www/vhosts/regenteimoveis.com.br/web_users/cobranca/.integra/prestconta.pl >/dev/null 2>&1)
Oct 21 07:56:01 qx01 crond[5321]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:56:01 qx01 crond[5322]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:57:01 qx01 crond[5567]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:57:01 qx01 crond[5569]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:58:01 qx01 crond[5865]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 07:58:01 qx01 crond[5866]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:59:01 qx01 crond[6135]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
Oct 21 07:59:01 qx01 crond[6137]: (root) CMD (/usr/local/psa/admin/sbin/backupmng >/dev/null 2>&1)
Oct 21 07:59:01 qx01 crond[6138]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 08:00:01 qx01 crond[6437]: (drweb) CMD (/opt/drweb/update.pl)
Oct 21 08:00:01 qx01 crond[6439]: (root) CMD (/usr/lib/sa/sa1 1 1)
Oct 21 08:00:01 qx01 crond[6441]: (root) CMD (/usr/local/psa/admin/bin/php /usr/local/psa/admin/bin/ttsmailparse.php >/dev/null 2>&1)
Oct 21 08:00:01 qx01 crond[6442]: (root) CMD (/usr/local/bin/pop-before-smtp >/dev/null 2>&1)
[/code]
 
Is it VPS or standalone server? If it is VPS I can assume that there is can be resources related issue.
 
Hello Ppl!

Thanks for the answers...

Lesb: Theres no network share.

IgorG: It's a dedicated server.


Any ideas?


Thanks again!
 
We've discovered that our server was really getting unresponsive because the cron.

When we disabled almost all cron jobs our server didnt freeze anymore.


We still don't know why or what is causing this...
 
Back
Top