Issue SWAP Space Issue

[KrazyBob]

On one of my legacy servers not yet migrated I am seeing high wa% times. This is the best screen cap I could snatch. It seems that simple HTTP commands freak it out. This is a Virtuozzo container that ran fine until I tried to do a security update that failed. The backup has since been over-written. vzstat is telling me that I'm out of swap space. This is a small server with a small Plesk installation. 8GB RAM

otal DISK READ: 8.90 M/s | Total DISK WRITE: 0.00 B/s
TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND
12333 be/4 postfix 162.02 K/s 0.00 B/s 0.00 % 99.99 % qmgr -l -t fifo -u
29673 be/4 apache 1816.91 K/s 3.86 K/s 5.61 % 91.85 % php-cgi -c /var/www/vhost~ontract.com/etc/php.ini
29224 be/4 apache 505.34 K/s 0.00 B/s 41.42 % 34.35 % httpd
29141 be/4 apache 582.49 K/s 0.00 B/s 60.16 % 13.52 % httpd
29587 be/4 27 219.88 K/s 3.86 K/s 8.55 % 8.59 % mysqld --basedir=/usr --d~=/var/lib/mysql/mysql.sock
29646 be/4 10077 999.11 K/s 0.00 B/s 98.66 % 7.12 % php-cgi -c /var/www/vhost~ontract.com/etc/php.ini
27763 be/4 apache 1230.56 K/s 0.00 B/s 96.01 % 2.90 % httpd
29588 be/4 27 285.46 K/s 34.72 K/s 20.36 % 1.50 % mysqld --basedir=/usr --d~=/var/lib/mysql/mysql.sock
29656 be/4 10077 995.25 K/s 0.00 B/s 96.04 % 0.00 % php-cgi -c /var/www/vhost~ontract.com/etc/php.ini
29438 be/4 apache 1149.55 K/s 0.00 B/s 99.99 % 0.00 % httpd
24444 be/4 apache 1137.98 K/s 0.00 B/s 99.18 % 0.00 % httpd
29184 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % console-kit-daemon --no-daemon
1 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % init
2 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kthreadd]
3 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/0]
4 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/0]
5 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/0]
6 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/0]
7 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/1]
8 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/1]
9 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/1]
10 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/1]
11 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [events/0]
12 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [events/1]

vzstat reports a swap issue. Nothing has changed on the setup.

5:46am, up 1042 days, 14:01, 3 users, load average: 19.79, 18.13, 16.06
CTNum 1, procs 318: R 2, S 297, D 17, Z 2, T 0, X 0
CPU [ OK ]: CTs 11%, CT0 88%, user 62%, sys 38%, idle 0%, lat(ms) 12/0
Mem [CRIT]: total 3820MB, free 39MB, lat(ms) 1/1
ZONE0 (DMA): size 14MB, act 1MB, inact 1MB, free 8MB (0/0/0)
ZONE1 (DMA32): size 2992MB, act 173MB, inact 146MB, free 28MB (5/7/8)
ZONE2 (Normal): size 1008MB, act 0MB, inact 0MB, free 2MB (1/2/2)
Mem lat (ms): A0 0, K0 1, U0 1, K1 1, U1 0
Slab pages: 62MB/62MB (ino 20MB, de 0MB, bh 0MB, pb 0MB)
Swap [CRIT]: tot 12287MB, free 11595MB, in 2.117MB/s, out 1.215MB/s
Net [ OK ]: tot: in 0.002MB/s 25pkt/s, out 0.006MB/s 11pkt/s
lo: in 0.000MB/s 0pkt/s, out 0.000MB/s 0pkt/s
eth0: in 0.002MB/s 25pkt/s, out 0.006MB/s 11pkt/s
eth1: in 0.000MB/s 0pkt/s, out 0.000MB/s 0pkt/s

The Virtuozzo script has not changed either.

[root@hw006 ~]# cd /etc/sysconfig/vz-scripts/
[root@hw006 vz-scripts]# cat 206.conf
#This is an example configuration file for so-called "basic" Container.
#<agent>: Configuration file for allocating 256 Mb of memory.
#
# Copyright (C) Parallels, 1999-2010. All rights reserved.

VERSION="2"

ONBOOT="yes"


PHYSPAGES="524288:524288"
SWAPPAGES="262144"
VM_OVERCOMMIT="1.5"

CPUUNITS="1000"

DISKSPACE="524288037:688128049"
DISKINODES="13495934:14845528"
QUOTATIME="0"
OFFLINE_MANAGEMENT="yes"