Serious issues with Plesk backups

[FirstPoint]

Hello,
I've done a search for plesk backup errors on the forums and I see many have an issue since they upgraded to Plesk 11.

Since we upgraded to Plesk 11, the backups over FTP don't work anymore and we never had a notification or something. I don't know if Plesk is aware that this functionnality is business critical for hosting companies ?

Anyways... after realising the backups didn't work, we tried reconfiguring. It's planned every night, at 2 am. No prefix, destination remote FTP, not multi-volume, my e-mail address in case of errors, and I configured to backup full system conf + content.

The backup is now running, but it always stays on the server... I've checked the FTP configuration everything is OK. I checked the logs in /usr/local/psa/PMM/logs.
last pmmcli.log shows only 3 "CONTENT ERRORS" like this one:

<dump description="XandMailWeb2cs" owner-guid="5a2082cc-99bc-4e2b-a1a1-f1f43ba41574" verification-string="" name="backup_info_1112191001.xml" owner-type="server" creation-date="1112191001" fullname="backup_info_1112191001.xml" size="13239607210">
<dump-status dump-status="CONTENT-ERROR">
</dump-status>

The other files, migration.log, pmmcli_daemon.log, and the migration.log.XXXX-etc don't show any errors...

We're running Plesk 11.0.9 Update #26.

Please tell us how to fix this issue asap. Thanks

 

[IgorG]

Not enough details. Try to find any related error messages in Backup logs:

/usr/local/psa/PMM/sessions/<session>/psadump.log
/usr/local/psa/PMM/sessions/<session>/migration.log
/usr/local/psa/PMM/logs/migration.log
/usr/local/psa/PMM/logs/pmmcli.log

 

[ErwanG]

FirstPoint,

We (and a lot of personn) have this problem since 3 months and Parallels always says that there is no error in the log, so no problem....

Good luck.

Note: we think that the problem is with Centos 5.x and not with Centos 6.x

 

[IgorG]

FirstPoint,

We (and a lot of personn) have this problem since 3 months and Parallels always says that there is no error in the log, so no problem....

Could you please tell me how we can reproduce and investigate the problem if no one does not provide us details?

 

[FirstPoint]

Ok so in the /usr/local/psa/PMM/sessions/2012-12-04-020702.246 folder I finally seem to have some errors... However this is the only session for which there are logs. Why ? There are no session folders for the backups that have run since begining of december, and not even the one of this night (2012-12-05) ?

In psadump.log of the session I have many errors, like:

[11363]: 05:54:16 ERROR 80a59a5b-a787-4e45-84db-24db0b87d62f Unable to execute SQL: Can't open file: './psa/mail.frm' (errno: 24)
[11363]: 05:54:16 ERROR 8aaddfe7-198f-4b2b-8d0e-322e18009cd3 Broken referencial integrity: Mail id 106 is not found in mail

[11363]: 05:55:19 ERROR e6270b24-1805-4eeb-8498-da77717014bf Unable to create dump:
at /usr/local/psa/PMM/agents/shared/Logging.pm line 84
Logging::error('Unable to create dump', 'fatal') called at /usr/local/psa/admin/bin/plesk_agent_manager line 650
main::__ANON__('Error::Simple=HASH(0x9cc6728)', 'SCALAR(0x8c23304)') called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 339
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 329
Error::subs::run_clauses('HASH(0x9000310)', '\'undef\' value passed to XmlNode::setAttribute for \'type\' ...', 'undef', 'ARRAY(0x9000430)') called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 426
Error::subs::try('CODE(0x900019c)', 'HASH(0x9000310)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 652
main:erform('verbose', 0, 'split-size', 'undef', 'session-path', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246', 'all', 1, 'owner-uid', ...) called at /usr/local/psa/admin/bin/plesk_agent_manager line 1279
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 408
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x804cb44)', 'HASH(0x8eadd10)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1288
main::main() called at /usr/local/psa/admin/bin/plesk_agent_manager line 1290

[11363]: 05:55:19 ERROR aa503d82-d2ee-4c5e-849e-252f685e0792 Unable to check dump: Could not check dump. Invalid xml response:
at /usr/local/psa/PMM/agents/PleskX/PmmCli.pm line 177
PmmCli:arseCheckDumpResult('Error: adjacent parameter is empty in \'dump-file-specificati...') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1205
main::checkDump('/var/lib/psa/dumps', '', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246') called at /usr/local/psa/admin/bin/plesk_agent_manager line 672
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 415
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x90001b4)', 'HASH(0x900049c)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 681
main:erform('verbose', 0, 'split-size', 'undef', 'session-path', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246', 'all', 1, 'owner-uid', ...) called at /usr/local/psa/admin/bin/plesk_agent_manager line 1279
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 408
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x804cb44)', 'HASH(0x8eadd10)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1288
main::main() called at /usr/local/psa/admin/bin/plesk_agent_manager line 1290.

[11363]: 05:55:19 ERROR c95012ca-3fba-4386-8629-a67f0910b20c Invalid dump file name ''. Cannot determine backup prefix.
[11363]: 05:57:48 ERROR 1953e364-54f6-469b-8ee9-a3c77716d93a Runtime error:
at /usr/local/psa/PMM/agents/shared/Logging.pm line 84
Logging::error('Runtime error', 'fatal') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1285
main::__ANON__('Error::Simple=HASH(0x8d50110)', 'SCALAR(0x8c23304)') called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 336
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 329
Error::subs::run_clauses('HASH(0x8eadd10)', 'Cannot export files\x{a} at /usr/local/psa/admin/bin/plesk_agent_...', '', 'ARRAY(0x8c23604)') called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 426
Error::subs::try('CODE(0x804cb44)', 'HASH(0x8eadd10)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1288
main::main() called at /usr/local/psa/admin/bin/plesk_agent_manager line 1290

/bin/tar: Error exit delayed from previous errors
Runtime error: Cannot export files
at /usr/local/psa/admin/bin/plesk_agent_manager line 1190
main::exportFilesTo('/usr/local/psa/PMM/tmp/backupjqaAgw', 'ARRAY(0x8d5fc90)', '/usr/local/psa/PMM/tmp/backupjqaAgw', 'undef', 0, 'undef', 1) called at /usr/local/psa/admin/bin/plesk_agent_manager line 712
main:erform('verbose', 0, 'split-size', 'undef', 'session-path', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246', 'all', 1, 'owner-uid', ...) called at /usr/local/psa/admin/bin/plesk_agent_manager line 1279
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 408
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x804cb44)', 'HASH(0x8eadd10)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1288
main::main() called at /usr/local/psa/admin/bin/plesk_agent_manager line 1290.

 

[FirstPoint]

migration.result:

<message id="c95012ca-3fba-4386-8629-a67f0910b20c" severity="error" code="msgtext">
<description>Invalid dump file name ''. Cannot determine backup prefix.</description>
</message>
<message id="aa503d82-d2ee-4c5e-849e-252f685e0792" severity="error" code="CheckDump">
<description>Unable to check dump: Could not check dump. Invalid xml response:
at /usr/local/psa/PMM/agents/PleskX/PmmCli.pm line 177
PmmCli:arseCheckDumpResult('Error: adjacent parameter is empty in \'dump-file-specificati...') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1205
main::checkDump('/var/lib/psa/dumps', '', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246') called at /usr/local/psa/admin/bin/plesk_agent_manager line 672
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 415
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x90001b4)', 'HASH(0x900049c)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 681
main:erform('verbose', 0, 'split-size', 'undef', 'session-path', '/usr/local/psa/PMM/sessions/2012-12-04-020702.246', 'all', 1, 'owner-uid', ...) called at /usr/local/psa/admin/bin/plesk_agent_manager line 1279
main::__ANON__() called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 408
eval {...} called at /usr/lib/perl5/vendor_perl/5.8.8/Error.pm line 407
Error::subs::try('CODE(0x804cb44)', 'HASH(0x8eadd10)') called at /usr/local/psa/admin/bin/plesk_agent_manager line 1288
main::main() called at /usr/local/psa/admin/bin/plesk_agent_manager line 1290.
</description>

dump-status.xml:

<?xml version="1.0" encoding="UTF-8"?>
<agent-dump-status completed-domains="67" completed-accounts="73" total-accounts="74" total-domains="76"/>

If you want me to PM you the full log files please tell me Igor. And how come there is a folder only for one session ??

 

[ErwanG]

Could you please tell me how we can reproduce and investigate the problem if no one does not provide us details?

And how can i give you details with no errors in log files ?

Have you check the backup with Plesk 11 and Centos 5.x ? We have 5 servers with the problem and they are all with Centos 5.2. No problem with servers on Centos 6.2 and after.

 

[IgorG]

Unable to execute SQL: Can't open file: './psa/mail.frm' (errno: 24)

Looks like psa database is corrupted. File /var/lib/mysql/psa/mail.frm is broken.
Try to check mysql psa database.

 

[FirstPoint]

We're running CentOS 5.6.
I've run a check on all tables of the psa database, everything is "OK".
Running a repair on all tables returns "The storage engine for the table doesn't support r..." for all tables.

Igor, I'm still wondering why there is only one session in the dumps logs.
Also, what I realise is that individual backup files for each domain for the current day are present in the /var/lib/psa/dumps/clients/sunnydayjs/domains/****.tld are present. For many domains, there are multiple backup tgz files for dates 21.11.2012 - till today...

 

[FirstPoint]

Hello Igor,

Again, for the backup of this night no session folder has been created in /usr/local/psa/PMM/sessions... In Plesk, in the Backup management, I see that the different backup files are present on the server. In the remote FTP, nothing is present.

 

[ErwanG]

Igor,

Have you check the backup system with Plesk 11 and Centos 5.x ?
The problem seems to come from that.

 

[laverboy]

Any further development with this issue, as I am continuing to have very similar issues. Thanks.

 

[ErwanG]

After 2 weeks with Plesk support (!!!), i have found the solution.
The issue was due to low disk space where is directory /usr/local/psa/PMM/tmp.

- delete the directory /usr/local/psa/PMM/tmp and create a symbolic link to another directory with enough space (/var/backup for example).

ln -s /var/backup/tmp /usr/local/psa/PMM/tmp

Simple, but there is nothing in the Plesk logs, so very difficult to found the problem.