Backup problem with Personal FTP repository

[ErwanG]

Hello,

We have a problem with the backup manager and the remote host (Personal FTP repository).

I have made a backup (schedule) with theses parameters : Store backup in "Personal FTP repository", Back up : "Server configuration".
RESULT : OK. The file is on the "Personal FTP repository".

Another test vith a backup (schedule) with theses parameters : Store backup in "Personal FTP repository", Back up : "Server configuration and content".
RESULT : Backup ok but the file isn"t in the remote FTP ("Personal FTP repository") but in the "Server repository".

An idea from the pb ?
In which log file can i find informations ?

 

[IgorG]

Look at Plesk Backup Manager section here http://kb.parallels.com/111283

 

[ErwanG]

The logfile says that.
The email message says : "Dump full name is:" (noname, nothing).
And the backup stay on the server, not on Personal FTP repository.
The problem is on 5 Plesk servers.

<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-list>
</task-list>
</data>
</response>

28222: 2012-10-09 23:14:02,911 DEBUG --> <pmmcli.GetConfigParametersAction object at 0xb77169ac>
28222: 2012-10-09 23:14:02,914 DEBUG <pmmcli.ActionRunner object at 0xb7711b8c>: doActivity
28222: 2012-10-09 23:14:02,915 DEBUG <pmmcli.GetConfigParametersAction object at 0xb77169ac>: response
28222: 2012-10-09 23:14:02,916 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<config-parameters>
<parameter>
<name>DAEMON_TIMEOUT</name>
<value>30</value>
</parameter>
<parameter>
<name>MAX_LOG_SIZE</name>
<value>1048576</value>
</parameter>
<parameter>
<name>MAX_CONFLICT_RESOLVES</name>
<value>1</value>
</parameter>
<parameter>
<name>FREE_DISK_SPACE</name>
<value>20</value>
</parameter>
<parameter>
<name>CHECK_BACKUP_DISK_SPACE</name>
<value>0</value>
</parameter>
<parameter>
<name>MAX_LOG_FILES</name>
<value>10</value>
</parameter>
<parameter>
<name>KEEP_TEMP_DUMP</name>
<value>1800</value>
</parameter>
<parameter>
<name>MAILBODY</name>
<value>'%TASK_TYPE% task finished.\n\nTask was created by %OWNER_TYPE% with guid (%OWNER_GUID%)\n\n\nCreation date is: %CREATION_DATE%\nTask status is: %TASK_STATUS%\n\nDump full name is: %FULL_NAME%\n\n\n\n'</value>
</parameter>
<parameter>
<name>AUTHREQUIRED</name>
<value>0</value>
</parameter>
<parameter>
<name>DAYS_TO_KEEP_SESSIONS</name>
<value>30</value>
</parameter>
<parameter>
<name>SMTPSERVER</name>
<value>localhost</value>
</parameter>
<parameter>
<name>MAILSUBJECT</name>
<value>Backup/Restore task notification</value>
</parameter>
<parameter>
<name>FORCE_DEBUG_LOG</name>
<value>0</value>
</parameter>
</config-parameters>
</data>
</response>

28223: 2012-10-09 23:14:03,012 DEBUG --> <pmmcli.MakeDumpAction object at 0xb77479ac>
28223: 2012-10-09 23:14:03,012 INFO stdin: <backup-task-description><misc backup-profile-name="sauv_systeme_plesk" owner-guid="8fd222dc-15d3-4be5-be79-69039a1f83ed"/><dumps-storage-credentials storage-type="foreign-ftp" use-passive-ftp-mode="true"><login>XXXXXXXXXX</login><password>XXXXXXXXXX</password><hostname>XXXXXXXXXX</hostname><root-dir>/</root-dir><file-name/><backup-password>XXXXXXXXXX</backup-password></dumps-storage-credentials><backup-specification><backup-options type="full" compression-level="standard" suspend="false" rotation="3" mail-to="XXXXXXXXXX@XXXXXXXXXX"/><object-to-backup type="server" all="true"/></backup-specification></backup-task-description>
28223: 2012-10-09 23:14:03,015 INFO Packet succesfully validated.
28223: 2012-10-09 23:14:03,016 DEBUG <pmmcli.ActionRunner object at 0xb7742b8c>: doActivity
28223: 2012-10-09 23:14:03,128 INFO Executing asynchronously <subprocess[28224] '/usr/bin/perl /usr/local/psa/admin/bin/plesk_agent_manager server --owner-uid=8fd222dc-15d3-4be5-be79-69039a1f83ed --dump-rotation=3 --backup-profile-name=sauv_systeme_plesk --session-path=/usr/local/psa/PMM/sessions/2012-10-09-231403.889 --output-file=ftp://XXXXXXXXXX@XXXXXXXXXX// --ftp-passive-mode'>
28223: 2012-10-09 23:14:03,129 DEBUG Acquired session mutex: MainThread
28223: 2012-10-09 23:14:03,129 DEBUG detecting running pmmcli daemon...
28223: 2012-10-09 23:14:03,199 DEBUG starting pmmcli daemon...
28223: 2012-10-09 23:14:03,204 DEBUG Executing asynchronously [28227] process
28223: 2012-10-09 23:14:03,230 DEBUG Released session mutex: MainThread
28223: 2012-10-09 23:14:03,230 DEBUG Acquired session mutex: MainThread
28223: 2012-10-09 23:14:03,302 DEBUG Released session mutex: MainThread
28223: 2012-10-09 23:14:03,302 DEBUG <pmmcli.MakeDumpAction object at 0xb77479ac>: response
28223: 2012-10-09 23:14:03,303 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-id>28224</task-id>
</data>
</response>

28229: 2012-10-09 23:14:03,486 DEBUG --> <pmmcli.GetTaskStatusAction object at 0xb77099cc>
28229: 2012-10-09 23:14:03,486 INFO parameters: ['28224']
28229: 2012-10-09 23:14:03,489 DEBUG <pmmcli.ActionRunner object at 0xb7704bac>: doActivity
28229: 2012-10-09 23:14:03,489 DEBUG Acquired session mutex: MainThread
28229: 2012-10-09 23:14:03,513 DEBUG Released session mutex: MainThread
28229: 2012-10-09 23:14:03,513 DEBUG <pmmcli.GetTaskStatusAction object at 0xb77099cc>: response
28229: 2012-10-09 23:14:03,514 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-status task-id="28224">
<working>
<starting></starting>
</working>
</task-status>
</data>
</response>

28539: 2012-10-09 23:15:04,085 DEBUG --> <pmmcli.GetTaskStatusAction object at 0xb77189cc>
28539: 2012-10-09 23:15:04,085 INFO parameters: ['28224']
28539: 2012-10-09 23:15:04,088 DEBUG <pmmcli.ActionRunner object at 0xb7713bac>: doActivity
28539: 2012-10-09 23:15:04,088 DEBUG Acquired session mutex: MainThread
28539: 2012-10-09 23:15:04,107 DEBUG Released session mutex: MainThread
28539: 2012-10-09 23:15:04,107 DEBUG <pmmcli.GetTaskStatusAction object at 0xb77189cc>: response
28539: 2012-10-09 23:15:04,108 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-status task-id="28224">
<working>
<dumping total-accounts="41" completed-domains="1" completed-accounts="1" total-domains="98">
</dumping>
</working>
</task-status>
</data>
</response>

28680: 2012-10-09 23:16:05,375 DEBUG --> <pmmcli.GetTaskStatusAction object at 0xb77849cc>
28680: 2012-10-09 23:16:05,375 INFO parameters: ['28224']
28680: 2012-10-09 23:16:05,378 DEBUG <pmmcli.ActionRunner object at 0xb777fbac>: doActivity
28680: 2012-10-09 23:16:05,379 DEBUG Acquired session mutex: MainThread
28680: 2012-10-09 23:16:05,397 DEBUG Released session mutex: MainThread
28680: 2012-10-09 23:16:05,397 DEBUG <pmmcli.GetTaskStatusAction object at 0xb77849cc>: response
28680: 2012-10-09 23:16:05,398 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-status task-id="28224">
<working>
<dumping total-accounts="41" completed-domains="1" completed-accounts="1" total-domains="98">
</dumping>
</working>
</task-status>
</data>
</response>


**********************
.......................
SAME THINGS BEETWEEN 23:14:03 AND 01:08:39 all minutes
.......................
**********************



23337: 2012-10-10 01:07:39,196 DEBUG --> <pmmcli.GetTaskStatusAction object at 0xb773c9cc>
23337: 2012-10-10 01:07:39,196 INFO parameters: ['28224']
23337: 2012-10-10 01:07:39,199 DEBUG <pmmcli.ActionRunner object at 0xb7737bac>: doActivity
23337: 2012-10-10 01:07:39,199 DEBUG Acquired session mutex: MainThread
23337: 2012-10-10 01:07:39,216 DEBUG Released session mutex: MainThread
23337: 2012-10-10 01:07:39,216 DEBUG <pmmcli.GetTaskStatusAction object at 0xb773c9cc>: response
23337: 2012-10-10 01:07:39,217 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-status task-id="28224">
<working>
<dumping total-accounts="41" completed-domains="98" completed-accounts="41" total-domains="98">
</dumping>
</working>
</task-status>
</data>
</response>

23570: 2012-10-10 01:08:39,787 DEBUG --> <pmmcli.GetTaskStatusAction object at 0xb76ba9cc>
23570: 2012-10-10 01:08:39,787 INFO parameters: ['28224']
23570: 2012-10-10 01:08:39,791 DEBUG <pmmcli.ActionRunner object at 0xb76b5bac>: doActivity
23570: 2012-10-10 01:08:39,791 DEBUG Acquired session mutex: MainThread
23570: 2012-10-10 01:08:39,808 DEBUG Released session mutex: MainThread
23570: 2012-10-10 01:08:39,808 DEBUG <pmmcli.GetTaskStatusAction object at 0xb76ba9cc>: response
23570: 2012-10-10 01:08:39,809 INFO Outgoing packet:
<?xml version="1.0" encoding="UTF-8"?>
<response>
<errcode>0</errcode>
<data>
<task-status task-id="28224">
<working>
<dumping total-accounts="41" completed-domains="98" completed-accounts="41" total-domains="98">
</dumping>
</working>
</task-status>
</data>
</response>

 

[IgorG]

I see nothing suspicious in this log.

 

[ErwanG]

And why the Plesk backup ("Server configuration and content") doesn't work ?

 

[MislavO]

Have you tryed to change password and try again? Maybe manually connect with current credentials when you're logged as root in shell to your FTP repository?

When you're logged in shell type: (most probablly you have same data in Home>Tools & Settings>Backup Manager>Personal FTP Repository>)
# ftp <ftp_server_hostname>

- after that you'll be asked for FTP username and password, you can also check this for FTP commands (or you can just google it, FTP commands):

http://ss64.com/bash/ftp.html

I wrote a little bash script on my server for FTP personal server backup, maybe this can help you (NOTE: if you have big server and usually backups have more then 50GB, this might take a while - this script is used to move already created Plesk backup which is created daily on my server).

Here is the script (within script every step is explained):

#!/bin/bash

#date format - 2012-10-03 - it's used in backup name to define date
dateBackup=`date +%F`

# 2012-10-01 - day before yesterday - i'm using this date because i don't have
# big FTP repository, so i delete old backups
dateBefore=`date +%F --date='-2 day'`

# date format - 121003 (12|10|03 - year (last two digits), month, day) - this is Plesk
# format of date which you can find when backup is created
# please note: Plesk backup have extra four digits after this date - hours and minutes which
# can vary from timezone/people are setting backups in different time, and because of that
# we ignore last four digits
datePlesk=`date +%y%m%d`


# This is where you specify name of the backup file (in this case this is the name of file
# that gets deleted so new backup file can be uploaded)
dirnameMO=fullbackup-$dateBefore.tar.gz

# This will create backup on server (local)
# option "nice -n 19" - it will run your command with lowest priority on server
# option "tar" - well it's creating archive, i guess you're familiar with this one
# option "find" - since backups are created in /var/lib/psa/dumps, it searches for all backup files
# created in reseller/client folder, and result is included in archive
nice -n 19 tar cfz fullbackup-$dateBackup.tar.gz `find . -name "*$datePlesk*"`

# This is the FTP servers host or IP address.
HOST=<ftp_server_hostname>

# This is the FTP user that has access to the server.
USER=<ftp_user>

# This is the password for the FTP user
PASS=<ftp_user_password>

# Uses the ftp command with the -inv switches. -i turns off interactive prompting. -n Restrains FTP from attempting the auto-login f$
ftp -inv $HOST << EOF

# Login credentials are supplied by calling the variables.
user $USER $PASS


# command "delete $dirnameMO" is deleting backup file before X days defined in variable $dateBefore
delete $dirnameMO

# command "send" is uploading newly created fullbackup file from local server to repository - second name is name
# of backup file on repository (it's suggested to leave it same, because of variable to delete this backup file)
send fullbackup-$dateBackup.tar.gz fullbackup-$dateBackup.tar.gz

bye
EOF

Things you need to change:
dateBefore=`date +%F --date='-X day'` (adjust to your preferences)
HOST=<ftp_server_hostname> (enter your FTP hostname)
USER=<ftp_user> (enter your FTP username)
PASS=<ftp_user_password> (enter your FTP user password)

 

[ErwanG]

Have you tryed to change password and try again? Maybe manually connect with current credentials when you're logged as root in shell to your FTP repository?

When you're logged in shell type: (most probablly you have same data in Home>Tools & Settings>Backup Manager>Personal FTP Repository>)
# ftp <ftp_server_hostname>

- after that you'll be asked for FTP username and password, you can also check this for FTP commands (or you can just google it, FTP commands):

Yes and the Plesk Backup is ok (FTP) with "Server configuration" parameter. But not with "Server configuration and content". That's the problem.

Thanks a lot for your script. It works fine for me. I must just verified the importation compatibility.

 

[MislavO]

Nice to hear that script is working, and no problem! We are here to share and help to each other.

 

[DjFarout]

I'm having the same issue. It was working just fine. then all of a sudden, it stopped.

Backups run, and I can upload the files using the script @MislavO posted (BTW thanks! MislavO)

The backups are ~15.4GB, and my storage NAS is on the same switch.

 

[ErwanG]

Hello,

I've always the problem with the Personal FTP Repository transfert.
I use the MislavO script but when i want to use it for restoring, it doesn't work.

Igor, which files are stored for the backup file ?
Command ?

Thank you.

 

[MislavO]

Current script only creates backup and upload it to personal FTP repository/deletes old backups, backup itself which is created is not meant to be used for restoration (only manually).

 

[ErwanG]

Yes.
But if we can create the same file than Plesk for the FTP, it will be great....

 

[MislavO]

I agree, well, this is only temporary solution until you fix this problem and you want to have backup somewhere.

Did you sent ticket to the Plesk Support? They always solve all problems

 

[DavidJH]

did you ever get a resolution to this problem, I have the same issue. Server will backup configuration files to personal ftp but not content. I wouldnt mind if pleask had a button to move backups from server to ftp like it does the other way around but that is not an option.
Any official Fixes available?

 

[ErwanG]

Hello,

No.
And no fix from Parallels....
The problem comes from Centos 5.x. It seems ok with Centos 6.x and after.

 

[MislavO]

did you ever get a resolution to this problem, I have the same issue. Server will backup configuration files to personal ftp but not content. I wouldnt mind if pleask had a button to move backups from server to ftp like it does the other way around but that is not an option.
Any official Fixes available?

So far, nothing.

 

[meichr]

Hi,
I have the same problem as described in the first posting, but I use OpenSUSE 11.4 and Plesk 10.4.4.
This problem has already caused two Plesk break downs due to filling up the /var partition instead of uploading to an FTP account.

So the error is somehow more a Plesk problem than an operating system problem.
Any fix from Plesk already?

Will also try the manual script posted above, thanks a lot to the community.

Plesk seems not to be very helpful
with any bugs they have cause long term.

 

[schmid_as]

We havn't had a problem with the FTP upload to our own Personal FTP repository since two years. But since one month we have the same problem as discussed.
Plesk will transfere a Server configuration backup but no full backup. @Plesk-Support when we can expect a fix for this problem?

 

[jhuedder]

... got the same problem!

 

[HyperP]

I´m having the same issues but tracked them down to 2 causes:

1.) passive mode ftp

If I use passive mode ftp it won´t work for the backup process (though viewing the personal ftp repository and any other ftp connection from the server to that passive ftp works fine).

2.) free space

I need to have the same amount of free space on my server as the backup will be in size. Because the backup is first being created on the server as *.tar.xml and then moved to the personal repository via ftp.