After last update DNSBL / SPF mail check fault

[Expert]

Hi, after update my Plesk 9.3 to last version I receive many SPAM messages.
Last version is 9.3.0-ubuntu8.04.build93091230.07
Before this update I have high CPU load by qmail-sender, now this problem is fixed, but SPAM filter by DNSBL and SPF don't work. I have a lot of SPAM messages with dns problem and hosts in dnsbl list...

But, another thing what I do is deleting AtMail and DrWeb from my server.
apt-get autoremove...

 

[IgorG]

Do you have any DNSBL/SPF problem related errors in Plesk maillog? Did you tried to rebuild mailsettings with 'mchk --with-spam'?

 

[Expert]

Do you have any DNSBL/SPF problem related errors in Plesk maillog?

I have a lot of this error in log
Apr 9 07:00:22 sss spf filter[26612]: Error code: (2) Could not find a valid SPF record
Apr 9 07:00:22 sss spf filter[26612]: Failed to query MAIL-FROM: No DNS data for 'be21.masterhost.ru'.

DNS on my host work correctly
ping be21.masterhost.ru
PING be21.masterhost.ru (217.16.16.221) 56(84) bytes of data.
64 bytes from be21.masterhost.ru (217.16.16.221): icmp_seq=1 ttl=61 time=1.29 ms

Did you tried to rebuild mailsettings with 'mchk --with-spam'?

I don't know how to do it in Ubuntu Server 8.04.

 

[Expert]

I found how to do this...

/usr/local/psa/admin/sbin/mchk --with-spam
==> Checking for: mail_spam_restore... not exsists
==> Checking for: mailsrv_conf_init... ok
==> Checking for: mail_mailbox_restore... ok
==> Checking for: mailsrv_entities_dump... ok
==> Checking for: mail_admin_aliases... ok
==> Checking for: mail_auth_dump... ok
==> Checking for: mailman_lists_dump... ok
==> Checking for: mail_responder_restore... ok
==> Checking for: mail_drweb_restore... not exsists
==> Checking for: mail_kav_restore... not exsists
==> Checking for: mail_spf_restore... ok
==> Checking for: mail_dk_restore... ok
==> Checking for: mail_grey_restore... ok

 

[IgorG]

Not sure, but there can be problems with SPF hooks for psa-mail-driver-common package. Try to check this package that it is correct version and upgrade all with

# /usr/local/psa/admin/sbin/autoinstaller --select-release-latest --upgrade-installed-components

 

[Expert]

Not sure, but there can be problems with SPF hooks for psa-mail-driver-common package. Try to check this package that it is correct version and upgrade all with

I Do this, but SPF do not work...
How I Can reinstall it?

Downloading the file products.inf3: 100% done.
Downloading the file plesk.inf3: 10%..21%..30%..41%..50%..60%..70%..80%..91%..100% done.
Downloading the file ppsmbe.inf3: 12%..27%..43%..58%..74%..89%..100% done.
Downloading the file sitebuilder.inf3: 15%..35%..55%..75%..96%..100% done.
Downloading the file sso.inf3: 10%..27%..40%..54%..67%..81%..94%..100% done.
Downloading the file setemplates.inf3: 38%..87%..100% done.
Checking for installed packages...
Downloading the file PSA_9.3.0/plesk-9.3.0-ubt8.04-x86_64.inf3: 10%..20%..31%..41%..52%..60%..70%..81%..91%..100% done.
Downloading the file PSA_9.3.0/plesk-patches-9.3.0-ubt8.04-x86_64.inf3: 57%..100% done.
В кеше http://ru.archive.ubuntu.com hardy Release.gpg
Получено:1 http://ru.archive.ubuntu.com hardy/main Translation-ru [33,6kB]
Получено:2 http://ru.archive.ubuntu.com hardy/restricted Translation-ru [1470B]
Получено:3 http://ru.archive.ubuntu.com hardy/universe Translation-ru [59,3kB]
Получено:4 http://ru.archive.ubuntu.com hardy/multiverse Translation-ru [955B]
Получено:5 http://ru.archive.ubuntu.com hardy-updates Release.gpg [189B]
Ign http://ru.archive.ubuntu.com hardy-updates/main Translation-ru
Ign http://ru.archive.ubuntu.com hardy-updates/restricted Translation-ru
Ign http://ru.archive.ubuntu.com hardy-updates/universe Translation-ru
Ign http://ru.archive.ubuntu.com hardy-updates/multiverse Translation-ru
В кеше http://ru.archive.ubuntu.com hardy Release
Получено:6 http://ru.archive.ubuntu.com hardy-updates Release [58,5kB]
В кеше http://ru.archive.ubuntu.com hardy/main Packages
В кеше http://ru.archive.ubuntu.com hardy/restricted Packages
В кеше http://ru.archive.ubuntu.com hardy/main Sources
Получено:7 http://security.ubuntu.com hardy-security Release.gpg [189B]
Ign http://security.ubuntu.com hardy-security/main Translation-ru
В кеше http://ru.archive.ubuntu.com hardy/restricted Sources
В кеше http://ru.archive.ubuntu.com hardy/universe Packages
В кеше http://ru.archive.ubuntu.com hardy/universe Sources
В кеше http://ru.archive.ubuntu.com hardy/multiverse Packages
В кеше http://ru.archive.ubuntu.com hardy/multiverse Sources
Получено:8 http://ru.archive.ubuntu.com hardy-updates/main Packages [475kB]
Получено:9 http://ru.archive.ubuntu.com hardy-updates/restricted Packages [9746B]
Получено:10 http://ru.archive.ubuntu.com hardy-updates/main Sources [122kB]
Получено:11 http://ru.archive.ubuntu.com hardy-updates/restricted Sources [943B]
Получено:12 http://ru.archive.ubuntu.com hardy-updates/universe Packages [226kB]
Ign http://security.ubuntu.com hardy-security/restricted Translation-ru
Ign http://security.ubuntu.com hardy-security/universe Translation-ru
Ign http://security.ubuntu.com hardy-security/multiverse Translation-ru
Получено:13 http://security.ubuntu.com hardy-security Release [58,5kB]
Получено:14 http://ru.archive.ubuntu.com hardy-updates/universe Sources [48,0kB]
Получено:15 http://ru.archive.ubuntu.com hardy-updates/multiverse Packages [28,8kB]
Получено:16 http://ru.archive.ubuntu.com hardy-updates/multiverse Sources [5229B]
Ign http://autoinstall.plesk.com hardy Release.gpg
Ign http://autoinstall.plesk.com hardy/all Translation-ru
Ign http://autoinstall.plesk.com hardy Release
В кеше http://autoinstall.plesk.com hardy/all Packages
Получено:17 http://security.ubuntu.com hardy-security/main Packages [206kB]
Получено:18 http://security.ubuntu.com hardy-security/restricted Packages [9738B]
Получено:19 http://security.ubuntu.com hardy-security/main Sources [36,0kB]
Получено:20 http://security.ubuntu.com hardy-security/restricted Sources [943B]
Получено:21 http://security.ubuntu.com hardy-security/universe Packages [109kB]
Получено:22 http://security.ubuntu.com hardy-security/universe Sources [17,5kB]
Получено:23 http://security.ubuntu.com hardy-security/multiverse Packages [12,0kB]
Получено:24 http://security.ubuntu.com hardy-security/multiverse Sources [1122B]
Получено 1520kB за 1s (1349kB/c)
Чтение списков пакетов...
Detecting installed product components.
Installing patches...
Downloading the file PSA_9.3.0/microupdates/MU1/dist-deb-Ubuntu-8.04-x86_64/qmail-queue: 11%..20%..30%..40%..50%..61%..71%..81%..91%..100% done.
Downloading the file PSA_9.3.0/microupdates/MU1/dist-deb-Ubuntu-8.04-x86_64/qmail-remote: 11%..21%..31%..40%..50%..60%..70%..81%..91%..100% done.
Downloading the file PSA_9.3.0/microupdates/MU2/dist-deb-Ubuntu-8.04-x86_64/sw-cp-serverd: 10%..20%..30%..40%..53%..60%..70%..80%..90%..100% done.
Hit http://ru.archive.ubuntu.com hardy Release.gpg
Hit http://ru.archive.ubuntu.com hardy-updates Release.gpg
Hit http://ru.archive.ubuntu.com hardy Release
Hit http://ru.archive.ubuntu.com hardy-updates Release
Hit http://ru.archive.ubuntu.com hardy/main Packages
Hit http://ru.archive.ubuntu.com hardy/restricted Packages
Hit http://ru.archive.ubuntu.com hardy/main Sources
Hit http://ru.archive.ubuntu.com hardy/restricted Sources
Hit http://ru.archive.ubuntu.com hardy/universe Packages
Hit http://ru.archive.ubuntu.com hardy/universe Sources
Hit http://ru.archive.ubuntu.com hardy/multiverse Packages
Hit http://ru.archive.ubuntu.com hardy/multiverse Sources
Hit http://ru.archive.ubuntu.com hardy-updates/main Packages
Hit http://ru.archive.ubuntu.com hardy-updates/restricted Packages
Hit http://ru.archive.ubuntu.com hardy-updates/main Sources
Hit http://ru.archive.ubuntu.com hardy-updates/restricted Sources
Hit http://ru.archive.ubuntu.com hardy-updates/universe Packages
Hit http://ru.archive.ubuntu.com hardy-updates/universe Sources
Hit http://ru.archive.ubuntu.com hardy-updates/multiverse Packages
Hit http://ru.archive.ubuntu.com hardy-updates/multiverse Sources
Hit http://security.ubuntu.com hardy-security Release.gpg
Hit http://security.ubuntu.com hardy-security Release
Hit http://security.ubuntu.com hardy-security/main Packages
Hit http://security.ubuntu.com hardy-security/restricted Packages
Hit http://security.ubuntu.com hardy-security/main Sources
Hit http://security.ubuntu.com hardy-security/restricted Sources
Hit http://security.ubuntu.com hardy-security/universe Packages
Hit http://security.ubuntu.com hardy-security/universe Sources
Hit http://security.ubuntu.com hardy-security/multiverse Packages
Hit http://security.ubuntu.com hardy-security/multiverse Sources
Reading package lists...

 

[MacroP]

same problem here how can i re-install all handlers/hooks?

If i switch them on then qmail-queue is completely misbehaving. a reinstallation of psa-mail-driver-common does not fix it which is the correct package in order to reinstall the hooks such as spf, drweb, spam dk-check dk-verify

 

[IgorG]

You can recover and remove broken handlers with following method:

1. Stop mail service.

~# /usr/local/psa/admin/sbin/mailmng --stop-service

2. Find all corrupted mail headers using the following command. For example:

~# find /usr/local/psa/handlers/before-* -type f | while read h ; do [ ! -d /usr/local/psa/handlers/info/$(basename $h) ] && echo $h ; done
/usr/local/psa/handlers/before-local/recipient/[email protected]/20-drweb-wDB2eC
~#

In output the command provides name of mail handlers that do not have link to executable binary.

3. Remove the file you have got:

~# rm -f /usr/local/psa/handlers/before-local/recipient/[email protected]/20-drweb-wDB2eC

4. Run utility mchk to recreate mail handlers. The output may look like the following:

~# /usr/local/psa/admin/sbin/mchk --with-spam
==> Checking for: mail_spam_restore... ok
==> Checking for: mailsrv_conf_init... ok
==> Checking for: mail_mailbox_restore... ok
==> Checking for: mailsrv_entities_dump... ok
==> Checking for: mail_admin_aliases... ok
==> Checking for: mail_auth_dump... ok
==> Checking for: mailman_lists_dump... ok
==> Checking for: mail_responder_restore... ok
==> Checking for: mail_drweb_restore... ok
==> Checking for: mail_kav_restore... not exsists
==> Checking for: mail_spf_restore... ok
==> Checking for: mail_dk_restore... ok
==> Checking for: mail_grey_restore... ok
~#

Start mail service after the reconfiguration:

~# /usr/local/psa/admin/sbin/mailmng --start-service

 

[MacroP]

Hello Igor,

i followed your recover and remove broken handlers advice and after testing the problems still persist.

As more Mail handlers (greylisting, spf, spam, domainkeys) i switch on as more problems with the mail appear. Mail just get lost, bounced back, multple times delivered all depending on the combination of Mail handlers activated.

I also noticed in the weblog that there must be a programming bug because mail send from local host via php-mail script got screened by the spf handler but not when i relay the message through the same server. It should surely not SPF a mail send from localhost - just also does not make any sense to check anyhow. the error message is identical the same as with Drweb

## Outgoing MAIL via (php-mail-script) SPF activated ##
>> Result >> no mail reaches the receiver

May 19 23:42:13 mail qmail-queue-handlers[32440]: Handlers Filter before-queue for qmail started ...
May 19 23:42:13 mail qmail-queue-handlers[32440]: [email protected]
May 19 23:42:13 mail qmail-queue-handlers[32440]: [email protected]
May 19 23:42:13 mail qmail-queue-handlers[32440]: hook_dir = '/usr/local/psa/handlers/before-queue'
May 19 23:42:13 mail qmail-queue-handlers[32440]: Unable to stat entry '/usr/local/psa/handlers/info/10-spf-83crEe/executable' or it is not link: Permission denied
May 19 23:42:13 mail qmail-queue-handlers[32440]: call_handlers: stop call handlers from dir '/usr/local/psa/handlers/before-queue/global'

 

[MacroP]

Hi Igor just one additional remark.

Here is another plesk user, with centos 5 64bit and plesk panel that is searching since a month desperately for a solution. this form covers the details identified by myself as well. We assume that the handlers are not the problem since they are complete and after recoverd and verfied by your scripts several time. But it appears to me that it must be a permission issue of the hook itself or how the hooks pass the data on to the qmail-queue.

http://forum.parallels.com/showthread.php?t=109260