@Umbus, I would imagine that you are not connecting to the server from the mail client correctly... First on all I would try to establish a test connection with a test e-mail account over unencrypted SMTP port 25.
As you can only receive mail I assume your IMAP/POP config is perfectly fine.