I'd check with Contabo if one of their IP ranges that your on is being flooded with SMTP requests and they maybe have their mitigation turned on as this sounds like their DDOS protection and it runs on CIDR, if your IP range is on that CIDR then your SMTP traffic will be affected too. You may have to ask them for a different IP range if they'll give it to you.