Fixed it. I finally have 10/10 score on mail-tester and the mail even arrives at all different extension of mail.com who were very strict with receiving. The flaw lied in the reverse DNS name in the Vultr settings.
Learned a lot of this endurance which will come in handy as I run many vultr servers.