I had plesk support help me, as it turns out iptables takes forever to process a single command, sometimes several minutes. So applying any new configuration/turning on the firewall from the GUI was impossible. Increasing the timeout to 600 seconds enabled me to at least apply the configuration...