Hello,
I agree with Christoph, but a solution would be that Plesk change the preview url by replacing the dots in the domain name by a "-".
This way you would have for example https://test-fr.<ip>.domain.com and a wild card on *.<ip>.domain.com would work.