Have a look at the content of your .pem file, it should contain the line:
-----BEGIN RSA PRIVATE KEY-----
This is the private key (.key). Copy and paste everything (including the ---BEGIN line and the ---END line) to the "private key" field in Plesk.
Do the same with the .cer file and copy & paste the content to the "Certifcate" field in Plesk.