Thanks Igor,
Ok, so I have followed the instructions and now have multiple PHP versions. How do I install PHP extensions such as Mcrypt etc for the newly enabled PHP version?
My Plesk installation (on Debian Wheezy) has PHP5.4.4 and I need to upgrade it to 5.4.9 or above.
How can I do this (It's a self managed Plesk server)?