I can't remember there being a close button to close the terminal. To my knowledge the terminal always functioned directly on a page in Plesk. Not as layover window, modal or popup. That being said, I never used the terminal in Plesk much, so I could be wrong. If there ever was close button it probably got removed during an update of the extension. Not as a result of your SSH port change.