At times just after I do some activity (such as removing comments) after logged into WP Dashboard, the site stops loading on my device. This is resolved after few minutes. Is it due to lack of memory which can be resolved if PHP memory limit raised?
What you describe is a typical fail2ban behavior when the plesk-modsecurity jail is active.
Try to disable plesk-modsecurity jail and see if that works for you: