Uninstall any services that are not vital for running the website. This will inevitably remove daemons (programs that constantly run in the background) which drain resources such as CPU power and RAM.
Manually install the server (e.g. LAMP & CMS) instead of using a distribution with an overlay like cPanel or Plesk. And if an administrative overlay is needed, choose a light solution such as Webmin.