I know that you are using CentOS, however, some VPS providers allow you to reinstall an OS or install an diffrent OS via their admin panel. If so, I would recommend using EHCP (http://ehcp.net) by switching from CentOS to Ubuntu and then running the install. It will get you up and running with everything in about an hour. Just a suggestion though. (Note: requires > 500MB RAM, so it may not be the best either).
Erm... server? Ubuntu!?
Compare to Ubuntu and CentOS, I think it is better to recommend the OP to use CentOS...