Gotta focus on uptime too, and DC reliability. BurstNET for example is ----. Their servers are cheap and powerful... but the network needs a lot of work before I'd ever consider it again. They go down and up randomly, and have slow periods... and their customer service is terrible.
When looking for hosting, or servers, or VPS's, I look for 99.9% uptime or better. That means that 99.9% of the time, that server will be online. I look for guarantees as well. People assume that figures such as 99.5% or 99% uptime will be good, but when you do the math... it gets pretty bad. If a datacenter's reliability is that bad, I wouldn't trust them with sensitive information.