Ask YC: Recommendations for a good VPS/Cloud Host benchmarking tool?

I am planning on hosting a variety of applications (Several Open Source business apps) on a VPS or Cloud Hosting provider, and I am wanting to benchmark several providers to see how they stack up, so I'm looking for a relatively quick to install Linux app that can run benchmarks over a period of time and give me results in a fairly usable form. Any suggestions? Also, any recommendations for how I should setup the test would be helpful!