To get the most correct benchmark results we should run the tests on
different machines. The Fabric tool might be good for that:

  http://www.nongnu.org/fab/

It is meant for deploying (web)applications on (web)servers.