Efficient Batch Scheduling of Large Numbers of Cloud Benchmarks

This paper proposes a framework for efficiently running benchmarks on one or multiple cloud environments. It is essential that users and businesses utilize benchmarks to understand the performance of their network or the cloud environment where they host their virtual network and machines. When performing a large number of benchmarks, we have found it necessary to construct a tool that allows us to automatically and efficiently schedule the benchmarks we need to run without exceeding our resource limits or interfering with other benchmarks. We have developed a benchmarking tool called PKB_scheduler that accepts benchmark configuration files, and will construct an optimal graph of virtual machine usage. PKB_scheduler will use this graph to dynamically schedule batches of benchmarks to run, seeking to reduce the total number of batches and thus the overall time of benchmark execution.