Energy- and Heat-Aware HPC Benchmarks

To evaluate data centers is tough. Several metrics are available to provide insight into their behaviour, but usually they are tested using simple benchmarks like linpack for HPC oriented data centers. A good choice of benchmarks is necessary to evaluate all the impact of applications on those data centers. One point that is often overlooked is their energy- and thermal-quality. To evaluate these qualities, adequate benchmarks are required from several points of view: from the nodes to the whole building. Classical benchmarks selection mainly focuses on time and raw performance. This article aims at shifting the focus towards an energy- and power-point of view. To this end, we select benchmarks able to evaluate data centers not only from this performance perspective, but also from the energy and thermal standpoint. We also provide insight into several classical benchmarks and method to select an adequate and small number of benchmarks in order to provide a sensible and minimum set of energy- and thermal-aware benchmarks for HPC systems.