Benchmarking data warehouse systems in the cloud

The most common benchmarks for cloud computing are the Terasort benchmark and the YCSB benchmark. Although these benchmarks are quite useful, they were not designed for data warehouse systems and related OLAP technologies. In this paper, first, we present cloud computing and data warehouse systems. Then, we argue that TPC-H benchmark - the most prominent benchmark for decision support system, mismatches cloud rationale (scalability, elasticity, pay-per-use, fault-tolerance features) and Customer Relationship Management rationale (enduser satisfaction, Quality of Service features). Finally, we present new requirements for implementing a benchmark for data warehouse systems in the cloud. The proposed requirements should allow a fair comparison of different cloud systems providers' offerings.