Performance evaluation of cloud systems: A behavioural approach

The concept of Cloud Engineering (CE) as a superset of performance engineering emerges in an extensive number of industrial architectural approaches and implementation flavours. To effectively manage cloud-based systems, it is crucial to monitor, to meter and then to allocate their structural behaviour and performance. In the context of this work, considerable number of experimental measurements are conducted in a distributed virtualised infrastructure and statistically analysed. The paper aims to evaluate cloud systems using multiple open-source benchmarking tools. Also, it addresses and discusses operational deviations of a commercial cloud system in respect to the service level objects (SLOs) per se.