mBenchLab: Measuring QoE of Web applications using mobile devices

In this paper, we present mBenchLab, a software infrastructure to measure the Quality of Experience (QoE) on tablet and smartphones accessing cloud hosted Web services. mBenchLab does not rely on emulation but uses real phones and tablets with their original software stack and communication interfaces for performance evaluation. We have used mBenchLab to measure the QoE of well-known web sites on various devices (Android tablets and smartphones) and networks (Wifi, 3G, 4G). We present our experimental results and lessons learned measuring QoE on mobile devices with mBenchLab. In our QoE analysis, we were able to discover a new bug in a very popular smartphone that impacts both performance and data usage. We have also made the entire mBenchLab software available as open source to the community to measure QoE on mobile devices that access cloud-hosted Web applications.