Opportunities and challenges of using crowdsourced measurements for mobile network benchmarking a case study on RTR open data

Crowdsourcing is a novel paradigm which has applications in a plethora of disciplines including software development, public administration, and communication technologies. In the field of telecommunications, crowdsourcing makes a viable addition to state of the art benchmarking methods for mobile networks, when combined with mobile sensing approaches to employ smartphones as end nodes. In this paper, we review the opportunities and challenges of using crowdsourced measurements from smartphones for benchmarking mobile networks, and demonstrate some of these generic aspects using an open data set containing over two million entries. We show that there is a big potential to distributing performance measurements towards the peripherals of the network, but in order to achieve accurate benchmarking, the collection of data has to be complemented with appropriate signal processing. Our study also emphasizes the importance of open data and open source tooling in achieving fairness and repeatability.