Automatic test framework for video streaming quality assessment

To understand better what happens when video streaming takes place, this paper introduces a framework to simulate a real-time video streaming over wireless channels. The system is divided into many modules and is simulated with different tools. DUMMYNET is used for the network simulator while FFMPEG is for coder/encoder and sender/receiver module. The video quality is measured by spatial (SSIM and PSNR) metrics. To permit automatic characteristic, a system controller with JENKINS is used to control the encoder, sender, network, receiver and decoder. A script at this server can be run to simulate automatically the system with many test cases for the practical network setting. The simulation results show that the simulated system can estimate accurately the quality of the videos transmitted over wireless network.