On an absolute evaluation method of the quality of television sequences

This paper describes the reliability of scores obtained in subjective evaluation tests of picture quality using the double-stimulus continuous quality-scale method (the DSCQS method) and the single-stimulus five-grade quality scale method (the SSQS method). First, it is shown that the mean scores with the absolute scale of the DSCQS method do not extend to a higher grade, unlike those with the SSQS method, and that the capability of assessors to recognize small quality differences in the absolute scale of the DSCQS method is inferior to that in the SSQS method. Next, the reason why the results obtained using two methods are different even with the same five-grade quality scale is investigated. It is found that the scale divisions on the vertical line described in the score sheet of the DSCQS method can affect significantly the distribution of scores and also the capability of assessors to recognize small quality differences. Finally, it is concluded that it is better to replace the graph scale with the continuous five-grade category scale to improve the reliability of the DSCQS method.