Subjective evaluation of image understanding results

Image understanding has many applications. Given an image and a ground truth, it is possible to measure the quality of understanding results provided by different algorithms or parameters. In this paper, we ask some users to make a subjective evaluation of image understanding results by sorting them from the best to the worst. We compared the results with some provided by a metric we defined recently. Experimental results show the good behavior of this metric compared to the human judgment.